Introduction Many clinical practice guidelines (CPGs) claim to use Grading of Recommendations Assessment, Development and Evaluation (GRADE) approach, but its implementation varies. This suggests that CPG developers, methodologists and users would benefit from an instrument to evaluate the extent to which CPGs adhere to GRADE approach. Such a structured instrument is currently unavailable. Accordingly, this study will develop an evaluation instrument for assessing guideline adherence to the GRADE approach, which we have named ‘GRADE-Check’. The goal is to target items to which CPGs fail to adhere and that potentially have serious consequences resulting in inaccuracies in certainty of evidence and inappropriate direction or strength of recommendations, thereby discriminating across CPGs in issues of importance. Methods and analysis The panel will include up to 25 individuals with specific knowledge and expertise, including experienced authors, educators and methodologists on CPGs methodology and GRADE approach from relevant organisations. The instrument will focus on the key elements of GRADE, aiming for clarity for GRADE experts and non-GRADE experts to apply. The development process for GRADE-Check will consist of the following five phases: (1) recruitment of a panel of GRADE experts; (2) development of objectives and scope for the development of GRADE-Check and criteria for item selection; (3) generation of candidate items through a literature review and panel consultation; (4) panellist discussion to construct the initial draft and extended explanation manual and (5) user testing. Ethics and dissemination This study has been approved by the Medical Ethics Committee of Zhongnan Hospital of Wuhan University (no. (2025047K)). Our research findings will be published in peer-reviewed journal articles and presented at academic conferences. Additionally, the dissemination plan will include considerations for the development of implementation manuals, a dedicated project website and training tools.
Assessment of the DASH-TOP Shared decision-making intervention using the decisional conflict scale: A mixed- method study
Abstract Background Venous thromboembolism (VTE) in pregnancy is a major cause of maternal morbidity and death. The use of low-molecular-weight heparin (LMWH), despite being the standard of care to prevent VTE, comes with some challenges. Shared decision-making (SDM) interventions are recommended to support patients and clinicians in making preference-sensitive decisions. The quality of the SDM process has been widely assessed with the decisional conflict scale (DCS). Our aim is to report participants’ perspectives of each of the components of an SDM intervention (DASH-TOP) in relation to the different subscales of the DCS. Methods Design: A convergent, parallel, mixed-methods design. Participants: The sample consisted of 22 health care professionals, students of an Applied Clinical Research in Health Sciences (ICACS) master program. Intervention: We randomly divided the participants in three groups: Group 1 received one component (evidence -based information), Group 2 received two components (first component and value elicitation exercises), and Group 3 received all three components (the first two and a decision analysis recommendation) of the SDM intervention. Analysis: For the quantitative strand, we used a non-parametric test to analyze the differences in the DCS subscales between the three groups. For the qualitative strand, we conducted a content analysis using the decisional conflict domains to deductively categorize the responses. Results Groups that received more intervention components experienced less conflict and better decision-making quality, although the differences between groups were not statistically significant. The decision analysis recommendation improved the efficacy with the decision-making process, however there are some challenges when implementing it in clinical practice. The uncertainty subscale showed a high decisional conflict for all three groups; contributing factors included low certainty of the evidence-based information provided and a perceived small effect of the drug to reduce the risk of a VTE event. Conclusions The DASH-TOP intervention reduced decisional conflict in the decision -making process, with decision analysis being the most effective component to improve the quality of the decision. There is a need for more implementation research to improve the delivery of SDM interventions in the clinical encounter.
Women’s values and preferences on low-molecular-weight heparin and pregnancy: a mixed-methods systematic review
Abstract Background: Venous thromboembolism (VTE) in pregnancy is an important cause of maternal morbidity and mortality. Low-molecular-weight heparin (LMWH) is the cornerstone of prophylaxis and treatment of thrombotic events during pregnancy. LMWH has fewer adverse effects than other anticoagulants, does not cross the placenta, and is safe for the fetus. However, the use of LMWH during pregnancy is sensitive to womens’ underlying preferences. The objective of this review is to systematically assess women’s values and preferences research evidence on this topic.Methods: We searched four electronic databases from inception to March 2022, and included studies examining values and preferences of using LMWH among pregnant women at risk of VTE. We followed a convergent integrated mixed-methods design to compare and contrast quantitative (utility and non-utility measures) and qualitative findings. We assessed the certainty of the values and preferences evidence with the GRADE approach for quantitative findings, and with GRADE-CERqual for qualitative evidence. Results were presented in a conjoint display.Results: We screened 3,393 references and identified seven eligible studies. The mixed methods analysis resulted in four themes. Datasets confirmed each other in that: 1) the majority of women consider that benefits of treatment outweigh the inconveniences of daily injections; and 2) main concerns around medication are safety and injections administration. Quantitative outcomes expanded on the qualitative findings in that: 3) participants who perceived a higher risk of VTE were more willing to take LMWH. Finally, we found a discrepancy between the datasets around: 4) the amount of information preferred to make the decision; however, qualitative data expanded to clarify that women prefer making informed decisions and receive support from their clinician in their decision-making process.Conclusions: We are moderately confident that in the context of pregnancy, using LMWH is preferred by women given its net beneficial balance. Integrating data from different sources of evidence, and representing them in a jointly manner helps to identify patient’s values and preferences. Our results may inform clinical practice guidelines and support shared decision-making process in the clinical encounter for the management of VTE in the context of pregnancy.
Association of Postoperative High-Sensitivity Troponin Levels With Myocardial Injury and 30-Day Mortality Among Patients Undergoing Noncardiac Surgery
AbstractBackgroundExploration of values and preferences in the context of anticoagulation therapy for atrial fibrillation (AF) remains limited. To better characterize the distribution of patient and physician values and preferences relevant to decisions regarding anticoagulation in patients with AF, we conducted interviews with patients at risk of developing AF and physicians who manage patients with AF.MethodsWe interviewed 96 outpatients and 96 physicians in a multicenter study and elicited the maximal increased risk of bleeding (threshold risk) that respondents would tolerate with warfarin vs. aspirin to achieve a reduction in three strokes in 100 patients over a 2‐year period. We used the probabilistic version of the threshold technique.ResultsThe median threshold risk for both patients and physicians was 10 additional bleeds (10 P = 0.7). In both groups, we observed large variability in the threshold number of bleeds, with wider variability in patients than clinicians [patient range: 0–100, physician range: 0–50]. We observed one cluster of patients and physicians who would tolerate <10 bleeds and another cluster of patients, but not physicians, who would accept more than 35.ConclusionsOur findings suggest wide variability in patient and physician values and preferences regarding the trade‐off between strokes and bleeds. Results suggest that in individual decision making, physician and patient values and preferences will often be discordant; this mandates tailoring treatment to the individual patient's preferences.
051 Can We Automatically Produce Generic Decision Aids for the Clinical Encounter Directly from GRADE Guideline Recommendations? Experience from the Share-It Project
Background Although decision aids (DA) can help to communicate evidence to patients, their production is time consuming, often not based on the best available evidence or rapidly outdated. Linking trustworthy guidelines and DA for shared-decision making could both overcome these limitations and enhance guideline dissemination. Objectives To test the feasibility of automatically translating any recommendations from GRADE guidelines into generic and interactive DA accessible on tablet computers for clinicians and their patients in the clinical encounter. Methods As part of the DECIDE project, we developed a framework for translating components of GRADE into DA, following the International Patient Decision Aid Standards. Using a recently published guideline, we implemented that framework in our MAGIC (Making Grade the Irresistible Choice) application – a prototype electronic guideline tool and publication platform that can automatically display recommendations in multilayered presentation formats. Results Our prototype was able to automatically translate a large number of GRADE recommendations and their supporting evidence into electronic and interactive DA. Preliminary results of user-testing in real patient-clinician interactions suggest that these DA can be used at the point of care to discuss estimates of treatment effects for patient relevant outcomes, confidence in estimates, burden of treatment, and cost issues. Discussion This study provides a proof-of-concept that components of GRADE recommendations can be interactively displayed in generic tools for interactive shared-decision making in a wide range of treatment alternatives. Implications for Guideline Developers/Users Our electronic DA offer promising opportunities to disseminate guidelines at the point of care.
Is Too Much Intervention Recommended in the ACP Osteoporosis Treatment Guidelines?
OBJECTIVE—We sought to systematically ascertain the quality of randomized controlled trials (RCTs) in diabetes. RESEARCH DESIGN AND METHODS—We identified the 10 most recently published trials as of 31 October 2003 in each of six general medical, five diabetes, and five metabolism and nutrition journals and further enriched our sample with 10 additional RCTs from each of five journals that published the most eligible RCTs in a year. We explored the association between trial characteristics and reporting quality using univariate analyses and a preplanned multivariate regression model. RESULTS—After excluding redundant reports of included trials and one trial that measured outcomes on the health system and not on patients, we included 199 RCTs: 119 assessed physiological and other laboratory outcomes, 42 assessed patient-important outcomes (e.g., morbidity and mortality, quality of life), and 38 assessed surrogate outcomes (e.g., disease progression or regression, HbA1c, cholesterol). Fifty-three percent were of low methodological quality, as were one-third (36–40%) of trials reporting patient-important or surrogate outcomes and two-thirds (64%) of laboratory investigations. Independent predictors of low quality were nonprofit funding source (odds ratio 3.1 [95% CI 1.5–6.2]), measure of physiological and laboratory outcomes (2.3 [1.2–4.4]), and cross-over design (2.3 [1.1–4.8]), all characteristics of laboratory clinical investigations. CONCLUSIONS—There is ample room for improving the quality of diabetes trials. To enhance the practice of evidence-based diabetes care, trialists need to pay closer attention to the rigorous implementation and reporting of important methodological safeguards against bias in randomized trials.