Brignardello‐Petersen, Romina

Introduction Many clinical practice guidelines (CPGs) claim to use Grading of Recommendations Assessment, Development and Evaluation (GRADE) approach, but its implementation varies. This suggests that CPG developers, methodologists and users would benefit from an instrument to evaluate the extent to which CPGs adhere to GRADE approach. Such a structured instrument is currently unavailable. Accordingly, this study will develop an evaluation instrument for assessing guideline adherence to the GRADE approach, which we have named ‘GRADE-Check’. The goal is to target items to which CPGs fail to adhere and that potentially have serious consequences resulting in inaccuracies in certainty of evidence and inappropriate direction or strength of recommendations, thereby discriminating across CPGs in issues of importance. Methods and analysis The panel will include up to 25 individuals with specific knowledge and expertise, including experienced authors, educators and methodologists on CPGs methodology and GRADE approach from relevant organisations. The instrument will focus on the key elements of GRADE, aiming for clarity for GRADE experts and non-GRADE experts to apply. The development process for GRADE-Check will consist of the following five phases: (1) recruitment of a panel of GRADE experts; (2) development of objectives and scope for the development of GRADE-Check and criteria for item selection; (3) generation of candidate items through a literature review and panel consultation; (4) panellist discussion to construct the initial draft and extended explanation manual and (5) user testing. Ethics and dissemination This study has been approved by the Medical Ethics Committee of Zhongnan Hospital of Wuhan University (no. (2025047K)). Our research findings will be published in peer-reviewed journal articles and presented at academic conferences. Additionally, the dissemination plan will include considerations for the development of implementation manuals, a dedicated project website and training tools.

When one initially targets the null effect and the point estimate falls close to the null, two challenges exist in rating certainty of evidence. First, when the point estimate is near the null and the data, therefore, suggests little or no effect, rating certainty in a benefit or harm is misleading. Second, since in general the narrower the confidence interval (CI) the more precise the estimate, if the CI is narrow, rating down for imprecision due simply to crossing the null is inappropriate. This paper addresses these issues and provides a solution: to revise the target of certainty rating from a non-zero effect to a little or no effect. This solution requires estimating a range in which the minimal important difference (MID) for benefit and an MID for harm might lie, and thus establishing a range that represents little or no effect. If GRADE (Grading of Recommendations, Assessment, Development, and Evaluations) users are confident that the point estimate represents an effect less than the smallest plausible MID, they will revise their target and rate certainty to a little or no effect. If the entire CI falls within the range of little or no effect, they will not rate down for imprecision. Otherwise (if the CI includes an important effect), they will rate down. Using the solution provided in this paper GRADE users can make an optimal choice of the target of certainty rating.