Morgan, Rebecca L.

Abstract Introduction While certainty of evidence assessment is key to a rigorous and transparent systematic review, it is unknown how – and how frequently – it is assessed in systematic reviews. The objective of this study was to examine the prevalence and approaches used for certainty of evidence assessment in systematic reviews published in high‐impact medicine journals over the past 11 years. Methods A PubMed search and hand‐searching of relevant journal websites identified systematic reviews published between 24 January 2013 and 23 January 2024 in any of the ten highest‐impact journals in the General and Internal Medicine category of the Journal Citation Report. Two reviewers independently selected any systematic review related to health outcomes assessing certainty of evidence using any method. We extracted data related to review characteristics, certainty of evidence and risk of bias/methodological quality assessment frameworks, and reported consideration of certainty of evidence domains. Logistic regression examined year of publication to determine whether the prevalence of certainty of evidence assessment changed over time. Results Of 1,023 included reviews, 346 (33.8%) assessed certainty of evidence. Prevalence of certainty of evidence assessment increased over time (0.16 ± 0.2; p < .001). Most (89.3%) of reviews used the Grading of Recommendations Assessment, Development and Evaluation (GRADE) framework to assess certainty of evidence. Conclusion Only one in three systematic reviews published in the highest‐impact medical journals over the past 11 years assessed certainty of evidence, though prevalence increased over time. The use of specific domains within each certainty of evidence framework was not clearly described in all reviews.

Abstract Background The Grading Recommendations, Assessment, Development, and Evaluations (GRADE) framework is widely applied in clinical guidelines to facilitate transparent evidence evaluation. While developing Infectious Diseases Society of America (IDSA) guidelines on the management of patients with coronavirus disease 2019 (COVID-19), panel members suggested developing and implementing a visual aid to enable quicker identification of key information by providers at bedside seeking guidance. Methods We conducted a mixed-methods study evaluating the usability of a newly designed infographic/icon using a survey and focus groups. The survey incorporated a simulated COVID-19 IDSA guideline with and without the icon, followed by comprehension questions. Focus group discussions provided qualitative feedback on the GRADE methodology and icon usability. Results The survey was returned by 289 health care providers. There was no statistical difference in the correct response rates between icon-aided and non-icon-aided guideline questions (McNemar's chi-square test, P &gt; .1 for both questions). Interactions with the icon notably increased the time taken and number of clicks required to respond to the first question (Wilcoxon signed-rank test, P &lt; .01). In contrast, response time did not differ between versions for the second question (P = .38). Most subjects (85%) indicated that the icon improved the readability of the guidelines. A focus group follow-up suggested alternative designs for the icon. Conclusions This study highlights the promise of iconography in clinical guidelines, although the specific icons tested did not measurably improve usability metrics. Future research should focus on icon design and testing within a formal usability framework, considering the impact of GRADE language on user experience.

Abstract Background The role of serologic testing for severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) has evolved during the pandemic as seroprevalence in global populations has increased. The Infectious Diseases Society of America convened an expert panel to perform a systematic review of the coronavirus disease 2019 (COVID-19) serology literature and construct updated best practice guidance related to SARS-CoV-2 serologic testing. This guideline is an update to the fourth in a series of rapid, frequently updated COVID-19 guidelines developed by the Infectious Diseases Society of America. Objective To develop evidence-based recommendations and identify unmet research needs pertaining to the use of anti–SARS-CoV-2 antibody tests for diagnosis, decisions related to vaccination and administration of monoclonal antibodies or convalescent plasma in immunocompromised patients, and identification of a serologic correlate of immunity. Methods A multidisciplinary panel of infectious diseases clinicians, clinical microbiologists, and experts in systematic literature reviewed, identified, and prioritized clinical questions related to the use of SARS-CoV-2 serologic tests. Grading of Recommendations Assessment, Development and Evaluation methodology was used to assess the certainty of evidence and make testing recommendations. Results The panel recommends against serologic testing to diagnose SARS-CoV-2 infection in the first 2 weeks after symptom onset (strong recommendations, low certainty of evidence). Serologic testing should not be used to provide evidence of COVID-19 in symptomatic patients with a high clinical suspicion and repeatedly negative nucleic acid amplification test results (strong recommendation, very low certainty of evidence). Serologic testing may assist with the diagnosis of multisystem inflammatory syndrome in children (strong recommendation, very low certainty of evidence). To seek evidence for prior SARS-CoV-2 infection, the panel suggests testing for immunoglobulin G (IgG), IgG/IgM, or total antibodies to nucleocapsid protein 3 to 5 weeks after symptom onset (conditional recommendation, low certainty of evidence). In individuals with previous SARS-CoV-2 infection or vaccination, the panel suggests against routine serologic testing given no demonstrated benefit to improving patient outcomes (conditional recommendation, very low certainty of evidence). The panel acknowledges further that a negative spike antibody test may be a useful metric to identify immunocompromised patients who are candidates for immune therapy. Conclusions The high seroprevalence of antibodies against SARS-CoV-2 worldwide limits the utility of detecting anti-SARS CoV-2 antibody. The certainty of available evidence supporting the use of serology for diagnosis was graded as very low to low. Future studies should use serologic assays calibrated to a common reference standard.

Abstract Accurate molecular diagnostic tests are necessary for confirming a diagnosis of coronavirus disease 2019 (COVID-19) and for identifying asymptomatic carriage of severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2). The number of available SARS-CoV-2 nucleic acid detection tests continues to increase as does the COVID-19 diagnostic literature. Thus, the Infectious Diseases Society of America (IDSA) developed an evidence-based diagnostic guideline to assist clinicians, clinical laboratorians, patients, and policymakers in decisions related to the optimal use of SARS-CoV-2 nucleic acid amplification tests. In addition, we provide a conceptual framework for understanding molecular diagnostic test performance, discuss nuances of test result interpretation in a variety of practice settings, and highlight important unmet research needs related to COVID-19 diagnostic testing. IDSA convened a multidisciplinary panel of infectious diseases clinicians, clinical microbiologists, and experts in systematic literature review to identify and prioritize clinical questions and outcomes related to the use of SARS-CoV-2 molecular diagnostics. Grading of Recommendations Assessment, Development and Evaluation (GRADE) methodology was used to assess the certainty of evidence and make testing recommendations. The panel agreed on 12 diagnostic recommendations. Access to accurate SARS-CoV-2 nucleic acid testing is critical for patient care, hospital infection prevention, and the public health response to COVID-19 infection. Information on the clinical performance of available tests continues to grow, but the quality of evidence of the current literature to support this updated molecular diagnostic guideline remains moderate to very low. Recognizing these limitations, the IDSA panel weighed available diagnostic evidence and recommends nucleic acid testing for all symptomatic individuals suspected of having COVID-19. In addition, testing is suggested for asymptomatic individuals with known or suspected contact with a COVID-19 case when the results will impact isolation/quarantine/personal protective equipment (PPE) usage decisions. Evidence in support of rapid testing and testing of upper respiratory specimens other than nasopharyngeal swabs, which offer logistical advantages, is sufficient to warrant conditional recommendations in favor of these approaches.

OBJECTIVES: To develop evidence-based recommendations for clinicians caring for adults with acute liver failure (ALF) or acute on chronic liver failure (ACLF) in the ICU. DESIGN: The guideline panel comprised 27 members with expertise in aspects of care of the critically ill patient with liver failure or methodology. We adhered to the Society of Critical Care Medicine standard operating procedures manual and conflict-of-interest policy. Teleconferences and electronic-based discussion among the panel, as well as within subgroups, served as an integral part of the guideline development. INTERVENTIONS: In part 2 of this guideline, the panel was divided into four subgroups: neurology, peri-transplant, infectious diseases, and gastrointestinal groups. We developed and selected Population, Intervention, Comparison, and Outcomes (PICO) questions according to importance to patients and practicing clinicians. For each PICO question, we conducted a systematic review and meta-analysis where applicable. The quality of evidence was assessed using the Grading of Recommendations Assessment, Development, and Evaluation approach. We used the evidence to decision framework to facilitate recommendations formulation as strong or conditional. We followed strict criteria to formulate best practice statements. MEASUREMENTS AND MAIN RESULTS: We report 28 recommendations (from 31 PICO questions) on the management ALF and ACLF in the ICU. Overall, five were strong recommendations, 21 were conditional recommendations, two were best-practice statements, and we were unable to issue a recommendation for five questions due to insufficient evidence. CONCLUSIONS: Multidisciplinary, international experts formulated evidence-based recommendations for the management ALF and ACLF patients in the ICU, acknowledging that most recommendations were based on low quality and indirect evidence.

Abstract Immunoassays designed to detect SARS-CoV-2 protein antigens (Ag) are commonly used to diagnose COVID-19. The most widely used tests are lateral flow assays that generate results in approximately 15 minutes for diagnosis at the point-of-care. Higher throughput, laboratory-based SARS-CoV-2 Ag assays have also been developed. The number of commercially available SARS-CoV-2 Ag detection tests has increased rapidly, as has the COVID-19 diagnostic literature. The Infectious Diseases Society of America (IDSA) convened an expert panel to perform a systematic review of the literature and develop best-practice guidance related to SARS-CoV-2 Ag testing. This guideline is an update to the third in a series of frequently updated COVID-19 diagnostic guidelines developed by the IDSA. IDSA's goal was to develop evidence-based recommendations or suggestions that assist clinicians, clinical laboratories, patients, public health authorities, administrators, and policymakers in decisions related to the optimal use of SARS-CoV-2 Ag tests in both medical and nonmedical settings. A multidisciplinary panel of infectious diseases clinicians, clinical microbiologists, and experts in systematic literature review identified and prioritized clinical questions related to the use of SARS-CoV-2 Ag tests. A review of relevant, peer-reviewed published literature was conducted through 1 April 2022. Grading of Recommendations Assessment, Development, and Evaluation (GRADE) methodology was used to assess the certainty of evidence and make testing recommendations. The panel made 10 diagnostic recommendations that address Ag testing in symptomatic and asymptomatic individuals and assess single versus repeat testing strategies. US Food and Drug Administration (FDA) SARS-CoV-2 Ag tests with Emergency Use Authorization (EUA) have high specificity and low to moderate sensitivity compared with nucleic acid amplification testing (NAAT). Ag test sensitivity is dependent on the presence or absence of symptoms and, in symptomatic patients, on timing of testing after symptom onset. In most cases, positive Ag results can be acted upon without confirmation. Results of point-of-care testing are comparable to those of laboratory-based testing, and observed or unobserved self-collection of specimens for testing yields similar results. Modeling suggests that repeat Ag testing increases sensitivity compared with testing once, but no empirical data were available to inform this question. Based on these observations, rapid RT-PCR or laboratory-based NAAT remain the testing methods of choice for diagnosing SARS-CoV-2 infection. However, when timely molecular testing is not readily available or is logistically infeasible, Ag testing helps identify individuals with SARS-CoV-2 infection. Data were insufficient to make a recommendation about the utility of Ag testing to guide release of patients with COVID-19 from isolation. The overall quality of available evidence supporting use of Ag testing was graded as very low to moderate.

Abstract There are many pharmacologic therapies that are being used or considered for treatment of coronavirus disease 2019 (COVID-19), with rapidly changing efficacy and safety evidence from trials. The objective was to develop evidence-based, rapid, living guidelines intended to support patients, clinicians, and other healthcare professionals in their decisions about treatment and management of patients with COVID-19. In March 2020, the Infectious Diseases Society of America (IDSA) formed a multidisciplinary guideline panel of infectious disease clinicians, pharmacists, and methodologists with varied areas of expertise to regularly review the evidence and make recommendations about the treatment and management of persons with COVID-19. The process used a living guideline approach and followed a rapid recommendation development checklist. The panel prioritized questions and outcomes. A systematic review of the peer-reviewed and grey literature was conducted at regular intervals. The Grading of Recommendations Assessment, Development, and Evaluation (GRADE) approach was used to assess the certainty of evidence and make recommendations. Based on the most recent search conducted on 31 May 2022, the IDSA guideline panel has made 32 recommendations for the treatment and management of the following groups/populations: pre- and postexposure prophylaxis, ambulatory with mild-to-moderate disease, and hospitalized with mild-to-moderate, severe but not critical, and critical disease. As these are living guidelines, the most recent recommendations can be found online at: https://idsociety.org/COVID19guidelines. At the inception of its work, the panel has expressed the overarching goal that patients be recruited into ongoing trials. Since then, many trials were conducted that provided much-needed evidence for COVID-19 therapies. There still remain many unanswered questions as the pandemic evolved, which we hope future trials can answer.