Mascha, Edward J.

Comprehensive resources exist on how to plan a systematic review and meta-analysis. The objective of this article is to provide guidance to authors preparing their systematic review protocol in the fields of regional anesthesia and pain medicine. The focus is on systematic reviews of healthcare interventions, with or without an aggregate data meta-analysis. We describe and discuss elements of the systematic review methodology that review authors should prespecify, plan, and document in their protocol before commencing the review. Importantly, authors should explain their rationale for planning their systematic review and describe the PICO framework—participants (P), interventions (I),comparators (C), outcomes (O)—and related elements central to constructing their clinical question, framing an informative review title, determining the scope of the review, designing the search strategy, specifying the eligibility criteria, and identifying potential sources of heterogeneity. We highlight the importance of authors defining and prioritizing the primary outcome, defining eligibility criteria for selecting studies, and documenting sources of information and search strategies. The review protocol should also document methods used to evaluate risk of bias, quality (certainty) of the evidence, and heterogeneity of results. Furthermore, the authors should describe their plans for managing key data elements, the statistical construct used to estimate the intervention effect, methods of evidence synthesis and meta-analysis, and conditions when meta-analysis may not be possible, including the provision of practical solutions. Authors should provide enough detail in their protocol so that the readers could conduct the study themselves.

In Part I of this series, we provide guidance for preparing a systematic review protocol. In this article, we highlight important steps and supplement with exemplars on conducting and reporting the results of a systematic review. We suggest how authors can manage protocol violations, multiplicity of outcomes and analyses, and heterogeneity. The quality (certainty) of the evidence and strength of recommendations should follow the Grading of Recommendations Assessment, Development, and Evaluation (GRADE) approach. It is our goal that Part II of this series provides valid guidance to authors and peer reviewers who conduct systematic reviews to adhere to important constructs of transparency, structure, reproducibility, and accountability. This will likely result in more rigorous systematic reviews being submitted for publication to the journals like Regional Anesthesia & Pain Medicine and Anesthesia & Analgesia.

In Part I of this series, we provide guidance for preparing a systematic review protocol. In this article, we highlight important steps and supplement with exemplars on conducting and reporting the results of a systematic review. We suggest how authors can manage protocol violations, multiplicity of outcomes and analyses, and heterogeneity. The quality (certainty) of the evidence and strength of recommendations should follow the Grading of Recommendations Assessment, Development, and Evaluation (GRADE) approach. It is our goal that Part II of this series provides valid guidance to authors and peer reviewers who conduct systematic reviews to adhere to important constructs of transparency, structure, reproducibility, and accountability. This will likely result in more rigorous systematic reviews being submitted for publication to the journals like Regional Anesthesia & Pain Medicine and Anesthesia & Analgesia .

Comprehensive resources exist on how to plan a systematic review and meta-analysis. The objective of this article is to provide guidance to authors preparing their systematic review protocol in the fields of regional anesthesia and pain medicine. The focus is on systematic reviews of health care interventions, with or without an aggregate data meta-analysis. We describe and discuss elements of the systematic review methodology that review authors should prespecify, plan, and document in their protocol before commencing the review. Importantly, authors should explain their rationale for planning their systematic review and describe the PICO framework—participants (P), interventions (I), comparators (C), outcomes (O)—and related elements central to constructing their clinical question, framing an informative review title, determining the scope of the review, designing the search strategy, specifying the eligibility criteria, and identifying potential sources of heterogeneity. We highlight the importance of authors defining and prioritizing the primary outcome, defining eligibility criteria for selecting studies, and documenting sources of information and search strategies. The review protocol should also document methods used to evaluate risk of bias, quality (certainty) of the evidence, and heterogeneity of results. Furthermore, the authors should describe their plans for managing key data elements, the statistical construct used to estimate the intervention effect, methods of evidence synthesis and meta-analysis, and conditions when meta-analysis may not be possible, including the provision of practical solutions. Authors should provide enough detail in their protocol so that the readers could conduct the study themselves.

Observational data are often readily available or less costly to obtain than conducting a randomized controlled trial. With observational data, investigators may statistically evaluate the relationship between a treatment or therapy and outcomes. However, inherent in observational data is the potential for confounding arising from the nonrandom assignment of treatment. In this statistical grand rounds, we describe the use of propensity score methods (ie, using the probability of receiving treatment given covariates) to reduce bias due to measured confounders in anesthesia and perioperative medicine research. We provide a description of the theory and background appropriate for the anesthesia researcher and describe statistical assumptions that should be assessed in the course of a research study using the propensity score. We further describe 2 propensity score methods for evaluating the association of treatment or therapy with outcomes, propensity score matching and inverse probability of treatment weighting, and compare to covariate-adjusted regression analysis. We distinguish several estimators of treatment effect available with propensity score methods, including the average treatment effect, the average treatment effect for the treated, and average treatment effect for the controls or untreated, and compare to the conditional treatment effect in covariate-adjusted regression. We highlight the relative advantages of the various methods and estimators, describe analysis assumptions and how to critically evaluate them, and demonstrate methods in an analysis of thoracic epidural analgesia and new-onset atrial arrhythmias after pulmonary resection.