Citations

Clear

97 citation(s) found for "Cook, David".

Self‐regulated learning in simulation‐based training: a systematic review and meta‐analysis
Brydges, Ryan , Manzone, Julian, Hatala, Rose , Hamstra, Stanley J. , Zendejas, Benjamin , Cook, David A. , Shanks, David, Hamstra, Stanley J

Mayo Clinic

Medical Education | March 20, 2015 | Volume: 49 | Issue: 4 | Pages: 368-378

10.1111/medu.12649 | PMID 25800297 Get It

Context Self‐regulated learning ( SRL ) requires an active learner who has developed a set of processes for managing the achievement of learning goals. Simulation‐based training is one context in which trainees can safely practise learning how to learn. Objectives The purpose of the present study was to evaluate, in the simulation‐based training context, the effectiveness of interventions designed to support trainees in SRL activities. We used the social‐cognitive model of SRL to guide a systematic review and meta‐analysis exploring the links between instructor supervision, supports or scaffolds for SRL , and educational outcomes. Methods We searched databases including MEDLINE and Scopus, and previous reviews, for material published until December 2011. Studies comparing simulation‐based SRL interventions with another intervention for teaching health professionals were included. Reviewers worked independently and in duplicate to extract information on learners, study quality and educational outcomes. We used random‐effects meta‐analysis to compare the effects of supervision (instructor present or absent) and SRL educational supports (e.g. goal‐setting study guides present or absent). Results From 11 064 articles, we included 32 studies enrolling 2482 trainees. Only eight of the 32 studies included educational supports for SRL . Compared with instructor‐supervised interventions, unsupervised interventions were associated with poorer immediate post‐test outcomes (pooled effect size: −0.34, p = 0.09; n = 19 studies) and negligible effects on delayed (i.e. > 1 week) retention tests (pooled effect size: 0.11, p = 0.63; n = 8 studies). Interventions including SRL supports were associated with small benefits compared with interventions without supports on both immediate post‐tests (pooled effect size: 0.23, p = 0.22; n = 5 studies) and delayed retention tests (pooled effect size: 0.44, p = 0.067; n = 3 studies). Conclusions Few studies in the simulation literature have designed SRL training to explicitly support trainees’ capacity to self‐regulate their learning. We recommend that educators and researchers shift from thinking about SRL as learning alone to thinking of SRL as comprising a shared responsibility between the trainee and the instructional designer (i.e. learning using designed supports that help prepare individuals for future learning).
A systematic review of validity evidence for checklists versus global rating scales in simulation‐based assessment
Ilgen, Jonathan S. , Ma, Irene , Hatala, Rose , Cook, David A.

Mayo Clinic

Medical Education | January 27, 2015 | Volume: 49 | Issue: 2 | Pages: 161-173

10.1111/medu.12621 | PMID 25626747 Get It

Context The relative advantages and disadvantages of checklists and global rating scales ( GRS s) have long been debated. To compare the merits of these scale types, we conducted a systematic review of the validity evidence for checklists and GRS s in the context of simulation‐based assessment of health professionals. Methods We conducted a systematic review of multiple databases including MEDLINE , EMBASE and S copus to F ebruary 2013. We selected studies that used both a GRS and checklist in the simulation‐based assessment of health professionals. Reviewers working in duplicate evaluated five domains of validity evidence, including correlation between scales and reliability. We collected information about raters, instrument characteristics, assessment context, and task. We pooled reliability and correlation coefficients using random‐effects meta‐analysis. Results We found 45 studies that used a checklist and GRS in simulation‐based assessment. All studies included physicians or physicians in training; one study also included nurse anaesthetists. Topics of assessment included open and laparoscopic surgery ( n = 22), endoscopy ( n = 8), resuscitation ( n = 7) and anaesthesiology ( n = 4). The pooled GRS –checklist correlation was 0.76 (95% confidence interval [ CI ] 0.69–0.81, n = 16 studies). Inter‐rater reliability was similar between scales ( GRS 0.78, 95% CI 0.71–0.83, n = 23; checklist 0.81, 95% CI 0.75–0.85, n = 21), whereas GRS inter‐item reliabilities (0.92, 95% CI 0.84–0.95, n = 6) and inter‐station reliabilities (0.80, 95% CI 0.73–0.85, n = 10) were higher than those for checklists (0.66, 95% CI 0–0.84, n = 4 and 0.69, 95% CI 0.56–0.77, n = 10, respectively). Content evidence for GRS s usually referenced previously reported instruments ( n = 33), whereas content evidence for checklists usually described expert consensus ( n = 26). Checklists and GRS s usually had similar evidence for relations to other variables. Conclusions Checklist inter‐rater reliability and trainee discrimination were more favourable than suggested in earlier work, but each task requires a separate checklist. Compared with the checklist, the GRS has higher average inter‐item and inter‐station reliability, can be used across multiple tasks, and may better capture nuanced elements of expertise.
High-Value, Cost-Conscious Medical Education
Cook, David A. , Beckman, Thomas J.

Mayo Clinic

JAMA Pediatrics | December 22, 2014 | Volume: 169 | Issue: 2 | Pages: 109

10.1001/jamapediatrics.2014.2964 | PMID 25532059 Get It

Getting Maintenance of Certification to Work
Cook, David A. , Holmboe, Eric S. , Sorensen, Kristi J., Wilkinson, John M. , Berger, Richard A. , Berger, Richard A.

Mayo Clinic

JAMA Internal Medicine | November 3, 2014 | Volume: 175 | Issue: 1 | Pages: 35

10.1001/jamainternmed.2014.5437 | PMID 25365596 Get It

How much evidence does it take? A cumulative meta‐analysis of outcomes of simulation‐based education
Cook, David A.

Mayo Clinic

Medical Education | July 10, 2014 | Volume: 48 | Issue: 8 | Pages: 750-760

10.1111/medu.12473 | PMID 25039731 Get It

Context Studies that investigate research questions that have already been resolved represent a waste of resources. However, the failure to collect sufficient evidence to resolve a given question results in ambiguity. Objectives The present study was conducted to reanalyse the results of a meta‐analysis of simulation‐based education ( SBE ) to determine: (i) whether researchers continue to replicate research studies after the answer to a research question has become known, and (ii) whether researchers perform enough replications to definitively answer important questions. Methods A systematic search of multiple databases to May 2011 was conducted to identify original research evaluating SBE for health professionals in comparison with no intervention or any active intervention, using skill outcomes. Data were extracted by reviewers working in duplicate. Data synthesis involved a cumulative meta‐analysis to illuminate patterns of evidence by sequentially adding studies according to a variable of interest (e.g. publication year) and re‐calculating the pooled effect size with each addition. Cumulative meta‐analysis by publication year was applied to 592 comparative studies using several thresholds of ‘sufficiency’, including: statistical significance; stable effect size classification and magnitude (Hedges’ g ± 0.1), and precise estimates (confidence intervals of less than ± 0.2). Results Among studies that compared the outcomes of SBE with those of no intervention, evidence supporting a favourable effect of SBE on skills existed as early as 1973 (one publication) and further evidence confirmed a quantitatively large effect of SBE by 1997 (28 studies). Since then, a further 404 studies were published. Among studies comparing SBE with non‐simulation instruction, the effect initially favoured non‐simulation training, but the addition of a third study in 1997 brought the pooled effect to slightly favour simulation, and by 2004 (14 studies) this effect was statistically significant (p < 0.05) and the magnitude had stabilised (small effect). A further 37 studies were published after 2004. By contrast, evidence from studies evaluating repetition continued to show borderline statistical significance and wide confidence intervals in 2011. Conclusions Some replication is necessary to obtain stable estimates of effect and to explore different contexts, but the number of studies of SBE often exceeds the minimum number of replications required.
Debriefing for technology‐enhanced simulation: a systematic review and meta‐analysis
Cheng, Adam , Eppich, Walter , Grant, Vincent , Sherbino, Jonathan , Zendejas, Benjamin , Cook, David A.

Mayo Clinic

Medical Education | June 9, 2014 | Volume: 48 | Issue: 7 | Pages: 657-666

10.1111/medu.12432 | PMID 24909527 Get It

Objectives Debriefing is a common feature of technology‐enhanced simulation ( TES ) education. However, evidence for its effectiveness remains unclear. We sought to characterise how debriefing is reported in the TES literature, identify debriefing features that are associated with improved outcomes, and evaluate the effectiveness of debriefing when combined with TES . Methods We systematically searched databases, including MEDLINE , EMBASE and Scopus, and reviewed previous bibliographies for original comparative studies investigating the use of TES with debriefing in training health care providers. Reviewers, in duplicate, evaluated study quality and abstracted information on instructional design, debriefing and outcomes. Effect sizes ( ES ) were pooled using random‐effects meta‐analysis. Results From 10 903 potentially eligible studies, we identified 177 studies (11 511 learners) that employed debriefing as part of TES . Key characteristics of debriefing (e.g. duration, educator presence and characteristics, content, structure/method, timing, use of video) were usually incompletely reported. A meta‐analysis of four studies demonstrated that video‐assisted debriefing has negligible and non‐significant effects for time skills ( ES = 0.10) compared with non‐video‐assisted debriefing. Meta‐analysis demonstrated non‐significant effects in favour of expert modelling with short debriefing in comparison with long debriefing (ES range = 0.21–0.74). Among studies comparing terminal with concurrent debriefing, results were variable depending on outcome measures and the context of training (e.g. medical resuscitation versus technical skills). Eight additional studies revealed insight into the roles of other debriefing‐related factors (e.g. multimedia debriefing, learner‐led debriefing, debriefing duration, content of debriefing). Among studies that compared simulation plus debriefing with no intervention, pooled ES s were favourable for all outcomes (ES range = 0.28–2.16). Conclusions Limited evidence suggests that video‐assisted debriefing yields outcomes similar to those of non‐video‐assisted debriefing. Other debriefing design features show mixed or non‐significant results. As debriefing characteristics are usually incompletely reported, future debriefing research should describe all the key debriefing characteristics along with their associated descriptors.
From ‘Solution Shop’ Model To ‘Focused Factory’ In Hospital Surgery: Increasing Care Value And Predictability
Cook, David J. , Thompson, Jeffrey E. , Habermann, Elizabeth B. , Visscher, Sue L. , Roger, Véronique L. , Dearani, Joseph A. , Borah, Bijan J. , Habermann, Elizabeth

Mayo Clinic

Health Affairs | May 5, 2014 | Volume: 33 | Issue: 5 | Pages: 746-755

10.1377/hlthaff.2013.1266 | PMID 24799570 Get It

Technology-Enhanced Simulation and Pediatric Education: A Meta-analysis
Cheng, Adam , Lang, Tara R., Starr, Stephanie R. , Pusic, Martin , Cook, David A. , Pusic, Martin V

Mayo Clinic

Pediatrics | April 14, 2014 | Volume: 133 | Issue: 5 | Pages: e1313-e1323

10.1542/peds.2013-2139 | PMID 24733867 Get It

BACKGROUND AND OBJECTIVE: Pediatrics has embraced technology-enhanced simulation (TES) as an educational modality, but its effectiveness for pediatric education remains unclear. The objective of this study was to describe the characteristics and evaluate the effectiveness of TES for pediatric education. METHODS: This review adhered to PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) standards. A systematic search of Medline, Embase, CINAHL, ERIC, Web of Science, Scopus, key journals, and previous review bibliographies through May 2011 and an updated Medline search through October 2013 were conducted. Original research articles in any language evaluating the use of TES for educating health care providers at any stage, where the content solely focuses on patients 18 years or younger, were selected. Reviewers working in duplicate abstracted information on learners, clinical topic, instructional design, study quality, and outcomes. We coded skills (simulated setting) separately for time and nontime measures and similarly classified patient care behaviors and patient effects. RESULTS: We identified 57 studies (3666 learners) using TES to teach pediatrics. Effect sizes (ESs) were pooled by using a random-effects model. Among studies comparing TES with no intervention, pooled ESs were large for outcomes of knowledge, nontime skills (eg, performance in simulated setting), behaviors with patients, and time to task completion (ES = 0.80–1.91). Studies comparing the use of high versus low physical realism simulators showed small to moderate effects favoring high physical realism (ES = 0.31–0.70). CONCLUSIONS: TES for pediatric education is associated with large ESs in comparison with no intervention. Future research should include comparative studies that identify optimal instructional methods and incorporate pediatric-specific issues into educational interventions.
Patient Education Self-Management During Surgical Recovery: Combining Mobile (iPad) and a Content Management System
Cook, David J. , Moradkhani, Anilga, Douglas, Kristin S. Vickers, Prinsen, Sharon K., Fischer, Erin N., Schroeder, Darrell R. , Schroeder, Darrell

Mayo Clinic

Telemedicine and e-Health | January 20, 2014 | Volume: 20 | Issue: 4 | Pages: 312-317

10.1089/tmj.2013.0219 | PMID 24443928 Get It

Objective: The objective of this investigation was to assess whether a new electronic health (e-health) platform, combining mobile computing and a content management system, could effectively deliver modular and “just-in-time” education to older patients following cardiac surgery. Subjects and Methods: Patients were provided with iPad ® (Apple ® , Cupertino, CA) tablets that delivered educational modules as part of a daily “to do” list in a plan of care. The tablet communicated wirelessly to a dashboard where data were aggregated and displayed for providers. Results: A surgical population of 149 patients with a mean age of 68 years utilized 5,267 of 6,295 (84%) of education modules delivered over a 5.3-day hospitalization. Increased age was not associated with decreased use. Conclusions: We demonstrate that age, hospitalization, and major surgery are not significant barriers to effective patient education if content is highly consumable and relevant to patients' daily care experience. We also show that mobile technology, even if unfamiliar to many older patients, makes this possible. The combination of mobile computing with a content management system allows for dynamic, modular, personalized, and “just-in-time” education in a highly consumable format. This approach presents a means by which patients may become informed participants in new healthcare models.
Surgical Process Improvement
Cook, David J. , Thompson, Jeffrey E. , Suri, Rakesh M. , Prinsen, Sharon K., Suri, Rakesh, Suri, Rakesh M.

Mayo Clinic

American Journal of Medical Quality | August 30, 2013 | Volume: 29 | Issue: 4 | Pages: 323-328

10.1177/1062860613499401 | PMID 23990593 Get It