Citations

Clear

97 citation(s) found for "Cook, David J".

Clinical reasoning research priorities for advancing diagnostic safety: researcher and patient perspectives
Matin, Roni , Meyer, Ashley N. D. , Singh, Hardeep, Olson, Andrew , Cook, David A., Zwaan, Laura , Olson, Andrew P J , Singh, Hardeep , Cook, David A.

Mayo Clinic

Diagnosis | July 30, 2026 | Volume: No volume available | Issue: No issue available | Pages: No page available

10.1515/dx-2026-0018 | PMID 42530344 Get It

Abstract Objectives This study used both researcher and patient perspectives to identify high-priority research questions related to clinical reasoning. Methods This study integrates findings from two previously published research prioritization exercises aimed at advancing the science of diagnostic safety, focusing on questions relevant to clinical reasoning. In Study 1 (April 2019), 97 researchers submitted 177 unique research questions that could be useful “to reduce patient harm in the diagnosis process”. In Study 2 (November 2019), 41 patients/caregivers/advocates submitted 84 unique research questions on the same topic. In an in-person meeting, a subset of these participants identified 81 of these questions as high-priority (51 from Study 1; 30 from Study 2). For the current study, five investigators identified questions that focused on clinical reasoning, first independently and then by consensus. They then categorized the clinical reasoning questions into inductively identified themes. Results Twenty-nine of the 81 high-priority research questions addressed clinical reasoning and were categorized into 5 themes: understanding clinical reasoning and cognition (12 questions), decision support/technology (6 questions), team-based decision making (5 questions), how to learn from cases/scenarios (3 questions), and patient engagement (3 questions). Questions addressed a range of basic/foundational science and clinical applications, and involved individuals, teams, and/or systems. Conclusions Identification of high-priority clinical reasoning research questions can help medical educators, clinicians, researchers, and funders catalyze research and discovery of interventions to improve clinical reasoning and ultimately improve patient outcomes.
Motivation and perceived learning in serious games: Reflexive thematic analysis of educational escape room experiences
Huang, Jeffrey , Licatino, Lauren K. , Sims, Charles R. , Cook, David A. , Warner, David O. , Abcejo, Arnoley S. , Usher, Ellen L. , Warner, David O , Usher, Ellen L , Abcejo, Arnoley , Licatino, Lauren K.

Mayo Clinic

Medical Teacher | July 7, 2026 | Volume: No volume available | Issue: No issue available | Pages: 1-12

10.1080/0142159x.2026.2681191 | PMID 42412519 Get It

Longitudinal Assessment for Continuing Certification of Anesthesiologists: Utilization, Performance, and Perception of Maintenance of Certification in Anesthesiology (MOCA) Minute
Sun, Huaping , Lee, Youngjun, Harman, Ann E., Macario, Alex, Deiner, Stacie , Minhaj, Mohammed, Cook, David A., Sun, Huaping , Harman, Ann E., Minhaj, Mohammed , Cook, David A. , Warner, David O.

Mayo Clinic

Anesthesiology | June 1, 2026 | Volume: 145 | Issue: 3 | Pages: 724-733

10.1097/aln.0000000000006178 | PMID 42224071 Get It

Background: Longitudinal assessments are increasingly common as a component of continuing certification programs offered by medical specialty boards. The goal of this study was to understand anesthesiologists’ utilization pattern, performance, and perception of the longitudinal assessment program administered by the American Board of Anesthesiology (Raleigh, North Carolina). Methods: The authors analyzed assessment usage and survey data from all anesthesiologists who participated in the Maintenance of Certification in Anesthesiology (MOCA) Minute from January 2018 to December 2019. Results: During the 24-month study period, 25,404 anesthesiologists completed all 120 questions assigned in at least 1 calendar year, collectively 5,801,160 responses to 1,646 unique questions. Participants were more likely to complete questions at the end of each quarter, with the highest frequency at the end of the year. Seventy-five percent of responses were first-time attempts, and 17% were first repeats. The median interval between original question presentation and first repeat was 314 days. The mean ± SD percent correct score was 68.3 ± 8.0% for first-time questions and 75.5 ± 12.6% for first repeats. The mean ± SD time to answer a first-time question was 26.8 ± 13.1 s, with shorter times for questions with correct than incorrect responses (25.0 ± 12.7 vs . 30.7 ± 13.3 s; time difference, −5.69 s; 95% CI, −5.71 to −5.66; P < 0.001). Of 5.11 million responses with ratings of relevance (88.2% of all responses analyzed), 4.86 million (95.2%) were felt to be somewhat or very relevant to practice. The percent correct scores were higher for responses with higher relevance and confidence ratings. For responses rated “not relevant,” “somewhat relevant,” and “very relevant,” the percent correct was 58.5%, 67.6%, and 77.0%, respectively; for responses rated as “unsure,” “somewhat confident,” and “very confident,” the percent correct was 53.6%, 67.9%, and 84.4%, respectively. Conclusions: MOCA Minute was generally used as designed. Evidence of learning was suggested by improved performance on repeat questions.
Using Generative AI to Appraise the Quality of Medical Education Research Studies: Agreement Between AI ‐Generated and Human MERS
Aldalou, Mohammad , Rush, Emily , Landry-Wegener, Bernard , Bills, Corey, Cook, David A. , Swope, John, Wilson, Adam B. , Cook, D A , Wilson, Adam B , Brooks, William S. , Bills, Corey B

Mayo Clinic

AEM Education and Training | May 15, 2026 | Volume: 10 | Issue: 3 | Pages: No page available

10.1002/aet2.70189 | PMID 42146734 Get It

ABSTRACT Objectives The increasing volume of medical education research necessitates efficient, reliable, and scalable methods for conducting quality appraisals. The Medical Education Research Study Quality Instrument (MERSQI) is a widely used tool, although its manual scoring process remains resource‐intensive. This study evaluated how well large language models (LLMs) appraise medical education research using the MERSQI tool in comparison with human judges. Methods Three LLMs (GPT‐5, Claude Sonnet 4, and Gemini 2.5 Pro) assigned MERSQI domain scores to 1423 medical education research articles. The authors compared AI‐generated scores with human‐generated scores using intraclass correlation coefficients (ICCs) across the six MERSQI domains. They evaluated the agreement between AI‐ and human‐generated MERSQI composite scores using Bland–Altman plots. Results Domain‐level ICC values ranged from fair (0.24) to near perfect (0.81), with the lowest agreement observed in the ‘sampling,’ ‘validity evidence,’ and ‘data analysis’ domains. No single LLM consistently outperformed the others across all domains. Composite score agreement with human ratings was substantial and similar across LLMs (ICC range: 0.65–0.69). GPT‐5 produced slightly lower composite scores than humans, while Claude Sonnet 4 and Gemini 2.5 Pro produced higher scores, with Gemini showing the largest deviation. The Bland–Altman plots for Gemini 2.5 Pro suggested proportional bias, indicating its agreement with human scores varied across the range of study quality. Conclusions These LLMs demonstrated substantial agreement with human raters for MERSQI composite scores, but domain‐level agreement varied. Systematic differences in scoring patterns highlight the need for human oversight and additional calibrations before integrating LLMs into systematic review appraisal workflows.
Large language model scoring of medical student reflection essays: Accuracy and reproducibility of prompt-model variations
Cook, David A. , Laack, Torrey A. , Pankratz, V. Shane

Mayo Clinic

No container title available | March 24, 2026 | Volume: No volume available | Issue: No issue available | Pages: No page available

10.64898/2026.03.20.26348918 Get It

Abstract Introduction Evaluate large language models (LLMs) for scoring medical student essays, and compare various prompting techniques and models. Methods OpenAI GPT scored 51 medical student reflection essays (15 real, 36 fabricated) using a previously-reported 6-point rubric (April-May 2025). We compared 29 prompt-model conditions by systematically varying the LLM prompts (including the persona, scoring rubric, few-shot learning [exemplars], chain-of-thought reasoning, and temperature), fine-tuning, and model (including GPT-4.1, GPT-4.1-mini, GPT-o4-mini, and GPT-4-Turbo). Outcomes were accuracy (compared with human raters, measured using single-score intraclass correlation coefficient [ICC] and mean absolute difference [MAD; zero indicates perfect agreement]), within-condition reproducibility, and cost. Results Across all conditions, it took mean (SD) 3.73 (3.12) seconds to score 1 essay. The cost to score 100 essays was USD $0.04 for GPT-4.1-mini, $0.21 for GPT-4.1, $0.57 for GPT-4.1 with 3 exemplars, and $2.00 for fine-tuned GPT-4.1. When the one-time cost of fine-tuning was amortized across 10,000 essays, the cost for fine-tuned GPT-4.1 was $0.20 per 100. Accuracy was “almost perfect” (ICC >0.80) for 28/29 conditions (97%). Fine-tuned models were more accurate than non-fine-tuned models (MAD difference –0.24 [95% CI, –0.34, –0.14]). Conditions with exemplars were more accurate than those without (MAD difference –0.44 [CI, –0.57, –0.31]). Accuracy progressively decreased as 6, 3, 1, and 0 rubric levels were explicitly defined in the prompt (P<.001). Contrary to hypotheses, accuracies for chain-of-thought prompts and variations in temperature and persona were not significantly different from the baseline prompt. Reproducibility ICC was >0.80 for 28/29 conditions (97%). Discussion Automated LLM essay scoring demonstrated near-perfect accuracy and reproducibility for most prompt-model conditions. Fine-tuned models and prompts with exemplars had higher accuracy but higher cost. Fine-tuned models had lower per-essay costs for larger essay volumes. For smaller volumes, non-fine-tuned GPT-4.1 provided excellent results at moderate cost. GPT-4.1-mini provided very good results at low cost.
Virtual Multidisciplinary Gastrointestinal Care Clinic Improves Patient Engagement, Satisfaction, and Outcomes at Reduced Costs and Healthcare Utilization: A Prospective Cohort Study
Berry, Sameer, Varma, Sanskriti , Basnayake, Chamara , Ahn, Joseph , Berinstein, J, Chan, Walter W. , Allen, John, Chey, William, Berry, Sameer , Berry, Sameer K , Ahn, Joseph C , Berinstein, Jeffrey , Chan, Walter , Cook, David J. , Allen, John I.

Mayo Clinic

American Journal of Gastroenterology | March 20, 2026 | Volume: No volume available | Issue: No issue available | Pages: No page available

10.14309/ajg.0000000000004002 | PMID 41860134 Get It

INTRODUCTION: Chronic gastrointestinal (GI) conditions, including irritable bowel syndrome and other disorders of gut-brain interaction, are prevalent and costly, and fragmented care contributes to suboptimal outcomes. Virtual and multidisciplinary care models may improve outcomes. Objectives: We aimed to (i) characterize patients receiving virtual GI care, (ii) report patient engagement with and patient-reported outcomes after virtual multidisciplinary care, and (iii) report healthcare utilization and costs from a payer perspective among patients vs propensity score-matched controls identified from claims data. METHODS: We collected descriptive data on patient demographics, clinic provider visits, symptoms, and patient-reported outcomes from 3/2021 to 9/2022. To evaluate healthcare utilization and costs, we conducted difference-in-difference analyses using claims data compared with a propensity score-matched control group. RESULTS: Among 234 patients (71% women, mean age 45.4 ± 13.2 years), 51% received a new GI diagnosis, predominately disorders of gut-brain interaction (63%). Engagement criteria were met by 80% (n = 187), who completed a mean of 10 visits and median time-to-first appointment of 6 days. Dietitians (93%), psychologists (76%), and health coaches (64%) were frequently used. Engaged patients exhibited significant improvements from preclinic to postclinic in irritable bowel syndrome severity (226.7–145.6), symptom control (20.2%–86.6%), quality-of-life dysphoria (27.5–32.8), missed workdays (1.0–0.7), and satisfaction (37.4%–96.3%) (all P < 0.05). Compared with matched controls, a significantly smaller percent of patients had imaging (15% vs 44%; P < 0.0001) and GI-related emergency department visits (4% vs 10%; P = 0.0028), which contributed to reductions in GI-related costs ($443 per member per month; P = 0.047) and all-cause costs ($676 per member per month; P = 0.043), equating to annualized savings of $5,316 and $8,112, respectively. DISCUSSION: Virtual multidisciplinary GI care was associated with high engagement, improved clinical outcomes, and reduced healthcare utilization and costs.
Primary Merkel Cell Carcinoma of the Deep Breast Parenchyma
Nielson, Kaitlyn J. , Cook, David , Hieken, Tina J. , Olave, Maria C. , Solanki, Malvika , Guo, Ruifeng , Jiménez, Rafael E. , Cook, David J , Solanki, Malvika H , Hieken, Tina J , Guo, Ruifeng

Mayo Clinic

International Journal of Surgical Pathology | October 21, 2025 | Volume: 34 | Issue: 2 | Pages: 559-563

10.1177/10668969251384887 | PMID 41117418 Get It

Neuroendocrine carcinomas of the breast are a rare subtype of invasive breast carcinomas, and those with morphologic and immunophenotypic features supporting Merkel cell carcinoma (MCC) are even more rare. Accurate diagnosis of these entities is important for clinical decision-making regarding the selection of optimal treatments. We report a patient withMCC in the deep breast parenchyma of a 52-year-old woman, without evidence of a cutaneous component. This tumor exhibited characteristic morphologic and immunophenotypic features of MCC, including sheets of high grade, hyperchromatic tumor cells, with perinuclear dot-like staining of keratin 20. To our knowledge, this is the sixth report of parenchymal breast MCC, and due to its rarity and aggressive course, we reviewed the literature, including prior experience on its diagnosis and management.
Global research aims for the study of cost and value in health professions education: A Delphi study of international experts
Tolsgaard, Martin G. , Nayahangan, Leizl Joy , Cook, David A. , Schalkwyk, Susan van , You, You , van Schalkwyk, Susan , You, Michelle You , Cleland, J , Tolsgaard, Martin , Madsen, Gorm Roager , Brydges, Ryan , Filho, Carvalho , Cleland, Jennifer

Mayo Clinic

Medical Teacher | May 10, 2025 | Volume: 47 | Issue: 11 | Pages: 1752-1760

10.1080/0142159x.2025.2501254 | PMID 40347090 Get It