Back to Authors

Heaton, Heather

Mayo Clinic

Department of Emergency Medicine, Mayo Clinic, Rochester, Minnesota.

Citations 3

Quality assessment of artificial intelligence‐generated versus human‐written hospital summaries evaluating detail, usefulness, and continuity of care
Ryu, Alexander J. , Heaton, Heather A. , Challener, Douglas , Ayanian, Shant , Ryu, Alexander, O'horo, John, Heaton, Heather, Challener, Douglas W. , Ryu, Alexander J. , O’Horo, John C.

Journal of Hospital Medicine | October 1, 2025 | Volume: 21 | Issue: 4 | Pages: 375-379

10.1002/jhm.70163 Get It

Abstract Background Hospital discharge summaries are critical for ensuring continuity of care, but their quality often varies. Large language models (LLMs) have the potential to standardize and enhance the efficiency of this documentation process. Objectives To evaluate the quality of hospital discharge summaries created by an LLM‐based hospital course drafting tool created by Epic Systems compared with human‐written summaries. Methods Retrospective study at a single tertiary‐care institution in 2024. The cohort included 100 adult hospitalizations lasting >72 h across medical and surgical dismissing services. No interventions were performed. Summaries (LLM‐generated vs. human‐written) were independently reviewed using a standardized rubric covering nine domains (e.g., comprehensiveness, clarity, relevance). Scores were normalized and compared. Readability was assessed using Flesch Reading Ease. Results LLM‐generated summaries outperformed human‐written summaries across all criteria ( p < .05), with the greatest difference observed in comprehensiveness (LLM median 0.62 vs. human −0.23). Human‐written summaries from surgical services scored lower than those from medical services, but LLM performance was consistent across both. Human summaries had higher Flesch Reading Ease scores (33.11 vs. 26.2; p < .05), reflecting simpler language. Conclusions LLM‐generated summaries demonstrated superior quality, consistency, and clinical utility compared with human‐written summaries, highlighting their potential to improve documentation efficiency and standardization.
Key findings from multisite implementation of electronic health record tools for clinical pretest probability of pulmonary embolism in the emergency department
Houghton, Damon E. , Keenan, Megan , Dykhoff, Hayley J. , Campbell, Kyle N., Hall, Marie Boas, Heaton, Heather A. , Thompson, Kristine M., Aranda, Jamie, Balgord, Sarah , Rubin, Jonathan M. , Hanson, Ryan , He, Wei , Cahill, Emily , Heaton, Heather, Thompson, Kristine, Houghton, Damon E , Hall, Marie, Raja, Ali S , Dutta, Sayon , McEvoy, Dustin , Kreuziger, Lisa Baumann , Rosovsky, Rachel

Vascular Medicine | June 16, 2025 | Volume: 30 | Issue: 3 | Pages: 302-308

10.1177/1358863x251337456 Get It

Background: The use of validated risk stratification tools for the workup of suspected pulmonary embolism (PE) is a recommendation of the American Society of Hematology and the American College of Emergency Physicians. Methods: We designed and implemented electronic clinical pretest probability (PTP) tools for use in emergency departments (ED). Overall, 38 EDs (tertiary and regional EDs) in the United States were involved across three health systems. PTP use was analyzed between September 12, 2022 and January 11, 2023 in 270,247 ED visits. PTP use was examined in terms of the percentage of visits for which patients underwent computed tomography pulmonary angiography (CTPA). Each site chose the 3-tier Wells’ score for implementation and Site 2 designed a combined Wells’, pulmonary embolism rule-out criteria (PERC), and YEARS score. Results: At Site 3, forced use resulted in documented PTP scores in 49–53% of ordered CTPAs. At Sites 1 and 2, where PTP scores were optional, documented PTP scores occurred in 2–3% and 1–3% of CTPA orders, respectively. At Site 1, the use of PTP increased slightly over the study period, with signs that PE yield on imaging was also increasing (3.4–5.9%). At Site 2, PE yield on imaging was 9–10%, and it remained similar, with similar use of PTP tools over the study period. PE yield (6–8%) on imaging also remained similar throughout the study at Site 3. Conclusions: Guideline-endorsed PTP scores for PE at three independent health systems in the United States did not increase PE yield on imaging. Novel implementation strategies involving interdisciplinary teams are urgently needed.
Palliative Care Initiated in the Emergency Department
Siman, Nina , Adeyemi, Oluwaseun , Yamarik, Rebecca , Investigators, PRIM-ER, Bellolio, Fernanda , Bourenane, Sorayah, Brody, Abraham A. , Cameron, Lauren , Cooper, Julie J. , Deutsch, Ashley, Elsayem, Ahmed , Fleischer-Black, Jessica, Gang, Mauren, Goett, Rebecca , Heaton, Heather A. , Hill, Jacob , Isaacs, Eric, Jubanyik, Karen , Lamba, Sangeeta , Lin, Michelle , Loprinzi-Brauer, Caitlin , Madsen, Troy , Modrek, Ada, Otero, Ronny, Ouchi, Kei , Richardson, Christopher , Richardson, Lynne D. , Schoenfeld, Elizabeth , Shreves, Ashley, Tan, Audrey , Uspal, Julie, Venkat, Arvind , Walker, Laura , Wittman, Ian, Zimny, Erin, Miller, Joseph , Heaton, Heather, Bellolio, M Fernanda , Schoenfeld, Elizabeth M , Grudzen, Corita R. , Cuthel, Allison M. , Goldfeld, Keith S. , Investigators, PRIM-ER, Abella, Benjamin S. , Chodosh, Joshua , Elie, Marie‐Carmelle , Fernandez, Rosemarie , Gang, Mauren, Genes, Nicholas , Horwitz, Leora Idit , Lawrence, Katharine , Miller, Joseph S. A. , Ryan, Matthew, Shaw, Matthew, Southerland, Lauren T.

JAMA | January 15, 2025 | Volume: 333 | Issue: 7 | Pages: 599

10.1001/jama.2024.23696 Get It

Importance The emergency department (ED) offers an opportunity to initiate palliative care for older adults with serious, life-limiting illness. Objective To assess the effect of a multicomponent intervention to initiate palliative care in the ED on hospital admission, subsequent health care use, and survival in older adults with serious, life-limiting illness. Design, Setting, and Participants Cluster randomized, stepped-wedge, clinical trial including patients aged 66 years or older who visited 1 of 29 EDs across the US between May 1, 2018, and December 31, 2022, had 12 months of prior Medicare enrollment, and a Gagne comorbidity score greater than 6, representing a risk of short-term mortality greater than 30%. Nursing home patients were excluded. Intervention A multicomponent intervention (the Primary Palliative Care for Emergency Medicine intervention) included (1) evidence-based multidisciplinary education; (2) simulation-based workshops on serious illness communication; (3) clinical decision support; and (4) audit and feedback for ED clinical staff. Main Outcome and Measures The primary outcome was hospital admission. The secondary outcomes included subsequent health care use and survival at 6 months. Results There were 98 922 initial ED visits during the study period (median age, 77 years [IQR, 71-84 years]; 50% were female; 13% were Black and 78% were White; and the median Gagne comorbidity score was 8 [IQR, 7-10]). The rate of hospital admission was 64.4% during the preintervention period vs 61.3% during the postintervention period (absolute difference, −3.1% [95% CI, −3.7% to −2.5%]; adjusted odds ratio [OR], 1.03 [95% CI, 0.93 to 1.14]). There was no difference in the secondary outcomes before vs after the intervention. The rate of admission to an intensive care unit was 7.8% during the preintervention period vs 6.7% during the postintervention period (adjusted OR, 0.98 [95% CI, 0.83 to 1.15]). The rate of at least 1 revisit to the ED was 34.2% during the preintervention period vs 32.2% during the postintervention period (adjusted OR, 1.00 [95% CI, 0.91 to 1.09]). The rate of hospice use was 17.7% during the preintervention period vs 17.2% during the postintervention period (adjusted OR, 1.04 [95% CI, 0.93 to 1.16]). The rate of home health use was 42.0% during the preintervention period vs 38.1% during the postintervention period (adjusted OR, 1.01 [95% CI, 0.92 to 1.10]). The rate of at least 1 hospital readmission was 41.0% during the preintervention period vs 36.6% during the postintervention period (adjusted OR, 1.01 [95% CI, 0.92 to 1.10]). The rate of death was 28.1% during the preintervention period vs 28.7% during the postintervention period (adjusted OR, 1.07 [95% CI, 0.98 to 1.18]). Conclusions and Relevance This multicomponent intervention to initiate palliative care in the ED did not have an effect on hospital admission, subsequent health care use, or short-term mortality in older adults with serious, life-limiting illness. Trial Registration ClinicalTrials.gov Identifier: NCT03424109