Proceedings of the Human Factors and Ergonomics Society Annual Meeting | September 16, 2026 | Volume: No volume available | Issue: No issue available | Pages: No page available
Surgeons are at high risk of developing long-term Work-Related Musculoskeletal Disorders (WMSDs) due to awkward sustained postures. Passive spine-supporting exoskeletons are a potential intervention to improve posture and reduce fatigue. The NekSpine ® was evaluated by 21 surgeons (15 male) across two hospital sites within a quaternary academic hospital system. Each surgeon performed at least two comparable procedures, one with the exoskeleton and one without. Surgeons completed pre- and postoperative surveys assessing NASA-TLX workload, usability, body-part discomfort, overall fatigue, and workflow disruptions. Eighty-two cases were evaluated (43 exoskeleton cases). Compared with baseline cases, surgeons reported reduced neck and upper back discomfort and lower overall fatigue when using the exoskeleton. The NekSpine ® exoskeleton may reduce spinal discomfort and fatigue during surgery, supporting its potential as an ergonomic intervention for surgeons.
Automated Discharge Instructions in Medical and Surgical Care: A Systematic Review of Patient Engagement and Clinical Outcomes
Background: Automated discharge instructions are increasingly used to support post-discharge communication, patient education, and nursing follow-up, yet the current state remains unidentified. This systematic review explores the types of automated discharge instructions used and their effectiveness in enhancing patient engagement and reducing readmission, emergency department visits and reoperation rates. Methods: A systematic search was conducted on 15 April 2025, using Embase, PubMed, Scopus, Web of Science, and CINAHL, following PRISMA guidelines. Inclusion criteria required peer-reviewed original research evaluating the utilization of automated patient discharge instructions following hospital admission or surgical stay. Exclusion criteria included correspondence, reviews, educational materials, not peer-reviewed, retracted reports, not retrievable, and no English translation. Risk of bias was assessed independently using NIH, JBI, ROB-2, and ROBINS-I tools. Two investigators independently conducted the screening, extraction, and synthesis of results using Endnote and Microsoft Excel. Results: Of the 1252 records identified, 13 studies were selected for analysis. There was a total of 34,386 patients across a diverse range of healthcare settings and clinical contexts. The average sample size per study was approximately 4912, with study samples ranging from 16 to 13,188 patients. The modalities of discharge instructions included automated phone calls (23.1%) and/or text messages (53.8%), as well as printed out auto-generated summaries (15.4%). Patient engagement was generally high, with automated phone calls showing the most consistent interaction, with completion rates ranging from 44% to 56%, often prompting clinical follow-up. SMS tools demonstrated strong scalability and response rates up to 87%. Two studies reported on hospital readmission outcomes and only a single study reported on emergency department revisit rates, while none assessed reoperation outcomes. Among those reporting readmission, automated phone calls and SMS were associated with lower or proxy-reduced readmission rates. Included studies had low to moderate levels of bias. Conclusions: While evidence on clinical outcomes such as readmissions, emergency department revisits, and reoperations remains limited and inconclusive, automated discharge tools—particularly phone calls and SMS—consistently demonstrated high patient engagement. Automated discharge tools show promise for supporting transitional care, discharge education, and post-discharge monitoring, highlighting the future role of automated tools in nursing workflows to support follow-up, escalation, and continuity of care.
Patient Characteristics and Clinical Outcomes of Acute Pyelonephritis Treated in Mayo Clinic's Hospital-at-Home Program
Abstract Background Outcomes of patients with acute pyelonephritis (AP) treated in a hospital-at-home setting have not been comprehensively evaluated in the United States. Methods We performed a multicenter, retrospective cohort study of adults diagnosed with and managed for AP in Mayo Clinic's Advanced Care at Home (ACH) program between July 2020 and January 2025. Collected data included demographics, Charlson Comorbidity Index (CCI), genitourinary comorbidities, severity of illness (SOI), and risk of mortality (ROM) scores, as well as pyelonephritis-related complications. Outcomes included length of stay (LOS), escalation of care, and 30-day postdischarge emergency department (ED) visits, readmissions, and mortality. Results A total of 165 patients met inclusion criteria. Median age was 67 years; SOI scores were moderate in 33.3%, major in 52.1%, and extreme in 8.5%. ROM scores were moderate in 30.3%, major in 38.2%, and extreme in 6.7%. Median CCI score was 5, and all patients had preexisting genitourinary conditions. On admission, 30.9% met sepsis criteria, acute kidney injury was present in 47.3%, and bacteremia developed in 33.3%. Median LOS in the ACH program was 3.1 days. Only 4.8% required escalation to a brick-and-mortar hospital. Readmission occurred in 17.0%, and 4.8% had ED visits. No in-program deaths occurred. Conclusions This multicenter retrospective study shows that AP, including cases with high illness severity and complex comorbidities, can be managed safely and effectively in a hospital-at-home setting with careful patient selection and robust infrastructure to support timely escalation when needed.
Enhancing Clinician Trust in AI Diagnostics: A Dynamic Framework for Confidence Calibration and Transparency
Background: Artificial Intelligence (AI)-driven Decision Support Systems (DSSs) promise improvements in diagnostic accuracy and clinical workflow efficiency, but their adoption is hindered by inadequate confidence calibration, limited transparency, and poor alignment with real-world decision processes, which limit clinician trust and lead to high override rates. Methods: We developed and validated a dynamic scoring framework to enhance trust in AI-generated diagnoses by integrating AI confidence scores, semantic similarity measures, and transparency weighting into the override decision process using 6689 cardiovascular cases from the MIMIC-III dataset. Override thresholds were calibrated and validated across varying transparency and confidence levels, with override rate as the primary acceptance measure. Results: The implementation of this framework reduced the override rate to 33.29%, with high-confidence predictions (90–99%) overridden at a rate of only 1.7%, and low-confidence predictions (70–79%) at a rate of 99.3%. Minimal transparency diagnoses had a 73.9% override rate compared to 49.3% for moderate transparency. Statistical analyses confirmed significant associations between confidence, transparency, and override rates (p < 0.001). Conclusions: These findings suggest that enhanced transparency and confidence calibration can substantially reduce override rates and promote clinician acceptance of AI diagnostics. Future work should focus on clinical validation to optimize patient safety, diagnostic accuracy, and efficiency.
Enhancing Clinical Decision Support with Adaptive Iterative Self-Query Retrieval for Retrieval-Augmented Large Language Models
Retrieval-Augmented Generation (RAG) offers a promising strategy to harness large language models (LLMs) for delivering up-to-date, accurate clinical guidance while reducing physicians’ cognitive burden, yet its effectiveness hinges on query clarity and structure. We propose an adaptive Self-Query Retrieval (SQR) framework that integrates three refinement modules—PICOT (Population, Intervention, Comparison, Outcome, Time), SPICE (Setting, Population, Intervention, Comparison, Evaluation), and Iterative Query Refinement (IQR)—to automatically restructure and iteratively enhance clinical questions until they meet predefined retrieval-quality thresholds. Implemented on Gemini-1.0 Pro, we benchmarked SQR using thirty postoperative rhinoplasty queries, evaluating responses for accuracy and relevance on a three-point Likert scale and for retrieval quality via precision, recall, and F1 score; statistical significance was assessed by one-way ANOVA with Tukey post-hoc testing. The full SQR pipeline achieved 87% accuracy (Likert 2.4 ± 0.7) and 100% relevance (Likert 3.0 ± 0.0), significantly outperforming a non-refined RAG baseline (50% accuracy, 80% relevance; p < 0.01 and p = 0.03). Precision, recall, and F1 rose from 0.17, 0.39 and 0.24 to 0.53, 1.00, and 0.70, respectively, while PICOT-only and SPICE-only variants yielded intermediate improvements. These findings demonstrate that automated structuring and iterative enhancement of queries via SQR substantially elevate LLM-based clinical decision support, and its model-agnostic architecture enables rapid adaptation across specialties, data sources, and LLM platforms.
Synthetic Patient–Physician Conversations Simulated by Large Language Models: A Multi-Dimensional Evaluation
Background: Data accessibility remains a significant barrier in healthcare AI due to privacy constraints and logistical challenges. Synthetic data, which mimics real patient information while remaining both realistic and non-identifiable, offers a promising solution. Large Language Models (LLMs) create new opportunities to generate high-fidelity clinical conversations between patients and physicians. However, the value of this synthetic data depends on careful evaluation of its realism, accuracy, and practical relevance. Objective: To assess the performance of four leading LLMs: ChatGPT 4.5, ChatGPT 4o, Claude 3.7 Sonnet, and Gemini Pro 2.5 in generating synthetic transcripts of patient–physician interactions in plastic surgery scenarios. Methods: Each model generated transcripts for ten plastic surgery scenarios. Transcripts were independently evaluated by three clinically trained raters using a seven-criterion rubric: Medical Accuracy, Realism, Persona Consistency, Fidelity, Empathy, Relevancy, and Usability. Raters were blinded to the model identity to reduce bias. Each was rated on a 5-point Likert scale, yielding 840 total evaluations. Descriptive statistics were computed, and a two-way repeated measures ANOVA was used to test for differences across models and metrics. In addition, transcripts were analyzed using automated linguistic and content-based metrics. Results: All models achieved strong performance, with mean ratings exceeding 4.5 across all criteria. Gemini 2.5 Pro received mean scores (5.00 ± 0.00) in Medical Accuracy, Realism, Persona Consistency, Relevancy, and Usability. Claude 3.7 Sonnet matched the scores in Persona Consistency and Relevancy and led in Empathy (4.96 ± 0.18). ChatGPT 4.5 also achieved perfect scores in Relevancy, with high scores in Empathy (4.93 ± 0.25) and Usability (4.96 ± 0.18). ChatGPT 4o demonstrated consistently strong but slightly lower performance across most dimensions. ANOVA revealed no statistically significant differences across models (F(3, 6) = 0.85, p = 0.52). Automated analysis showed substantial variation in transcript length, style, and content richness: Gemini 2.5 Pro generated the longest and most emotionally expressive dialogues, while ChatGPT 4o produced the shortest and most concise outputs. Conclusions: Leading LLMs can generate medically accurate, emotionally appropriate synthetic dialogues suitable for educational and research use. Despite high performance, demographic homogeneity in generated patients highlights the need for improved diversity and bias mitigation in model outputs. These findings support the cautious, context-aware integration of LLM-generated dialogues into medical training, simulation, and research.
The PIEE Cycle: A Structured Framework for Red Teaming Large Language Models in Clinical Decision-Making
The increasing integration of large language models (LLMs) into healthcare presents significant opportunities, but also critical risks related to patient safety, accuracy, and ethical alignment. Despite these concerns, no standardized framework exists for systematically evaluating and stress testing LLM behavior in clinical decision-making. The PIEE cycle—Planning and Preparation, Information Gathering and Prompt Generation, Execution, and Evaluation—is a structured red-teaming framework developed specifically to address artificial intelligence (AI) safety risks in healthcare decision-making. PIEE enables clinicians and informatics teams to simulate adversarial prompts, including jailbreaking, social engineering, and distractor attacks, to stress-test language models in real-world clinical scenarios. Model performance is evaluated using specific metrics such as true positive and false positive rates for detecting harmful content, hallucination rates measured through adapted TruthfulQA scoring, safety and reliability assessments, bias detection via adapted BBQ benchmarks, and ethical evaluation using structured Likert-based scoring rubrics. The framework is illustrated using examples from plastic surgery, but is adaptable across specialties, and is intended for use by all medical providers, regardless of their backgrounds or familiarity with artificial intelligence. While the framework is currently conceptual and validation is ongoing, PIEE provides a practical foundation for assessing the clinical reliability and ethical robustness of LLMs in medicine.
38. The Use of Multimodal AI for Facial Analysis in Plastic Surgery
(1) Burn injuries demand multidisciplinary, evidence-based care, yet the extensive literature complicates timely decision making. Retrieval-augmented generation (RAG) synthesizes research while addressing inaccuracies in pretrained models. However, citation bias in sourcing for RAG often prioritizes highly cited studies, overlooking less-cited but valuable research. This study examines RAG’s performance in burn management, comparing citation levels to enhance evidence synthesis, reduce selection bias, and guide decisions. (2) Two burn management datasets were assembled: 30 highly cited (mean: 303) and 30 less-cited (mean: 21). The Gemini-1.0-Pro-002 RAG model addressed 30 questions, ranging from foundational principles to advanced surgical approaches. Responses were evaluated for accuracy (5-point scale), readability (Flesch–Kincaid metrics), and response time with Wilcoxon rank sum tests (p < 0.05). (3) RAG achieved comparable accuracy (4.6 vs. 4.2, p = 0.49), readability (Flesch Reading Ease: 42.8 vs. 46.5, p = 0.26; Grade Level: 9.9 vs. 9.5, p = 0.29), and response time (2.8 vs. 2.5 s, p = 0.39) for the highly and less-cited datasets. (4) Less-cited research performed similarly to highly cited sources. This equivalence broadens clinicians’ access to novel, diverse insights without sacrificing quality. As plastic surgery evolves, RAG’s inclusive approach fosters innovation, improves patient care, and reduces cognitive burden by integrating underutilized studies. Embracing RAG could propel the field toward dynamic, forward-thinking care.
Facial Analysis for Plastic Surgery in the Era of Artificial Intelligence: A Comparative Evaluation of Multimodal Large Language Models
Background/Objectives: Facial analysis is critical for preoperative planning in facial plastic surgery, but traditional methods can be time consuming and subjective. This study investigated the potential of Artificial Intelligence (AI) for objective and efficient facial analysis in plastic surgery, with a specific focus on Multimodal Large Language Models (MLLMs). We evaluated their ability to analyze facial skin quality, volume, symmetry, and adherence to aesthetic standards such as neoclassical facial canons and the golden ratio. Methods: We evaluated four MLLMs—ChatGPT-4o, ChatGPT-4, Gemini 1.5 Pro, and Claude 3.5 Sonnet—using two evaluation forms and 15 diverse facial images generated by a Generative Adversarial Network (GAN). The general analysis form evaluated qualitative skin features (texture, type, thickness, wrinkling, photoaging, and overall symmetry). The facial ratios form assessed quantitative structural proportions, including division into equal fifths, adherence to the rule of thirds, and compatibility with the golden ratio. MLLM assessments were compared with evaluations from a plastic surgeon and manual measurements of facial ratios. Results: The MLLMs showed promise in analyzing qualitative features, but they struggled with precise quantitative measurements of facial ratios. Mean accuracy for general analysis were ChatGPT-4o (0.61 ± 0.49), Gemini 1.5 Pro (0.60 ± 0.49), ChatGPT-4 (0.57 ± 0.50), and Claude 3.5 Sonnet (0.52 ± 0.50). In facial ratio assessments, scores were lower, with Gemini 1.5 Pro achieving the highest mean accuracy (0.39 ± 0.49). Inter-rater reliability, based on Cohen’s Kappa values, ranged from poor to high for qualitative assessments (κ > 0.7 for some questions) but was generally poor (near or below zero) for quantitative assessments. Conclusions: Current general purpose MLLMs are not yet ready to replace manual clinical assessments but may assist in general facial feature analysis. These findings are based on testing models not specifically trained for facial analysis and serve to raise awareness among clinicians regarding the current capabilities and inherent limitations of readily available MLLMs in this specialized domain. This limitation may stem from challenges with spatial reasoning and fine-grained detail extraction, which are inherent limitations of current MLLMs. Future research should focus on enhancing the numerical accuracy and reliability of MLLMs for broader application in plastic surgery, potentially through improved training methods and integration with other AI technologies such as specialized computer vision algorithms for precise landmark detection and measurement.