Abdelfattah, Fatmaelzahraa E.

Objective To compare the diagnostic accuracy of four available automated electronic medical record (EMR) retrieval methods, including a large language model (LLM)-assisted workflow, against manual chart adjudication for identifying cardiovascular events. Design Retrospective diagnostic accuracy study. Setting Three sites within a single US tertiary health system. Participants Two adult cohorts with previously adjudicated cardiovascular outcomes were included. Cohort 1 included 2258 patients treated with immune checkpoint inhibitors, and Cohort 2 included 1426 patients who underwent transcatheter aortic valve replacement. Primary and secondary outcome measures The reference standard was clinician manual chart adjudication. Outcomes included ischaemic stroke or transient ischaemic attack, myocardial infarction (MI), heart failure (HF) exacerbation or hospitalisation and a composite major adverse cardiovascular events (MACE) outcome. Automated retrieval methods included International Classification of Diseases (ICD) codes, primary diagnosis, problem list and a zero-shot LLM workflow. Area under the (receiver operating characteristic) curve (AUC), sensitivity, specificity and net reclassification improvement were assessed. Results In Cohort 1, the LLM achieved the highest AUC for stroke (0.920; 95% CI 0.881 to 0.958), MI (0.938; 95% CI 0.905 to 0.971) and composite MACE (0.880; 95% CI 0.854 to 0.907), whereas ICD-based retrieval had a higher AUC for HF (0.882; 95% CI 0.845 to 0.918 vs 0.873; 95% CI 0.831 to 0.914). In Cohort 2, the LLM achieved the highest AUC for all evaluated outcomes: stroke (0.915; 95% CI 0.862 to 0.968), MI (0.928; 95% CI 0.839 to 1.000), HF (0.844; 95% CI 0.803 to 0.884) and composite MACE (0.862; 95% CI 0.829 to 0.895). In Cohort 1, differences in AUC between the LLM and ICD methods were not statistically significant across outcomes, whereas in Cohort 2 the LLM showed significantly higher AUC for stroke and composite MACE. Conclusion In this multisite retrospective validation study, the LLM-assisted workflow showed strong but context-dependent performance for identifying cardiovascular events from the EMR. Performance varied by outcome and cohort, and ICD-based retrieval remained competitive for some use cases. These findings support a complementary role for LLM-assisted extraction in retrospective cardiovascular outcomes research.

Background: Pulmonary hypertension (PH) is a complex condition associated with significant morbidity and mortality. Traditional diagnostic and management approaches for PH often face limitations, leading to delays in diagnosis and potentially suboptimal treatment outcomes. Artificial intelligence (AI), encompassing machine learning (ML) and deep learning (DL) offers a transformative approach to PH care. Materials and Methods: We systematically searched PubMed, Scopus, and Web of Science for original studies on AI applications in PH, using predefined keywords. Out of more than 500 initial articles, 45 relevant studies were selected. Risk of bias was evaluated using PROBAST (Prediction model Risk of Bias Assessment Tool). Results: This review examines the potential applications of AI in PH, focusing on its role in enhancing diagnosis, disease classification, and prognostication. We discuss how AI-powered analysis of medical data can improve the accuracy and efficiency of detecting PH. Furthermore, we explore the potential of AI in risk stratification, leading to treatment optimization for PH. Conclusions: While acknowledging the existing challenges and limitations and the need for continued exploration and refinement of AI-driven tools, this review highlights the significant promise of AI in revolutionizing PH management to improve patient outcomes.