Mukherjee, Piyush

INTRODUCTION: High-quality colonoscopy requires accurate risk stratification for surveillance per the 2020 US Multi-Society Task Force guidelines and adherence to 2024 American College of Gastroenterology/American Society for Gastrointestinal Endoscopy quality benchmarks. Both are operationally challenging in clinical practice. We developed and validated Colon-Pilot, a large language model—powered clinical decision support system using GPT-4o to automate and standardize both functions. METHODS: The system was evaluated in 2 operational modes: (i) a human-in-the-loop clinical decision support validation of surveillance recommendations for 596 colonoscopies, comparing concordance with 2020 US Multi-Society Task Force guidelines against expert consensus, and (ii) an automated administrative audit applying Colon-Pilot to 42,632 colonoscopies across the Mayo Clinic Health System to calculate 2024 American College of Gastroenterology/American Society for Gastrointestinal Endoscopy priority quality indicators. Recommendations were autogenerated unless predefined safety criteria triggered manual review. RESULTS: Colon-Pilot issued recommendations for 522 of 596 cases (87.6%) and flagged 12.4% for manual review. For automated cases, guideline-concordant accuracy was 97.5% (Cohen κ = 0.970) versus 69.7% (κ = 0.781) for original endoscopist recommendations. Discordant artificial intelligence (AI) cases (n = 13) most often recommended longer-than-appropriate intervals (62%). Applied to the enterprise data set, Colon-Pilot calculated performance exceeding 2024 targets: adenoma detection rate 49.8% (≥35%), sessile serrated lesion detection rate 17.7% (≥6%), bowel preparation adequacy 91.8% (≥90%), and cecal intubation rate 97.4% (≥95%). DISCUSSION: Colon-Pilot demonstrated high fidelity in applying surveillance guidelines and automated quality benchmarking, outperforming unassisted endoscopists in guideline adherence. By combining safety protocols with large-scale automated reporting, it offers a scalable solution for improving both efficiency and quality in colorectal cancer prevention.

Abstract Objective Access to palliative care (PC) is important for many patients with uncontrolled symptom burden from serious or complex illness. However, many patients who could benefit from PC do not receive it early enough or at all. We sought to address this problem by building a predictive model into a comprehensive clinical framework with the aims to (i) identify in-hospital patients likely to benefit from a PC consult, and (ii) intervene on such patients by contacting their care team. Materials and Methods Electronic health record data for 68 349 inpatient encounters in 2017 at a large hospital were used to train a model to predict the need for PC consult. This model was published as a web service, connected to institutional data pipelines, and consumed by a downstream display application monitored by the PC team. For those patients that the PC team deems appropriate, a team member then contacts the patient’s corresponding care team. Results Training performance AUC based on a 20% holdout validation set was 0.90. The most influential variables were previous palliative care, hospital unit, Albumin, Troponin, and metastatic cancer. The model has been successfully integrated into the clinical workflow making real-time predictions on hundreds of patients per day. The model had an “in-production” AUC of 0.91. A clinical trial is currently underway to assess the effect on clinical outcomes. Conclusions A machine learning model can effectively predict the need for an inpatient PC consult and has been successfully integrated into practice to refer new patients to PC.