Back to Authors

Kohli, Darrell

Mayo Clinic

Mayo Clinic

Citations 3

Evaluation of AI Summaries on Interdisciplinary Understanding of Ophthalmology Notes
Becerra, Clara M. Castillejo , Dahl, Heidi M., Patel, Neil R. , Kaplan, Tyler M., Kohli, Darrell, Bothun, Erick D. , Mohney, Brian G., Tooley, Andrea A. , Baratz, Keith H. , Iezzi, Raymond , Bakri, Sophie J. , Roddy, Gavin W. , Hodge, David O. , Sit, Arthur J. , Chen, John J. , D'Souza, Haley S, Barkmeier, Andrew J. , Hodge, David, Chen, John J , Castillejo Becerra, Clara M , Sit, Arthur J , Tailor, Prashant D. , D’Souza, Haley S. , Patel, Neil R., Starr, Matthew R.

JAMA Ophthalmology | April 4, 2025 | Volume: 143 | Issue: 5 | Pages: 410

10.1001/jamaophthalmol.2025.0351 Get It

ImportanceSpecialized ophthalmology terminology limits comprehension for nonophthalmology clinicians and professionals, hindering interdisciplinary communication and patient care. The clinical implementation of large language models (LLMs) into practice has to date been relatively unexplored.ObjectiveTo evaluate LLM–generated plain language summaries (PLSs) integrated into standard ophthalmology notes (SONs) in improving diagnostic understanding, satisfaction, and clarity.Design, Setting, and ParticipantsRandomized quality improvement study conducted from February 1, 2024, to May 31, 2024, including data from inpatient and outpatient encounters in a single tertiary academic center. Participants were nonophthalmology clinicians and professionals and ophthalmologists. The single inclusion criterion was any encounter note generated by an ophthalmologist during the study dates. Exclusion criteria were (1) lack of established nonophthalmology clinicians and professionals for outpatient encounters and (2) procedure-only patient encounters.InterventionAddition of LLM-generated plain language summaries to ophthalmology notes.Main Outcomes and MeasuresThe primary outcome was survey responses from nonophthalmology clinicians and professionals assessing understanding, satisfaction, and clarity of ophthalmology notes. Secondary outcomes were survey responses from ophthalmologists evaluating PLS in terms of clinical workflow and accuracy, objective measures of semantic quality, and safety analysis.ResultsA total of 362 (85%) nonophthalmology clinicians and professionals (33.0% response rate) preferred the PLS to SON. Demographic data on age, race and ethnicity, and sex were not collected. Nonophthalmology clinicians and professionals reported enhanced diagnostic understanding (percentage point increase, 9.0; 95% CI, 0.3-18.2; P = .01), increased note detail satisfaction (percentage point increase, 21.5; 95% CI, 11.4-31.5; P < .001), and improved explanation clarity (percentage point increase, 23.0; 95% CI, 12.0-33.1; P < .001) for notes containing a PLS. The addition of a PLS was associated with reduced comprehension gaps between clinicians who were comfortable and uncomfortable with ophthalmology terminology (from 26.1% [95% CI, 13.7%-38.6%; P < .001] to 14.4% [95% CI, 4.3%-24.6%; P > .06]). PLS semantic analysis found high meaning preservation (bidirectional encoder representations from transformers score mean F1 score: 0.85) with greater readability than SONs (Flesch Reading Ease: 51.8 vs 43.6; Flesch-Kincaid Grade Level: 10.7 vs 11.9). Ophthalmologists (n = 489; 84% response rate) reported high PLS accuracy (90% [320 of 355] a great deal) with minimal review time burden (94.9% [464 of 489] ≤1 minute). PLS error rate on ophthalmologist review was 26% (126 of 489). A total of 83.9% (104 of 126) of errors were deemed low risk for harm and none had a risk of severe harm or death.Conclusions and RelevanceIn this study, use of LLM-generated PLSs was associated with enhanced comprehension and satisfaction among nonophthalmology clinicians and professionals, which might aid interdisciplinary communication. Careful implementation and safety monitoring are recommended for clinical integration given the persistence of errors despite physician review.
Metabolic syndrome and its components are associated with non-arteritic anterior ischaemic optic neuropathy
Kohli, Darrell, Wu, Kristi Y., White, Launia J. , Hodge, David O. , Chen, John J. , Roddy, Gavin W. , Chen, John J

BMJ Open Ophthalmology | October 3, 2022 | Volume: 7 | Issue: 1 | Pages: e001111

10.1136/bmjophth-2022-001111 Get It

Purpose To determine whether metabolic syndrome (MetS) is a risk factor for various forms of optic neuropathy including non-arteritic anterior ischaemic optic neuropathy (NAION). Methods This population-based analysis identified patients ≥40 years of age in Olmsted County, Minnesota, USA using the Rochester Epidemiology Project 2005–2018. Patients with MetS were identified if three or more of the five standard criteria for diagnosing MetS were present: systemic hypertension, hyperglycaemia, hypertriglyceridaemia, reduced high-density lipoprotein cholesterol (hypoalphalipoproteinaemia) and central adiposity defined by increased body mass index. Charts of patients identified as having an optic neuropathy were reviewed to record specific diagnoses and compared with patients without ocular pathology other than cataract. The odds ratio (OR) of association with MetS was calculated and adjusted for age, sex and race with multivariate analysis for the various optic neuropathies. Results Patients with MetS were more likely to have an optic neuropathy than those without (OR 2.2, p<0.001). After adjusting for age, sex and race, the only optic neuropathy found to be significantly associated with MetS was NAION (OR 6.17, p=0.002). For patients with NAION, though each individual component of MetS was individually significantly associated with MetS, further analysis suggested that hypertriglyceridaemia, hypoalphalipoproteinaemia and hyperglycaemia were likely the key drivers in the overall significance between NAION and MetS. Conclusion Patients with MetS were more likely to have NAION. Further studies are needed to determine whether MetS is a modifiable risk factor for NAION.
Multiple Systemic Vascular Risk Factors Are Associated With Low-Tension Glaucoma
Funk, Robert O., Hodge, David O. , Kohli, Darrell, Roddy, Gavin W.

Journal of Glaucoma | November 3, 2021 | Volume: 31 | Issue: 1 | Pages: 15-22

10.1097/ijg.0000000000001964 Get It

Précis: Multiple systemic vascular-associated conditions including systemic hypertension and hypotension, diabetes mellitus, migraine headache, peripheral vascular disease, Raynaud syndrome, and anemia were associated with low-tension glaucoma. Purpose: The purpose of this study was to identify systemic risk factors associated with low-tension glaucoma. Patients and Methods: A retrospective case-control study design was employed to identify patients seen at the Mayo Clinic Department of Ophthalmology between 2005 and 2015 with low-tension glaucoma and an age-matched and sex-matched control group, each containing 277 patients. Results: The low-tension glaucoma group had more myopic refractive errors (−1.6 vs. −1.0 D, P <0.001), lower intraocular pressure (14.2 vs. 15.2 mm Hg, P <0.001), and a higher cup-to-disc ratio (0.7 vs. 0.3, P <0.001). The low-tension glaucoma group was significantly less likely to be obese (body mass index >30, P =0.03). This group had a significantly higher prevalence of systemic hypertension [odds ratio (OR): 1.64, P =0.004], diabetes mellitus (OR: 3.01, P <0.001), peripheral vascular disease (OR: 2.61, P =0.009), migraine headache (OR: 2.12, P =0.02), anemia (OR: 2.18, P =0.003), systemic hypotension (OR: 4.43, P <0.001), Raynaud syndrome (OR: 3.09, P =0.05), and angiotensin-converting enzyme inhibitor (OR: 1.64, P =0.01) or calcium channel blocker use (OR: 1.98, P =0.004). After adjusting for systemic hypertension, calcium channel blocker use remained significant (OR: 1.70, P =0.03). No significant difference was found between groups with respect to hyperlipidemia, obstructive sleep apnea, coronary artery disease, carotid stenosis, stroke, or statin, angiotensin-converting enzyme inhibitor, angiotensin receptor blocker, beta-blocker, or metformin use. Conclusions: Multiple vascular-associated conditions were associated with low-tension glaucoma including systemic hypertension, diabetes mellitus, peripheral vascular disease, migraine headache, Raynaud syndrome, anemia, systemic hypotension, and calcium channel blocker use. This study strengthens the evidence for the vascular hypothesis of low-tension glaucoma.