Mohney, Brian G.

ImportanceSpecialized ophthalmology terminology limits comprehension for nonophthalmology clinicians and professionals, hindering interdisciplinary communication and patient care. The clinical implementation of large language models (LLMs) into practice has to date been relatively unexplored.ObjectiveTo evaluate LLM–generated plain language summaries (PLSs) integrated into standard ophthalmology notes (SONs) in improving diagnostic understanding, satisfaction, and clarity.Design, Setting, and ParticipantsRandomized quality improvement study conducted from February 1, 2024, to May 31, 2024, including data from inpatient and outpatient encounters in a single tertiary academic center. Participants were nonophthalmology clinicians and professionals and ophthalmologists. The single inclusion criterion was any encounter note generated by an ophthalmologist during the study dates. Exclusion criteria were (1) lack of established nonophthalmology clinicians and professionals for outpatient encounters and (2) procedure-only patient encounters.InterventionAddition of LLM-generated plain language summaries to ophthalmology notes.Main Outcomes and MeasuresThe primary outcome was survey responses from nonophthalmology clinicians and professionals assessing understanding, satisfaction, and clarity of ophthalmology notes. Secondary outcomes were survey responses from ophthalmologists evaluating PLS in terms of clinical workflow and accuracy, objective measures of semantic quality, and safety analysis.ResultsA total of 362 (85%) nonophthalmology clinicians and professionals (33.0% response rate) preferred the PLS to SON. Demographic data on age, race and ethnicity, and sex were not collected. Nonophthalmology clinicians and professionals reported enhanced diagnostic understanding (percentage point increase, 9.0; 95% CI, 0.3-18.2; P = .01), increased note detail satisfaction (percentage point increase, 21.5; 95% CI, 11.4-31.5; P < .001), and improved explanation clarity (percentage point increase, 23.0; 95% CI, 12.0-33.1; P < .001) for notes containing a PLS. The addition of a PLS was associated with reduced comprehension gaps between clinicians who were comfortable and uncomfortable with ophthalmology terminology (from 26.1% [95% CI, 13.7%-38.6%; P < .001] to 14.4% [95% CI, 4.3%-24.6%; P > .06]). PLS semantic analysis found high meaning preservation (bidirectional encoder representations from transformers score mean F1 score: 0.85) with greater readability than SONs (Flesch Reading Ease: 51.8 vs 43.6; Flesch-Kincaid Grade Level: 10.7 vs 11.9). Ophthalmologists (n = 489; 84% response rate) reported high PLS accuracy (90% [320 of 355] a great deal) with minimal review time burden (94.9% [464 of 489] ≤1 minute). PLS error rate on ophthalmologist review was 26% (126 of 489). A total of 83.9% (104 of 126) of errors were deemed low risk for harm and none had a risk of severe harm or death.Conclusions and RelevanceIn this study, use of LLM-generated PLSs was associated with enhanced comprehension and satisfaction among nonophthalmology clinicians and professionals, which might aid interdisciplinary communication. Careful implementation and safety monitoring are recommended for clinical integration given the persistence of errors despite physician review.

OBJECTIVE. We investigated the prevalence and types of psychiatric disorders diagnosed by early adulthood among patients who had common forms of strabismus as children. METHODS. The medical records of children (<19 years) who were diagnosed as having esotropia (N = 266) or exotropia (N = 141) while residents of Olmsted County, Minnesota, between January 1, 1985, and December 31, 1994, were reviewed retrospectively for psychiatric disease diagnoses. Each case subject was compared with a randomly selected, individually birth- and gender-matched, control subject from the same population. RESULTS. A mental health disorder was diagnosed for 168 (41.3%) of the 407 patients with a history of childhood strabismus, who were monitored to a mean age of 17.4 years, compared with 125 control subjects (30.7%). Children with exotropia were 3.1 times more likely to develop a psychiatric disorder than were control subjects when monitored to a mean age of 20.3 years. Children with esotropia were no more likely to develop mental illness than were control subjects when monitored for similar periods. Patients with intermittent exotropia also were significantly more likely to have greater numbers of mental health disorders, mental health emergency department visits, and mental health hospitalizations and to have suicidal or homicidal ideation. CONCLUSIONS. Children diagnosed as having strabismus in this population, especially those with exotropia, were at increased risk for developing mental illness by early adulthood. Patients with intermittent exotropia seemed to be particularly prone to developing significant psychiatric diseases by the third decade of life.