Dalvin, Lauren A.

Purpose: To analyze the accuracy and thoroughness of three large language models (LLMs) to produce information for providers about immune checkpoint inhibitor ocular toxicities. Methods: Eight questions were created about the general definition of checkpoint inhibitors, their mechanism of action, ocular toxicities, and toxicity management. All were inputted into ChatGPT 4.0, Bard, and LLaMA programs. Using the six-point Likert scale for accuracy and completeness, four ophthalmologists who routinely treat ocular toxicities of immunotherapy agents rated the LLMs answers. Analysis of variance testing was used to assess significant differences among the three LLMs and a post hoc pairwise t-test. Fleiss kappa values were calculated to account for interrater variability. Results: ChatGPT responses were rated with an average of 4.59 for accuracy and 4.09 for completeness; Bard answers were rated 4.59 and 4.19; LLaMA results were rated 4.38 and 4.03. The three LLMs did not significantly differ in accuracy (P = 0.47) nor completeness (P = 0.86). Fleiss kappa values were found to be poor for both accuracy (−0.03) and completeness (0.01). Conclusion: All three LLMs provided highly accurate and complete responses to questions centered on immune checkpoint inhibitor ocular toxicities and management. Further studies are needed to assess specific immune checkpoint inhibitor agents and the accuracy and completeness of updated versions of LLMs.

Purpose: The purpose of this study was to assess the accuracy and completeness of 3 large language models (LLMs) to generate information about antibody–drug conjugate (ADC)-associated ocular toxicities. Methods: There were 22 questions about ADCs, tisotumab vedotin, and mirvetuximab soravtansine that were developed and input into ChatGPT 4.0, Bard, and LLaMa. Answers were rated by 4 ocular toxicity experts using standardized 6-point Likert scales on accuracy and completeness. ANOVA tests were conducted for comparison between the 3 subgroups, followed by pairwise t-tests. Interrater variability was assessed with Fleiss kappa tests. Results: The mean accuracy score was 4.62 (SD 0.89) for ChatGPT, 4.77 (SD 0.90) for Bard, and 4.41 (SD 1.09) for LLaMA. Both ChatGPT (P = 0.03) and Bard (P = 0.003) scored significantly better for accuracy when compared with LLaMA. The mean completeness score was 4.43 (SD 0.91) for ChatGPT, 4.57 (SD 0.93) for Bard, and 4.42 (SD 0.99) for LLaMA. There were no significant differences in completeness scores between groups. Fleiss kappa assessment for interrater variability was good (0.74) for accuracy and fair (0.31) for completeness. Conclusions: All 3 LLMs had relatively high accuracy and completeness ratings, showing LLMs are able to provide sufficient answers for niche topics of ophthalmology. Our results indicate that ChatGPT and Bard may be slightly better at providing more accurate answers than LLaMA. As further research and treatment plans are developed for ADC-associated ocular toxicities, these LLMs should be reassessed to see if they provide complete and accurate answers that remain in line with current medical knowledge.

Purpose: To report the rare clinical, optical coherence tomography, and optical coherence tomography-angiography (OCT-A) findings of a visually significant choroidal neovascular membrane in the setting of focal choroidal excavation in a child. Methods: Case report and literature review. Results: A 9-year-old girl with focal choroidal excavation–related central choroidal neovascular membrane based on clinical findings and multimodal imaging. Patient's visual acuity and retinal findings progressed, and bevacizumab intravitreal therapy (off label) was started with resultant stepwise improvement in visual acuity and retinal imaging findings, including regression of a neovascular complex on OCT-angiography. Conclusion: This case highlights the successful use of bevacizumab for a rare choroidal neovascular complex associated with focal choroidal excavation in a child.

Purpose: To identify demographic and clinical factors associated with delayed diagnosis in patients with primary vitreoretinal lymphoma (VRL). Methods: Retrospective, tertiary referral center-based cohort study of all patients at Mayo Clinic in Rochester, Minnesota, with a biopsy-proven diagnosis of VRL from January 1, 2000, to October 31, 2022. Results: There were 87 patients included during the 22-year study period with 73 patients (83.9%) diagnosed with VRL upon initial evaluation at the tertiary center, with the other 14 patients (16.1%) diagnosed later. The median referral time was 4.8 months (range: 0–113 months). Patients who received an initial diagnosis of inflammatory uveitis or another incorrect diagnosis elsewhere were referred slower than those initially diagnosed with VRL (P = 0.04). The most common incorrect initial diagnosis from an outside institution was inflammatory uveitis (n = 35, 40.2%). When patients were split into four groups based on referral time, prior use of corticosteroids was associated with a significant delay in referral (P = 0.03). Conclusion: Diagnosing VRL continues to be challenging, as months-long delays from initial evaluation to expert referral center evaluation are common. Prior use of corticosteroids was associated with delay in diagnosis and referral time, underscoring the need to increase awareness regarding differences between VRL and uveitis.

Angiogenesis has an essential role in the de novo evolution of choroidal melanoma as well as choroidal nevus transformation into melanoma. Differentiating early-stage melanoma from nevus is of high clinical importance; thus, imaging techniques that provide objective information regarding tumor microvasculature structures could aid accurate early detection. Herein, we investigated the feasibility of quantitative high-definition microvessel imaging (qHDMI) for differentiation of choroidal tumors in humans. This new ultrasound-based technique encompasses a series of morphological filtering and vessel enhancement techniques, enabling the visualization of tumor microvessels as small as 150 microns and extracting vessel morphological features as new tumor biomarkers. Distributional differences between the malignant melanomas and benign nevi were tested on 37 patients with choroidal tumors using a non-parametric Wilcoxon rank-sum test, and statistical significance was declared for biomarkers with p-values < 0.05. The ocular oncology diagnosis was choroidal melanoma (malignant) in 21 and choroidal nevus (benign) in 15 patients. The mean thickness of benign and malignant masses was 1.70 ± 0.40 mm and 3.81 ± 2.63 mm, respectively. Six HDMI biomarkers, including number of vessel segments (p = 0.003), number of branch points (p = 0.003), vessel density (p = 0.03), maximum tortuosity (p = 0.001), microvessel fractal dimension (p = 0.002), and maximum diameter (p = 0.003) exhibited significant distributional differences between the two groups. Contrast-free HDMI provided noninvasive imaging and quantification of microvessels of choroidal tumors. The results of this pilot study indicate the potential use of qHDMI as a complementary tool for characterization of small ocular tumors and early detection of choroidal melanoma.

To investigate downstream molecular changes caused by mitogen-activated protein kinase (MEK) inhibitor treatment and further explore the impact of direct knockdown of early growth response-1 (EGR1) in melanoma cell culture. RNA-sequencing (RNA-Seq) was performed to determine gene expression changes with MEK inhibitor treatment. Treatment with MEK inhibitor (trametinib) was then assessed in two cutaneous (MEL888, MEL624) and one conjunctival (YUARGE 13-3064) melanoma cell line. Direct knockdown of EGR1 was accomplished using lentiviral vectors containing shRNA. Cell viability was measured using PrestoBlueHS Cell Viability Reagent. Total RNA and protein were assessed by qPCR and SimpleWestern. RNA-Seq demonstrated a profound reduction in EGR1 with MEK inhibitor treatment, prompting further study of melanoma cell lines. Following trametinib treatment of melanoma cells, viability was reduced in both cutaneous (MEL888 26%, P < 0.01; MEL624 27%, P < 0.001) and conjunctival (YUARGE 13-3064 33%, P < 0.01) melanoma compared with DMSO control, with confirmed EGR1 knockdown to 0.04-, 0.01-, and 0.16-fold DMSO-treated levels (all P < 0.05) in MEL888, MEL624, and YUARGE 13-3064, respectively. Targeted EGR1 knockdown using shRNA reduced viability in both cutaneous (MEL624 78%, P = 0.05) and conjunctival melanoma (YUARGE-13-3064 67%, P = 0.02). RNA-Sequencing in MEK inhibitor-treated cells identified EGR1 as a candidate effector molecule of interest. In a malignant melanoma cell population, MEK inhibition reduced viability in both cutaneous and conjunctival melanoma with a profound downstream reduction in EGR1 expression. Targeted knockdown of EGR1 reduced both cutaneous and conjunctival melanoma cell viability independent of MEK inhibition, suggesting a key role for EGR1 in melanoma pathobiology.

A patient with cytomegalovirus viremia who underwent kidney transplant developed floaters in both eyes that did not improve after painful intravitreal injections of foscarnet and ganciclovir. What would you do next?