Back to Authors

Archibald, David

Mayo Clinic

Mayo Clinic

Citations 3

Comparative Assessment of Otolaryngology Knowledge Among Large Language Models
Merlino, Dante J. , Saieed, George, Abel, Kathryn M. Van , Archibald, David, Ator, Gregory A., Carlson, Matthew L. , Brufau, Santiago R, Van Abel, Kathryn M , Carlson, Matthew L , Romero‐Brufau, Santiago , Saieed, George , Price, Daniel L. , Archibald, David J.

The Laryngoscope | September 21, 2024 | Volume: 135 | Issue: 2 | Pages: 629-634

10.1002/lary.31781 Get It

ObjectiveThe purpose of this study was to evaluate the performance of advanced large language models from OpenAI (GPT‐3.5 and GPT‐4), Google (PaLM2 and MedPaLM), and an open source model from Meta (Llama3:70b) in answering clinical test multiple choice questions in the field of otolaryngology—head and neck surgery.MethodsA dataset of 4566 otolaryngology questions was used; each model was provided a standardized prompt followed by a question. One hundred questions that were answered incorrectly by all models were further interrogated to gain insight into the causes of incorrect answers.ResultsGPT4 was the most accurate, correctly answering 3520 of 4566 questions (77.1%). MedPaLM correctly answered 3223 of 4566 (70.6%) questions, while llama3:70b, GPT3.5, and PaLM2 were correct on 3052 of 4566 (66.8%), 2672 of 4566 (58.5%), and 2583 of 4566 (56.5%) questions. Three hundred and sixty‐nine questions were answered incorrectly by all models. Prompts to provide reasoning improved accuracy in all models: GPT4 changed from incorrect to correct answer 31% of the time, while GPT3.5, Llama3, PaLM2, and MedPaLM corrected their responses 25%, 18%, 19%, and 17% of the time, respectively.ConclusionLarge language models vary in their understanding of otolaryngology‐specific clinical knowledge. OpenAI's GPT4 has a strong understanding of core concepts as well as detailed information in the field of otolaryngology. Its baseline understanding in this field makes it well‐suited to serve in roles related to head and neck surgery education provided that the appropriate precautions are taken and potential limitations are understood.Level of EvidenceNA Laryngoscope, 135:629–634, 2025
Type 1 First Branchial Cleft Anomaly: Duplication of the External Auditory Canal
Carlson, Matthew L. , Archibald, David, Cofer, Shelagh A. , Archibald, David J.

Ear, Nose & Throat Journal | January 10, 2019 | Volume: 90 | Issue: 7 | Pages: 302-303

10.1177/014556131109000705 Get It

Kikuchi-Fujimoto Disease in a 30-Year-Old Caucasian Female
Archibald, David, Carlson, Matthew L. , Gustafson, Ray O.

International Journal of Otolaryngology | December 21, 2009 | Volume: 2009 | Issue: No issue available | Pages: 1-4

10.1155/2009/901537 Get It

Kikuchi-Fujimoto disease is a rare, self-limited, histiocytic, necrotizing lymphadenitis first described in Japan in 1972. Necrosis of lymph node tissue is caused by apoptosis and may be virally induced. It commonly presents with cervical lymphadenitis and fever. Despite its low incidence, Kikuchi-Fujimoto disease should be considered in patients with persistent lymphadenopathy. Originally thought to occur only in young Asian women, it is now recognized in other geographic regions. We report a 30-year-old white woman with Kikuchi-Fujimoto disease. We discuss the clinical features, differential diagnosis, radiography, pathology, and outcome.