Back to Authors

Alhankawi, Ahmad R.

0000-0002-0311-1588

Mayo Clinic

Mayo Clinic in Arizona

Citations 3

ChatGPT, Claude Sonnet, and Grok Display Similarly Low Rates of Accuracy in Identifying Image‐Based Orthopaedic Sports Pathologies
Alhankawi, Ahmad R. , Holle, Alejandro M, Moore, M. Lane, Chhabra, Anikar , Moore, M. Lane , Holle, Alejandro M. , Alhankawi, Ahmad R. , Holle, Alejandro , Moore, M Lane , Tarabichi, Saad , Chhabra, Anikar , Braithwaite, Collin

Arthroscopy, Sports Medicine, and Rehabilitation | April 30, 2026 | Volume: 8 | Issue: 2 | Pages: No page available

10.1002/ars2.70009 Get It

Purpose To assess the ability of artificial intelligence (AI) to identify common sports‐related pathologies using radiologic imaging and to compare ChatGPT 4.0 with 2 competitors, Grok 2 and Claude 3.5 Sonnet. Methods ChatGPT 4.0, Grok 2, and Claude 3.5 Sonnet were used. Five common orthopaedic sports pathologies were chosen: anterior cruciate ligament tears, posterior cruciate ligament tears, meniscal tears, chondral pathologies, and rotator cuff tears. Fifty images representing each pathology were collected from a radiologic imaging database when possible, which included radiographic images, computed tomography, and magnetic resonance imaging. Normal images were collected that corresponded to each diagnostic category. Receiver operator characteristic curves and area under the curve values were calculated to assess the accuracy of each AI platform. Results ChatGPT 4.0, Grok 2, and Claude 3.5 Sonnet accurately identified the pathology in 23.6%, 15.7%, and 17.1% of diseased images, respectively. ChatGPT and Grok were most accurate at identifying meniscus pathologies (ChatGPT: 48%, Grok: 42%), whereas Claude Sonnet was most accurate at identifying anterior cruciate ligament pathologies (30%). The area under the curve for ChatGPT, Grok, and Claude Sonnet was 0.21, 0.16, and 0.15, respectively (ChatGPT 4.0 vs Grok 2, P = .30; ChatGPT 4.0 vs Claude 3.5 Sonnet, P = .24; Grok 2 vs Claude 3.5 Sonnet, P > .99). There were no differences in performance between the 3 platforms overall or within any of the diagnostic categories. Conclusions ChatGPT 4.0, Grok 2, and Claude 3.5 Sonnet correctly identified the pathology in less than 25% of images of common sports‐related pathologies and showed area under the curve values well below 0.5, indicating poor accuracy. Based on these findings, we do not recommend the current use of these generative AI models for image‐based diagnosis in orthopaedics. Clinical Relevance As the use of AI becomes more popular within the general public, it becomes increasingly important to make aware the capabilities and limitations of popular AI platforms in regard to their current image‐based diagnostic capabilities.
Comparing the Efficacy Between ChatGPT 5, Grok 3, and Claude 4.5 Sonnet in Analyzing Orthopedic Trauma-Related Imaging
Holmstrom, Joshua Aaron , Braithwaite, Collin , Alhankawi, Ahmad R. , Moore, M. Lane, Patel, Karan A. , Miller, Brian H., Moore, M. Lane , Alhankawi, Ahmad R. , Holmstrom, Joshua A , Braithwaite, Collin L , Moore, M Lane , Patel, Karan

Journal of Orthopaedic Trauma | March 5, 2026 | Volume: 40 | Issue: 7 | Pages: 360-365

10.1097/bot.0000000000003166 Get It

OBJECTIVES: To evaluate and compare the ability of three popular open-source artificial intelligence platforms to diagnose common trauma-related fractures using radiologic imaging. METHODS: Design: Retrospective diagnostic performance comparison study. Setting: Publicly accessible online radiologic imaging databases. Patient Selection Criteria: Five common orthopedic trauma fractures were assessed: ankle, tibial plateau, intertrochanteric, femoral neck, and humerus. Radiographs and computed tomography (CT) images were collected. Images were randomly selected from confirmed diagnoses on Radiopaedia.org. Outcome Measures and Comparisons: ChatGPT 5, Grok 3, and Claude 4.5 Sonnet were queried with each image. Diagnostic accuracy, sensitivity, specificity, positive and negative predictive values, and performance by modality (X-ray vs. CT) were assessed. The reference standard was the expert-verified diagnosis provided by Radiopaedia.org, limited to cases labeled with a “diagnosis certain” tag. RESULTS: Each model was provided with 30 radiographs and 20 CT images whenever possible. ChatGPT 5, Grok 3, and Claude 4.5 Sonnet accurately diagnosed diseased images in 26.8%, 18.8%, and 22.4% of cases, respectively. By fracture type, ChatGPT 5 demonstrated the highest correct classification rates for ankle (10%), femoral neck (38%), humerus (40%), and tibial plateau (44%) fractures. Grok 3 demonstrated the highest correct classification rate for intertrochanteric fractures (6%). Overall sensitivities were 0.267, 0.187, and 0.223 for ChatGPT 5, Grok 3, and Claude 4.5 Sonnet, respectively. ChatGPT 5 and Grok 3 outperformed Claude 4.5 Sonnet (both P < 0.001). No modality-based performance differences were observed for any model. CONCLUSIONS: Among the publicly available large language models evaluated for radiologic interpretation of orthopedic trauma imaging, ChatGPT 5 demonstrated the highest overall diagnostic accuracy, followed by Claude 4.5 Sonnet and Grok 3. Despite relative variation between the models, overall diagnostic accuracy for fracture detection was low across all platforms (<27%). In their baseline forms, these publicly accessible large language models are not recommended for radiologic imaging interpretation. LEVEL OF EVIDENCE: Diagnostic Level III. See Instructions for Authors for a complete description of levels of evidence.
Testosterone Replacement Therapy Is Associated with a Higher Rate of Revision and Malunion/Nonunion After Distal Radius ORIF
Alhankawi, Ahmad, Lopez, Jasmine K. M. , Renfree, Sean P. , Lin, E., Alhankawi, Ahmad R. , Alhankawi, Ahmad R. , Braithwaite, Collin , Holle, Alejandro M. , Koschmeder, Katelyn , Renfree, Kevin J.

Journal of Wrist Surgery | January 15, 2026 | Volume: No volume available | Issue: No issue available | Pages: No page available

10.1055/a-2781-2579 Get It

Abstract Despite the reported benefits of testosterone replacement therapy (TRT), prior studies have shown that TRT is correlated with increased incidence of adverse outcomes after orthopedic procedures. There is a paucity of literature assessing the outcomes of patients on preoperative TRT undergoing distal radius open reduction and internal fixation (DR-ORIF). Our purpose was to evaluate rates of surgical and medical complications in patients on TRT undergoing DR-ORIF with a matched control cohort. The PearlDiver database was queried for patients who used TRT within 3 months prior to the index procedure. Patients were matched 1:4 with nonuser controls using propensity score matching. Matching was conducted based on age, Elixhauser Comorbidity Index, hypogonadism, osteoporosis, and other comorbidities. Complications were assessed at 90 days and 2 years. Statistical analyses were conducted using chi-square tests. Odds ratios (OR) with 95% confidence intervals (CI) were calculated for each complication. Statistical significance was determined at a p-value of < 0.05. The matched group included 657 TRT users and 2,236 controls. There were significant differences in depression (control: 40.6% vs. TRT: 45.7%, p = 0.02) and rates of hypogonadism (control: 74.1% vs. TRT: 77.9%, p = 0.05) between the groups. No other statistically significant demographic or characteristic differences were noted. TRT use was not associated with increased surgical or medical complication rates at 90 days postoperatively. At 2 years, TRT use was associated with a greater incidence of revision (OR: 2.80, 95% CI: 1.34–5.85) and nonunion (OR: 2.76, 95% CI: 1.59–4.81). There were no other associations noted at 2 years. Preoperative TRT was associated with an increased risk of revision surgery and nonunion at 2 years postoperatively. No other significant associations in the risk of major or minor complications were observed. Level III