ImportanceThere exists substantial heterogeneity in outcomes within T stages for patients with cutaneous squamous cell carcinoma (cSCC).ObjectiveTo determine whether a customized generative pretrained transformer model, trained on a comprehensive dataset with more than 1 trillion parameters and equipped with relevant focused context and retrieval augmented generation (RAG), could excel in aggregating and interpreting vast quantities of data to develop a novel class-based risk stratification system that outperforms the current standards.Design, Setting, and ParticipantsTo build the RAG knowledge base, a systematic review of the literature was conducted that addressed risk factors for poor outcomes in cSCC. Using the RAG-enabled generative pretrained transformer (GPT) model, we developed a novel class-based risk stratification system that assigned point values for risk factors, culminating in a GPT-based prognostication system called the artificial intelligence–derived risk score (AIRIS). The system’s performance was validated on a combined prospective and retrospective cohort of 2379 primary cSCC tumors (1996-2023) with at least 36 months of follow-up, against Brigham and Women’s Hospital (BWH) and American Joint Committee on Cancer Staging Manual, eighth edition (AJCC8) systems in stratifying risk for locoregional recurrence (LR), nodal metastasis (NM), distant metastasis (DM), and disease-specific death (DSD).Main Outcomes and MeasuresPerformance metrics evaluated included distinctiveness, homogeneity, and monotonicity, as defined by the AJCC8, as well as sensitivity, specificity, positive predictive value, negative predictive value, accuracy, the area under the receiver operating characteristic curve, and concordance.ResultsThe median age at diagnosis was 73 (IQR, 64-81) years, with 38.5% female patients and 61.5% male patients. The AIRIS prognostication system demonstrated superior sensitivity across all outcomes (LR, 49.1%; NM, 73.7%; DM, 82.5%; and DSD, 72.2%) and the highest area under the receiver operating characteristic curve values (LR, 0.69; NM, 0.81; DM, 0.85; and DSD, 0.80), indicating significantly enhanced discriminative capability compared with the BWH and AJCC8 systems. While all systems were comparably distinctive, the AIRIS prognostication system consistently demonstrated the lowest proportion of tumors exhibiting poor outcomes in low-risk categories, suggesting its improved homogeneity and monotonicity.Conclusions and RelevanceThe results of this diagnostic study suggest that the AIRIS system outperforms the existing BWH and AJCC8 prognostication systems, potentially providing a more effective tool for predicting poor outcomes in cSCC. This study illustrates the potential of large language models in refining prognostic tools, offering implications for treating patients with cancer.
Artificial Intelligence Models Are Limited in Predicting Clinical Outcomes Following Hip Arthroscopy
Background: Hip arthroscopy has seen a significant surge in utilization, but complications remain, and optimal functional outcomes are not guaranteed. Artificial intelligence (AI) has emerged as an effective supportive decision-making tool for surgeons. The purpose of this systematic review was to characterize the outcomes, performance, and validity (generalizability) of AI-based prediction models for hip arthroscopy in current literature. Methods: Two reviewers independently completed structured searches using PubMed/MEDLINE and Embase databases on August 10, 2022. The search query used the terms as follows: (artificial intelligence OR machine learning OR deep learning) AND (hip arthroscopy). Studies that investigated AI-based risk prediction models in hip arthroscopy were included. The primary outcomes of interest were the variable(s) predicted by the models, best model performance achieved (primarily based on area under the curve, but also accuracy, etc), and whether the model(s) had been externally validated (generalizable). Results: Seventy-seven studies were identified from the primary search. Thirteen studies were included in the final analysis. Six studies (n = 6,568) applied AI for predicting the achievement of minimal clinically important difference for various patient-reported outcome measures such as the visual analog scale and the International Hip Outcome Tool 12-Item Questionnaire, with area under a receiver-operating characteristic curve (AUC) values ranging from 0.572 to 0.94. Three studies used AI for predicting repeat hip surgery with AUC values between 0.67 and 0.848. Four studies focused on predicting other risks, such as prolonged postoperative opioid use, with AUC values ranging from 0.71 to 0.76. None of the 13 studies assessed the generalizability of their models through external validation. Conclusion: AI is being investigated for predicting clinical outcomes after hip arthroscopy. However, the performance of AI models varies widely, with AUC values ranging from 0.572 to 0.94. Critically, none of the models have undergone external validation, limiting their clinical applicability. Further research is needed to improve model performance and ensure generalizability before these tools can be reliably integrated into patient care. Level of Evidence: Level IV . See Instructions for Authors for a complete description of levels of evidence.
Revision total elbow arthroplasty is associated with a high rate of 30-day complications: A descriptive analysis of a national database
Introduction Revision total elbow arthroplasty (TEA) is indicated for component loosening, periprosthetic joint infection, and fractures. Previous investigations into revision TEA complications have small sample sizes and limited exploration of acute complications. This study aims to characterize the 30-day complications and associated demographics of patients undergoing revision TEA using a large national database. Methods The 2015–2020 American College of Surgeons National Surgical Quality Improvement Program database was used to identify all revision TEA patients. Results The analysis included 158 patients (average age 62.6 years). The overall complication rate was 13.9% ( n = 22). The most common 30-day complications were organ/space surgical site infection (3.8%, n = 6), unplanned readmission (3.2%, n = 5), intraoperative or postoperative transfusion (3.2%, n = 5), and unplanned reoperation (1.9%, n = 3). Patients with a history of dyspnea or steroid/immunosuppressant use for a chronic condition had significantly higher rates of bleeding requiring transfusion ( p = .029 and p = .021, respectively). Additionally, patients aged 80 years or older had a significantly higher rate of unplanned readmission ( p = .032). Conclusion Revision TEA has a 13.9% rate of complications within 30-days of surgery, with most involving surgical site infection, unplanned readmission, and blood transfusion. Level of Evidence IV.