Assessment of a Deep Learning Model Trained on Permanent Pathology for the Classification of Squamous Cell Carcinoma in Mohs Frozen Sections: Lessons Learned
BACKGROUND There is a scarcity of artificial intelligence models trained on frozen pathology. One way to expand the clinical utility of models trained on permanent pathology is by applying them to frozen sections and fine-tune based on weaknesses. OBJECTIVE To qualitatively evaluate a deep learning model trained on permanent pathology to classify squamous cell carcinoma on Mohs surgery frozen sections to learn model shortcomings and inform retraining and fine-tuning. MATERIALS AND METHODS The authors trained a model for classification of tumor on 746 skin biopsy slides and tested it on 15 Mohs surgery frozen sections. The authors estimated performance metrics and compared the regions of interest generated by the model with the original H&E slides. RESULTS The model achieved an AUC-ROC of 0.985 and 0.796 for tumor classification in permanent pathology and in frozen sections, respectively. Regions of interest for frozen sections with scarce tumor areas were inaccurate, focusing on normal tissue for slides classified as false negative, or highlighting structures different from tumor (e.g., inflammation, muscle, and nerves) for slides classified as true positive. CONCLUSION Deep anatomical structures more commonly present in Mohs frozen pathology might represent data out-of-distribution for models trained on permanent pathology, potentially leading to inadequate model outputs.
Pathologist-Read vs AI-Driven Assessment of Tumor-Infiltrating Lymphocytes in Melanoma
Importance Tumor-infiltrating lymphocytes (TILs) are a provocative biomarker in melanoma, influencing diagnosis, prognosis, and immunotherapy outcomes; however, traditional pathologist-read TIL assessment on hematoxylin and eosin–stained slides is prone to interobserver variability, leading to inconsistent clinical decisions. Therefore, development of newer TIL scoring approaches that produce more reliable and consistent readouts is important. Objective To evaluate the analytical and clinical validity of a machine learning algorithm for TIL quantification in melanoma compared with traditional pathologist-read methods. Design, Setting, and Participants This multioperator, global, multi-institutional prognostic study compared TIL scoring reproducibility between traditional pathologist-read methods and an artificial intelligence (AI)-driven approach. The study was conducted using retrospective cohorts of patients with melanoma between January 2022 and June 2023 across 45 institutions, with tissue evaluated by participants from academic, clinical, and research institutions. Participants were selected to ensure diverse expertise and professional backgrounds. Main Outcomes and Measures Intraclass correlation coefficient (ICC) values were calculated for the manual and AI-assisted arms using log-transformed data. Kendall W values were calculated for Clark scores (brisk = 3, nonbrisk = 2, and sparse = 1). Reliabilities of ICC and W values were classified as moderate (0.40-0.60), good (0.61-0.80), or excellent (>0.80). AI TIL measurements were dichotomized using the 16.6 and median cutoffs. Univariable and multivariable Cox regression analyses assessed the prognostic value of TIL scores adjusted for clinicopathologic variables. Results There were 111 patients with melanoma in the independent testing cohort (median [range] age at diagnosis, 61.0 [25.0-87.0] years; 56 [50.5%] male) who contributed melanoma whole tissue sections. A total of 98 participants evaluated TILs on 60 hematoxylin and eosin–stained melanoma tissue sections. All 40 participants in the manual arm were pathologists, while the AI-assisted arm included 11 pathologists and 47 nonpathologists (scientists). The AI algorithm demonstrated superior reproducibility, with ICCs higher than 0.90 for all machine learning TIL variables, significantly outperforming manual assessments (ICC, 0.61 for AI-derived stromal TILs vs Kendall W , 0.44 for manual Clark TIL scoring). AI-based TIL scores showed prognostic associations with patient outcomes (n = 111) using the median cutoff approach with a hazard ratio (HR) of 0.45 (95% CI, 0.26-0.80; P = .005), and using the cutoff of 16.6, with an HR of 0.56 (95% CI, 0.32-0.98; P = .04). Conclusions and Relevance In this prognostic study of TIL quantification in melanoma, the AI algorithm demonstrated superior reproducibility and prognostic associations compared with traditional methods. Although the retrospective nature of the cohorts limits demonstration of clinical utility, the publicly available dataset and open-source AI tool offer a foundation for future validation and integration into melanoma management.
OnabotulinumtoxinA
Injections for Atypical Site Hyperhidrosis
A phase III trial evaluating addition of adjuvant chemotherapy to ovarian function suppression + endocrine therapy in premenopausal women with pN0-1, HR+/HER2- breast cancer (BC) and oncotype recurrence score (RS) ≤25 (OFSET): NRG-BR009.
TPS615 Background: The TAILORx and RxPONDER trials demonstrated that RS identifies many postmenopausal pts with node-neg and node-pos BC and RS ≤25, who do not benefit from addition of ACT to endocrine therapy (ET). Both trials also showed that certain subsets of premenopausal pts (node-neg/high clinical risk/RS 16-20, node-neg/RS 21-25, and node-pos/RS ≤25) benefited from adding ACT to ET. Most premenopausal pts in these trials did not receive ovarian function suppression (OFS) as part of their ET regimen. Given the observed benefit from OFS in high-risk premenopausal pts with HR+/HER2- BC in the SOFT/TEXT trials, many questioned whether all or part of the observed ACT benefit in the TAILORx/RxPONDER trials may have been the result of chemotherapy-induced OFS. To address this question, we developed OFSET, a phase III, multicenter clinical trial comparing OFS+ET v ACT+OFS+ET. Methods: We hypothesize that addition of ACT to OFS+ET is superior to OFS+ET in improving invasive breast cancer-free survival (IBCFS) among premenopausal, early-stage BC pts with HR+/HER2- tumors, and a 21-gene RS between 16-25 (for pN0 pts) and 0-25 (for pN1 pts). Secondary objectives include invasive disease-free survival, overall survival, distant recurrence-free interval, breast cancer-free interval, and health-related quality of life (HRQOL). Pts must be node-neg with RS 16-20 (plus high clinical risk), or RS 21-25, or have 1-3 positive nodes with RS ≤25. Stratification is by nodal status/RS status (pN0 RS 16-25 v pN1 RS 0-15 and pN1 RS 16-25), intent to receive CDK4/6 inhibitor (yes; no), and age (18-39 v ≥40). Pts are randomized after surgery to either OFS+ET or ACT+OFS+ET v ET is an aromatase inhibitor (AI). Choice is per investigator discretion; tamoxifen is allowed if AI is not tolerated or if OFS is incomplete. Radiotherapy will be administered per investigator discretion per protocol guidelines. The HRQOL sub-study will assess differences in severe menopausal symptoms, measured by the FACT ESS-19 score between arms, as well as increased pain severity (PROMIS). Blood and tumor specimens will be collected for future research. Accrual of 3,960 pts is anticipated to be completed in 7 yrs, 7 mos. Per NSABP B-28 and RxPONDER data, 5yr IBCFS of pN1 pts on the ACT+OFS+ET arm is estimated at 92.3%. Based on TAILORx data, 5yr IBCFS of pN0 pts on the ACT arm is ~95%. Assuming 56% of pts to be pN0 and 44% pN1, and a 0.5% annual loss-to-follow-up rate, the definitive analyses to detect a hazard ratio: 0.75 with ACT+OFS+ET v OFS+ET, with one-sided α of 0.025 and 80% power, will require 380 IBCFS events, expected to occur~11 yrs after study initiation. OFSETwas activated Aug 2023. As of 1-6-25, accrual is: 188/3,960. NCT #: NCT05879926. Support: U10CA180868, -80822, UG1CA189867, U24CA196067. Clinical trial information: NCT05879926 .
Improving Preparatory Materials for the Pediatric Infectious Diseases Initial Certifying Exam: A Targeted Needs Assessment
Abstract We conducted a national survey of current pediatric infectious diseases (PID) fellows and PID fellowship graduates from the past 10 years to assess satisfaction with existing PID initial certifying exam preparatory materials. Satisfaction with existing resources was low. The most desired new resource was additional board-style questions.
Clinical Validity of Repeated Circulating Tumor Cell Enumeration as an Early Treatment Monitoring Tool for Metastatic Breast Cancer in the PREDICT Global Pooled Analysis
Abstract Purpose: The aim of PREDICT was to confirm clinical validity and the potential for clinical utility of serial circulating tumor cell (CTC) enumeration in patients with metastatic breast cancer, focusing on its prognostic value in different breast cancer subtypes and clinical settings. Experimental Design: In total, 4,436 individual patient-level data with CTC results from both baseline and one follow-up (CellSearch; Menarini Silicon Biosystems) were analyzed to evaluate the association between CTC detection and overall survival (OS) in the full patient cohort and separately for tumor and treatment types. Results: Using the cutoff ≥1 CTC for CTC positivity, 913 (20.6%) patients had 0 CTCs at both time points (neg/neg) and 325 (7.3%) and 1,189 (26.8%) patients converted from CTC negative to CTC positive (neg/pos) or vice versa (pos/neg), whereas 2,009 (45.3%) patients had at least one CTC at both time points (pos/pos). The median OS for the neg/neg, neg/pos, pos/neg, and pos/pos group was 45.6, 26.1, 32.3, and 17.3 months, respectively (P < 0.0001, global log-rank test). CTC responders (pos/neg) showed a lower risk of death compared with CTC nonresponders (pos/pos; HR, 0.48; 95% confidence interval, 0.44–0.53). Similar results were obtained in subgroup analyses according to hormone receptor and HER2 subtype, treatment type, and with a ≥5 CTC cutoff for CTC positivity. Conclusions: Follow-up CTC assessments strongly predict OS independently from tumor subtype and treatment. New randomized trials to define the clinical utility of CTC monitoring for risk stratification and as an early response marker in metastatic breast cancer are urgently needed.
Analyzing Public Interest and Information in Superficial Radiation Therapy for Keratinocyte Carcinomas: Google Trends 2004–2024
Background: As machine learning becomes increasingly utilized in orthopaedic clinical research, the application of machine learning methodology to cohort data from the Multicenter ACL Revision Study (MARS) presents a valuable opportunity to translate data into patient-specific insights. Purpose: To apply novel machine learning methodology to MARS cohort data to determine a predictive model of revision anterior cruciate ligament reconstruction (rACLR) graft failure and features most predictive of failure. Study Design: Cohort study; Level of evidence, 3. Methods: The authors prospectively recruited patients undergoing rACLR from the MARS cohort and obtained preoperative radiographs, surgeon-reported intraoperative findings, and 2- and 6-year follow-up data on patient-reported outcomes, additional surgeries, and graft failure. Machine learning models including logistic regression (LR), XGBoost, gradient boosting (GB), random forest (RF), and a validated ensemble algorithm (AutoPrognosis) were built to predict graft failure by 6 years postoperatively. Validated performance metrics and feature importance measures were used to evaluate model performance. Results: The cohort included 960 patients who completed 6-year follow-up, with 5.7% (n = 55) experiencing graft failure. AutoPrognosis demonstrated the highest discriminative power (model area under the receiver operating characteristic curve: AutoPrognosis, 0.703; RF, 0.618; GB, 0.660; XGBoost, 0.680; LR, 0.592), with well-calibrated scores (model Brier score: AutoPrognosis, 0.053; RF, 0.054; GB, 0.057; XGBoost, 0.058; LR, 0.111). The most important features for AutoPrognosis model performance were prior compromised femoral and tibial tunnels (placement and size) and allograft graft type used in current rACLR. Conclusion: The present study demonstrated the ability of the novel AutoPrognosis machine learning model to best predict the risk of graft failure in patients undergoing rACLR at 6 years postoperatively with moderate predictive ability. Femoral and tibial tunnel size and position in prior ACLR and allograft use in current rACLR were all risk factors for rACLR failure in the context of the AutoPrognosis model. This study describes a unique model that can be externally validated with larger data sets and contribute toward the creation of a robust rACLR bedside risk calculator in future studies. Registration: NCT00625885 (ClinicalTrials.gov identifier).