Abstract Glioblastoma (GBM), isocitrate dehydrogenase wild-type (IDHwt) and central nervous system diffuse large B-cell lymphoma (CNS-DLBCL) are aggressive brain tumors with overlapping MRI features, yet distinct treatment approaches. Noninvasive tools are needed to aid in differential diagnosis. Deep learning on T1 postcontrast and T2-weighted MRI sequences were used to differentiate GBM and CNS-DLBCL. A three-stage temporal study design was utilized. Model development was performed on 146 patients with CNS-DLBCL and 146 age-matched, sex-matched, and MRI year–matched patients with GBM diagnosed at Mayo Clinic between 1998 and 2019. Models were tested on independent temporal test cohorts. Initial testing included 240 independent GBM diagnosed at Mayo Clinic between 1998 and 2019. The prospective test cohort included 37 patients with CNS-DLBCL and 256 patients with GBM diagnosed at Mayo Clinic after January 1, 2020, and 36 patients with CNS-DLBCL diagnosed at an external institution. Of the patients diagnosed at Mayo Clinic, 47% had MRIs generated from non-Mayo institutions. Two different model approaches were compared: (i) ensemble approach using area under the receiver operating characteristic curve (AUC) and cross-validation for model selection and (ii) loss approach minimizing cross-entropy loss and cross-validation to evaluate prediction performance. The AUCs on the prospective test cohort were 0.84 [95% confidence interval (CI), 0.78–0.90] and 0.83 (95% CI, 0.77–0.88) for the ensemble and loss approaches, respectively. Stability of ensemble prediction improved with the increasing number of models. Stratified AUC analysis demonstrated consistent performance across sex and age. We utilized a robust temporal study design and applied 2 different analytic approaches to develop a classification model. The findings confirm the feasibility of using MRI-based deep learning models to differentiate GBM from CNS-DLBCL. Significance: GBM, IDHwt and CNS-DLBCL are aggressive brain tumors with overlapping MRI features, yet distinct treatment approaches. Noninvasive tools are needed to aid in differential diagnosis. We developed MRI-based deep learning models to differentiate GBM, IDHwt from CNS-DLBCL using a rigorous three-stage temporal design that included prospective validation. The model AUC on a prospective cohort was 0.84.
Agentic AI in Radiology: Evolution from Large Language Models to Future Clinical Integration
Agentic artificial intelligence marks a shift from large language models to autonomous, goal-driven clinical assistants. The framework presented in this report outlines implementation in radiology workflows and addresses cybersecurity, bias, and accountability challenges.
Uncover This Tech Term: Agentic Artificial Intelligence in Radiology
Abstract Background The CCDC26 germline variant rs55705857 is causal for development of IDH mutant (IDHmut) adult glioma. However, ~60% of IDHmut patients do not carry the rs55705857 risk allele. We aimed to identify variants associated with developing IDHmut glioma among patients that do not have the rs55705857 risk allele and to further understand development of IDHwt glioma. Methods We used three datasets that included 1216 IDHmut and 1442 IDHwt glioma patients and a case–case design to perform genome-wide association (GWAS) analyses comparing IDHmut versus IDHwt glioma. Analyses were performed overall and stratified by rs55705857 genotype and sex. Multivariable logistic regression and regression trees were used to develop models to predict IDH status using germline variants, age, and contrast enhancement on MRI. Results Three regions were identified comparing IDHmut versus IDHwt: rs55705857 (meta P-value [P] = 1.35 × 10−43), PHLDB1 (rs7125115, P = 3.46 × 10−17), and D2HGDH (rs71430382, P = 2.43 × 10−12). When analyzing only patients that do not have the rs55705857 risk allele, PHLDB1 (rs7125115, P = 1.73 × 10−13) and D2HGDH (rs71430382, P = 8.86 × 10−10) were identified. Among patients who have the rs55705857 risk allele, four variants between ROBO1 and ROBO2 (rs4680975, P = 4.65 × 10−7) increased the likelihood of having an IDHwt tumor. Tumor expression of ROBO1 was associated with rs4680975 genotype in IDHwt patients that have the rs55705857 risk allele (P = 0.034). Multivariable logistic analysis demonstrated that rs55705857, rs71430382 (D2HGDH), and age predicted IDH mutation status. Conclusions To understand the development of adult glioma, we demonstrate that D2HGDH and PHLDB1 should be prioritized for functional studies in IDHmut tumors. The ROBO1 region warrants further investigation in IDHwt tumors.
The Brain Tumor Segmentation (BraTS-METS) Challenge 2023: Brain Metastasis Segmentation on Pre-treatment MRI
The translation of AI-generated brain metastases (BM) segmentation into clinical practice relies heavily on diverse, high-quality annotated medical imaging datasets. The BraTS-METS 2023 challenge has gained momentum for testing and benchmarking algorithms using rigorously annotated internationally compiled real-world datasets. This study presents the results of the segmentation challenge and characterizes the challenging cases that impacted the performance of the winning algorithms. Untreated brain metastases on standard anatomic MRI sequences (T1, T2, FLAIR, T1PG) from eight contributed international datasets were annotated in stepwise method: published UNET algorithms, student, neuroradiologist, final approver neuroradiologist. Segmentations were ranked based on lesion-wise Dice and Hausdorff distance (HD95) scores. False positives (FP) and false negatives (FN) were rigorously penalized, receiving a score of 0 for Dice and a fixed penalty of 374 for HD95. The mean scores for the teams were calculated. Eight datasets comprising 1303 studies were annotated, with 402 studies (3076 lesions) released on Synapse as publicly available datasets to challenge competitors. Additionally, 31 studies (139 lesions) were held out for validation, and 59 studies (218 lesions) were used for testing. Segmentation accuracy was measured as rank across subjects, with the winning team achieving a LesionWise mean score of 7.9. The Dice score for the winning team was 0.65 ± 0.25. Common errors among the leading teams included false negatives for small lesions and misregistration of masks in space. The Dice scores and lesion detection rates of all algorithms diminished with decreasing tumor size, particularly for tumors smaller than 100 mm3. In conclusion, algorithms for BM segmentation require further refinement to balance high sensitivity in lesion detection with the minimization of false positives and negatives. The BraTS-METS 2023 challenge successfully curated well- annotated, diverse datasets and identified common errors, facilitating the translation of BM segmentation across varied environments and providing the tools for future development of personalized volumetric reports to patients undergoing BM treatment.
Cybersecurity Threats and Mitigation Strategies for Large Language Models in Health Care
Large language models pose unique cybersecurity risks in health care, including vulnerability to malicious attacks and data breaches. This article equips professionals with strategies to mitigate these threats for safe use.
TMIC-60. BRATS-PATH: ASSESSING HETEROGENEOUS HISTOPATHOLOGIC REGIONS IN GLIOBLASTOMA
Abstract Glioblastoma, the most common malignant primary adult brain tumor, poses significant diagnostic and treatment challenges due to its heterogeneous molecular and micro-environmental profiles. To this end, we organize the BraTS-Path challenge to provide a public benchmarking environment and a comprehensive dataset to develop and validate AI models for identifying distinct histopathologic glioblastoma sub-regions in H&E-stained digitized tissue sections. We identified 188 multi-institutional diagnostic slides of glioblastoma (IDH-wt, Gr.4) cases, from the TCGA-GBM and TCGA-LGG data collections, following their reclassification according to the 2021 WHO classification criteria. Sub-regions were selected according to distinctive morphology of histopathologic features and included aggressive tumor biology and areas consistent with potential treatment effect. Selected sub-region annotations included cellular tumor, geographic necrosis, cortical infiltration, pseudopalisading necrosis, microvascular proliferation, white matter penetration, regions dense with macrophages, leptomeningeal infiltration, and presence of lymphocytes. We obtained 107,340 patches of size 512x512 from the 9 sub-regions. A global network of board-certified expert neuropathologists defined and followed a systematic annotation protocol based on clinical definitions and only delineated sub-regions with high confidence, thus ensuring high-quality standardized data. Each tissue section was assigned to an annotator-approver pair, with the annotator delineating sub-regions and the approver ensuring the consistency of the annotations. By crowdsourcing annotations, the BraTS-Path challenge harnesses the collective expertise of clinical neuropathologists and fosters a collaborative environment to advance the neuro-oncology field. The anticipated developed algorithms are expected to integrate state-of-the-art computational methods, achieving high accuracy in identifying diverse histopathologic features and advancing clinical decision-making processes. The BraTS-Path challenge aims to bridge the gap between research and clinical practice by promoting the development of AI-driven tools for precise tumor characterization. This collaborative effort can significantly enhance our understanding of glioblastoma, improve diagnostic accuracy, and inform treatment strategies, thereby contributing to better patient outcomes.
A Multi-View Deep Learning Model for Thyroid Nodules Detection and Characterization in Ultrasound Imaging
Thyroid Ultrasound (US) is the primary method to evaluate thyroid nodules. Deep learning (DL) has been playing a significant role in evaluating thyroid cancer. We propose a DL-based pipeline to detect and classify thyroid nodules into benign or malignant groups relying on two views of US imaging. Transverse and longitudinal US images of thyroid nodules from 983 patients were collected retrospectively. Eighty-one cases were held out as a testing set, and the rest of the data were used in five-fold cross-validation (CV). Two You Look Only Once (YOLO) v5 models were trained to detect nodules and classify them. For each view, five models were developed during the CV, which was ensembled by using non-max suppression (NMS) to boost their collective generalizability. An extreme gradient boosting (XGBoost) model was trained on the outputs of the ensembled models for both views to yield a final prediction of malignancy for each nodule. The test set was evaluated by an expert radiologist using the American College of Radiology Thyroid Imaging Reporting and Data System (ACR-TIRADS). The ensemble models for each view achieved a mAP0.5 of 0.797 (transverse) and 0.716 (longitudinal). The whole pipeline reached an AUROC of 0.84 (CI 95%: 0.75–0.91) with sensitivity and specificity of 84% and 63%, respectively, while the ACR-TIRADS evaluation of the same set had a sensitivity of 76% and specificity of 34% (p-value = 0.003). Our proposed work demonstrated the potential possibility of a deep learning model to achieve diagnostic performance for thyroid nodule evaluation.