Citations

Large language models pose unique cybersecurity risks in health care, including vulnerability to malicious attacks and data breaches. This article equips professionals with strategies to mitigate these threats for safe use.

We describe the design and results from the BraTS 2023 Intracranial Meningioma Segmentation Challenge. The BraTS Meningioma Challenge differed from prior BraTS Glioma challenges in that it focused on meningiomas, which are typically benign extra-axial tumors with diverse radiologic and anatomical presentation and a propensity for multiplicity. Nine participating teams each developed deep-learning automated segmentation models using image data from the largest multi-institutional systematically expert annotated multilabel multi-sequence meningioma MRI dataset to date, which included 1000 training set cases, 141 validation set cases, and 283 hidden test set cases. Each case included T2, FLAIR, T1, and T1Gd brain MRI sequences with associated tumor compartment labels delineating enhancing tumor, non-enhancing tumor, and surrounding non-enhancing FLAIR hyperintensity. Participant automated segmentation models were evaluated and ranked based on a scoring system evaluating lesion-wise metrics including dice similarity coefficient (DSC) and 95% Hausdorff Distance. The top ranked team had a lesion-wise median dice similarity coefficient (DSC) of 0.976, 0.976, and 0.964 for enhancing tumor, tumor core, and whole tumor, respectively and a corresponding average DSC of 0.899, 0.904, and 0.871, respectively. These results serve as state-of-the-art benchmarks for future pre-operative meningioma automated segmentation algorithms. Additionally, we found that 1286 of 1424 cases (90.3%) had at least 1 compartment voxel abutting the edge of the skull-stripped image edge, which requires further investigation into optimal pre-processing face anonymization steps.

Abstract Clinical management of IDH wildtype glioblastoma (GBM) and tumefactive multiple sclerosis (tMS) is drastically different. GBM requires maximal safe resection followed by chemoradiation, while tMS outcome is worsened by surgery and radiotherapy. Noninvasive methods are needed to help with accurate diagnosis of tumor and non-tumor etiologies. To develop an MRI-based classification model, tMS subjects diagnosed prior to January 1, 2020, were matched to tMS by age at diagnosis, sex, index MRI date, and 2D/3D acquisition. Inclusion criteria included one cm minimal lesion size and pre-operative post-contrast T1 and T2 images available for analysis. A 3D-DenseNet121 was used to develop a classification model using prespecified parameters: 650 epochs, batch size 16, learning rate 10-3, cross-entropy loss, and AdamW optimizer. The stopping rule was defined as three sequential differences in epoch cross-entropy loss <0.02. Models were developed using both T1gd and T2, as well as from only T1gd and only T2. Training included 220 subjects (110 GBM, 110 tMS). A 2-stage validation design was used, which included both retrospective and prospective cohorts. Stage 1 consisted of 272 retrospective GBM (diagnosed prior to January 1, 2020). Stage 2 consisted of 69 and 34 prospective (diagnosed after January 1, 2020) GBM and tMS, respectively. External validation on the 272 retrospective GBM demonstrated accuracy of 91%, 84%, and 78% for T1gd+T2, T1gd only, and T2 only, respectively. External validation on the 69 prospective GBM demonstrated an accuracy of 87%, 64%, and 67% for T1gd+T2, T1gd only, and T2 only, respectively. The 34 prospective tMS demonstrated accuracy of 76%, 76%, and 82% for T1gd+T2, T1gd only, and T2 only, respectively. This shows the feasibility of deep learning to aid in differential diagnosis of brain lesions. Future work entails the integration of germline variants into the classification model, including variants associated with the risk of glioma or MS.

Abstract Glioblastoma, the most common malignant primary adult brain tumor, poses significant diagnostic and treatment challenges due to its heterogeneous molecular and micro-environmental profiles. To this end, we organize the BraTS-Path challenge to provide a public benchmarking environment and a comprehensive dataset to develop and validate AI models for identifying distinct histopathologic glioblastoma sub-regions in H&E-stained digitized tissue sections. We identified 188 multi-institutional diagnostic slides of glioblastoma (IDH-wt, Gr.4) cases, from the TCGA-GBM and TCGA-LGG data collections, following their reclassification according to the 2021 WHO classification criteria. Sub-regions were selected according to distinctive morphology of histopathologic features and included aggressive tumor biology and areas consistent with potential treatment effect. Selected sub-region annotations included cellular tumor, geographic necrosis, cortical infiltration, pseudopalisading necrosis, microvascular proliferation, white matter penetration, regions dense with macrophages, leptomeningeal infiltration, and presence of lymphocytes. We obtained 107,340 patches of size 512x512 from the 9 sub-regions. A global network of board-certified expert neuropathologists defined and followed a systematic annotation protocol based on clinical definitions and only delineated sub-regions with high confidence, thus ensuring high-quality standardized data. Each tissue section was assigned to an annotator-approver pair, with the annotator delineating sub-regions and the approver ensuring the consistency of the annotations. By crowdsourcing annotations, the BraTS-Path challenge harnesses the collective expertise of clinical neuropathologists and fosters a collaborative environment to advance the neuro-oncology field. The anticipated developed algorithms are expected to integrate state-of-the-art computational methods, achieving high accuracy in identifying diverse histopathologic features and advancing clinical decision-making processes. The BraTS-Path challenge aims to bridge the gap between research and clinical practice by promoting the development of AI-driven tools for precise tumor characterization. This collaborative effort can significantly enhance our understanding of glioblastoma, improve diagnostic accuracy, and inform treatment strategies, thereby contributing to better patient outcomes.

Thyroid Ultrasound (US) is the primary method to evaluate thyroid nodules. Deep learning (DL) has been playing a significant role in evaluating thyroid cancer. We propose a DL-based pipeline to detect and classify thyroid nodules into benign or malignant groups relying on two views of US imaging. Transverse and longitudinal US images of thyroid nodules from 983 patients were collected retrospectively. Eighty-one cases were held out as a testing set, and the rest of the data were used in five-fold cross-validation (CV). Two You Look Only Once (YOLO) v5 models were trained to detect nodules and classify them. For each view, five models were developed during the CV, which was ensembled by using non-max suppression (NMS) to boost their collective generalizability. An extreme gradient boosting (XGBoost) model was trained on the outputs of the ensembled models for both views to yield a final prediction of malignancy for each nodule. The test set was evaluated by an expert radiologist using the American College of Radiology Thyroid Imaging Reporting and Data System (ACR-TIRADS). The ensemble models for each view achieved a mAP0.5 of 0.797 (transverse) and 0.716 (longitudinal). The whole pipeline reached an AUROC of 0.84 (CI 95%: 0.75–0.91) with sensitivity and specificity of 84% and 63%, respectively, while the ACR-TIRADS evaluation of the same set had a sensitivity of 76% and specificity of 34% (p-value = 0.003). Our proposed work demonstrated the potential possibility of a deep learning model to achieve diagnostic performance for thyroid nodule evaluation.

Abstract INTRODUCTION Prior to 2021, (classic) glioblastoma (GBM) required absence of IDH mutation and histologic features of hypercellularity, nuclear atypia, microvascular proliferation (MVP), and necrosis. Absence of histologic features can be a result of undersampling, with molecular, radiologic, and clinical features consistent with GBM. Accordingly, WHO 2021 defined molecular glioblastoma as diffuse glioma IDHwt, H3wt, with one or more of MVP, necrosis, TERT promoter mutation, EGFR gene amplification (EGFRamp), and/or +7/−10. We hypothesized that there is clinical and radiographic heterogeneity among tumors defined as molecular GBM. METHODS We identified 121 patients that met the criteria for molecular GBM. 121 Classic GBM, defined as IDHwt with hypercellularity, MVP or necrosis, were matched to molecular GBM cases by age, sex, and diagnosis date. All cases were reviewed for relevant histologic features and molecular features. Examined clinical variables included: first symptom, time from first symptom to date of pathological diagnosis, date of first MRI, tumor location, radiographic features of enhancement, diffusion or mass effect, time to progression and overall survival. Clinical, radiologic, and molecular features were compared between classic and molecular GBM. RESULTS Currently,160 cases have been reviewed. Preliminary results show that there is a longer time from first symptom to diagnosis for molecular GBM. Molecular GBM is significantly more likely to be discovered coincidentally, and without enhancement or radiographic necrosis. Classic GBM is significantly more likely to present with focal neurologic deficit as first symptom, regional mass effect on index imaging and have monosomy 10. CONCLUSION While pathologic undersampling accounts for a significant proportion of molecular GBM, our data suggest that there are significant clinical, radiographic, and outcome differences between classical and molecular GBM. Final analysis of the entire cohort will help better define this clinical spectrum.

Abstract There have been several attempts to predict the MGMT promoter methylation status of gliomas using deep learning (DL), with mixed results. These studies did not account for IDH mutation status and did not utilize a uniform methylation assay, introducing potential confounders in the experimental design. We assessed the performance of DL applied to brain MRI to predict the MGMT promoter methylation status of IDH-wildtype gliomas tested with a standardized assay. We included 539 IDH-wildtype gliomas tested with real-time methylation-specific PCR from 2017-2022; 205 (38%) were MGMT promoter methylated. The assay targets 8 downstream MGMT CpG sites using ACTB as control; methylation status is determined based on the difference of PCR crossing-point values: methylated if difference < 5, unmethylated if difference > 7, indeterminate otherwise. We used post-contrast T1 and T2 MRIs as inputs for our models trained using stratified 5-fold cross-validation, 400 epochs, batch size of 16, a learning rate scheduler starting at 10-3, weighted binary cross-entropy loss, and AdamW optimizer. We repeated the experiments using two 3D DL architectures (DenseNet121 and EfficientNetB0) and two image preprocessing pipelines: the BraTS protocol and one that uses padding instead of registration to an MRI atlas, keeping constant other experimental variables. For Densenet121, the best cross-validation AUROCC and F1-score (median, median absolute deviation) were 0.67 (0.06), 0.59 (0.02) using the BraTS protocol, and 0.67 (0.06), 0.58 (0.01) using padding. For EfficientNetB0, were 0.67 (0.02), 0.66 (0.01) using the BraTS protocol and 0.67 (0.01), 0.68 (0.01) using padding. Our findings suggest that it is unlikely that DL models trained on brain MRI can predict the MGMT promoter methylation of IDH-wildtype gliomas. Importantly, our study is the first to focus on an IDH-wildtype adult diffuse glioma cohort tested with a single, standardized MGMT methylation assay, eliminating the variability introduced by different assays and IDH status.

Abstract Missing MRI sequences are common in radiology due to differences in protocols, time constraints, and image artifacts. Missing sequences are a nuisance for subsequent algorithms, such as automated segmentation algorithms requiring multiple MRI sequences (e.g., HD-GLIO, which requires T2, T1, post-contrast T1 (T1c), and FLAIR). Accurate tumor segmentation is a fundamental step in extracting radiomics analysis to use, for example, to predict the IDH status of glioma or their overall survival. We validated a conditional (pix2pix) and super-resolution GAN (SOUP-GAN) for imputing MRI sequences on 285 adult glioma with complete MRI sequences available. We simulated missing T1 sequences and subsequently imputed them from T1c using pix2pix and from sagittal T1 using SOUP-GAN. Using HD-GLIO, we obtained the true segmentations from the complete MRI sequences. HD-GLIO was also used after replacing the original T1 sequence with the one imputed with pix2pix and SOUP-GAN. Thus, there were three sets of segmentations for each subject. We compared T2 and T1c radiomics features extracted with Pyradiomics using segmentations obtained with complete data with features extracted from segmentation obtained with the imputed T1 sequences using intraclass correlation coefficient (ICC) and Bland-Altman (BA) analysis. Median (interquartile range) ICC for shape features extracted from T2 and T1c were 0.82(0.76-0.92) using pix2pix and 0.89(0.86-0.94) using SOUP-GAN. Median ICC for first-order-statistics features were 0.90(0.83-0.93) for T2 and 0.90(0.88-0.92) for T1c using pix2pix, and 0.61(0.22-0.82) for T2 and 0.42(0.34-0.57) for T1c using SOUP-GAN. Median ICC for texture features were 0.86(0.82-0.87) for T2 and 0.87(0.79-0.90) for T1c using pix2pix, and 0.69(0.47-0.81) for T2 and 0.76(0.65-0.83) for T1c using SOUP-GAN. We show that T2 and T1c shape features (e.g., volumetric analysis) can be adequately extracted from segmentations obtained with an algorithm requiring multiple MRI sequences using T1 sequences imputed with GANs; however, the effect of imputation differed for first-order-statistics and texture features.