Reppert, Marc von

The translation of AI-generated brain metastases (BM) segmentation into clinical practice relies heavily on diverse, high-quality annotated medical imaging datasets. The BraTS-METS 2023 challenge has gained momentum for testing and benchmarking algorithms using rigorously annotated internationally compiled real-world datasets. This study presents the results of the segmentation challenge and characterizes the challenging cases that impacted the performance of the winning algorithms. Untreated brain metastases on standard anatomic MRI sequences (T1, T2, FLAIR, T1PG) from eight contributed international datasets were annotated in stepwise method: published UNET algorithms, student, neuroradiologist, final approver neuroradiologist. Segmentations were ranked based on lesion-wise Dice and Hausdorff distance (HD95) scores. False positives (FP) and false negatives (FN) were rigorously penalized, receiving a score of 0 for Dice and a fixed penalty of 374 for HD95. The mean scores for the teams were calculated. Eight datasets comprising 1303 studies were annotated, with 402 studies (3076 lesions) released on Synapse as publicly available datasets to challenge competitors. Additionally, 31 studies (139 lesions) were held out for validation, and 59 studies (218 lesions) were used for testing. Segmentation accuracy was measured as rank across subjects, with the winning team achieving a LesionWise mean score of 7.9. The Dice score for the winning team was 0.65 ± 0.25. Common errors among the leading teams included false negatives for small lesions and misregistration of masks in space. The Dice scores and lesion detection rates of all algorithms diminished with decreasing tumor size, particularly for tumors smaller than 100 mm3. In conclusion, algorithms for BM segmentation require further refinement to balance high sensitivity in lesion detection with the minimization of false positives and negatives. The BraTS-METS 2023 challenge successfully curated well- annotated, diverse datasets and identified common errors, facilitating the translation of BM segmentation across varied environments and providing the tools for future development of personalized volumetric reports to patients undergoing BM treatment.

Abstract Background Although response in pediatric low-grade glioma (pLGG) includes volumetric assessment, more simplified 2D-based methods are often used in clinical trials. The study’s purpose was to compare volumetric to 2D methods. Methods An expert neuroradiologist performed solid and whole tumor (including cyst and edema) volumetric measurements on MR images using a PACS-based manual segmentation tool in 43 pLGG participants (213 total follow-up images) from the Pacific Pediatric Neuro-Oncology Consortium (PNOC-001) trial. Classification based on changes in volumetric and 2D measurements of solid tumor were compared to neuroradiologist visual response assessment using the Brain Tumor Reporting and Data System (BT-RADS) criteria for a subset of 65 images using receiver operating characteristic (ROC) analysis. Longitudinal modeling of solid tumor volume was used to predict BT-RADS classification in 54 of the 65 images. Results There was a significant difference in ROC area under the curve between 3D solid tumor volume and 2D area (0.96 vs 0.78, P = .005) and between 3D solid and 3D whole volume (0.96 vs 0.84, P = .006) when classifying BT-RADS progressive disease (PD). Thresholds of 15–25% increase in 3D solid tumor volume had an 80% sensitivity in classifying BT-RADS PD included in their 95% confidence intervals. The longitudinal model of solid volume response had a sensitivity of 82% and a positive predictive value of 67% for detecting BT-RADS PD. Conclusions Volumetric analysis of solid tumor was significantly better than 2D measurements in classifying tumor progression as determined by BT-RADS criteria and will enable more comprehensive clinical management.

Abstract Radiographic response assessment in neuro-oncology is critical in clinical practice and trials. Conventional criteria, such as the MacDonald and response assessment in neuro-oncology (RANO) criteria, rely on bidimensional (2D) measurements of a single tumor cross-section. Although RANO criteria are established for response assessment in clinical trials, there is a critical need to address the complexity of brain tumor treatment response with multiple new approaches being proposed. These include volumetric analysis of tumor compartments, structured MRI reporting systems like the Brain Tumor Reporting and Data System, and standardized approaches to advanced imaging techniques to distinguish tumor response from treatment effects. In this review, we discuss the strengths and limitations of different neuro-oncology response criteria and summarize current research findings on the role of novel response methods in neuro-oncology clinical trials and practice.

Abstract BACKGROUND Gliomas with CDKN2A mutations are known to have worse prognosis but imaging features of these gliomas are unknown. Our goal is to identify CDKN2A specific qualitative imaging biomarkers in glioblastomas using a new informatics workflow that enables rapid analysis of qualitative imaging features with Visually AcceSAble Rembrandtr Images (VASARI) for large datasets in PACS. Gliomas with CDKN2A mutations are known to have worse prognosis but imaging features of these gliomas are unknown. Our goal is to identify CDKN2A specific qualitative imaging biomarkers in glioblastomas using a new informatics workflow that enables rapid analysis of qualitative imaging features withVisually AcceSAble Rembrandtr Images (VASARI) for large datasets in PACS. MATERIAL AND METHODS Sixty nine patients undergoing GBM resection with CDKN2A status determined by whole-exome sequencing were included. GBMs on magnetic resonance images were automatically 3D segmented using deep learning algorithmsincorporated within PACS. VASARI features were assessed using FHIR forms integrated within PACS. RESULTS GBMs without CDKN2A alterations were significantly larger (64% vs. 30%, p=0.007) compared to tumors with homozygous deletion (HOMDEL) and heterozygous loss (HETLOSS). Lesions larger than 8 cm were four times more likely to have no CDKN2A alteration (OR: 4.3; 95% CI:1.5-12.1; p<0.001). The pial invasion was predictive of HOMDEL (OR: 8.1, 95% CI: 1.8-53.2; p<0.012) as tumors with pial invasion were eight times more likely to be HOMDEL, even after adjusting for deep white matter and subependymal invasion. CONCLUSION We developed a novel integrated PACS informatics platform for the assessment of GBM molecular subtypes and show that tumors with HOMDEL are more likely to have radiographic evidence of pial invasion and less likely to have deep white matter invasion or subependymal invasion. These imaging features may allow noninvasive identification of CDKN2A allele status.

Abstract BACKGROUND: Endpoints in clinical trials using novel treatments are evaluated by RANO criteria, which provide an estimate of tumor size from two-dimensional measurements along the most prominent axial slice. However, pediatric low-grade gliomas (pLGG) commonly have variegated shapes with solid and cystic components, potentially resulting in misevaluation of true tumor volume and thus, ultimately, trial outcome. OBJECTIVES: We aim to characterize treatment response through volumetric assessment of progressive/recurrent pLGGs treated with single-agent everolimus on PNOC001 clinical trial. We seek to identify clinically relevant criteria that provide added value to response assessment beyond 2D measurements. METHODS: In a cohort of 44 patients we performed 3D-segmentation of solid, cystic and whole tumor within our PACS-framework and compared results to previously carried-out central imaging review by RANO criteria which had yielded 15 PD, 27 SD, 2 PR and 0 CR. RESULTS: 8 tumors were solid only and 36 had a mixed solid-cystic appearance. When evaluating the entire tumor (i.e. solid and cystic components combined) and using the same RANO cutoff criteria, one case changed from PR to SD, one changed from SD to PR, 3 changed from SD to PD, and 7 changed from PD to SD, resulting in an overall discordance of 27% of cases. CONCLUSION: We propose that incorporation of volumetrics into response assessment provides additional and potentially more accurate information beyond RANO-based measurements. It is crucial to note that the above-reported changes represent numerical discrepancies as opposed to true-to-reality changes in clinical outcome. Determining representative thresholds for the deployment of volumetric measures in clinical trials will be critical. Future work will include data from the PNOC002 clinical trial and evaluate inter-reader agreement and reader discordance. With the availability of PACS-based 3D-tools in neuroradiology practice, well-defined volumetric criteria could be incorporated prospectively into treatment response analysis in clinical trials.