Citations

The translation of AI-generated brain metastases (BM) segmentation into clinical practice relies heavily on diverse, high-quality annotated medical imaging datasets. The BraTS-METS 2023 challenge has gained momentum for testing and benchmarking algorithms using rigorously annotated internationally compiled real-world datasets. This study presents the results of the segmentation challenge and characterizes the challenging cases that impacted the performance of the winning algorithms. Untreated brain metastases on standard anatomic MRI sequences (T1, T2, FLAIR, T1PG) from eight contributed international datasets were annotated in stepwise method: published UNET algorithms, student, neuroradiologist, final approver neuroradiologist. Segmentations were ranked based on lesion-wise Dice and Hausdorff distance (HD95) scores. False positives (FP) and false negatives (FN) were rigorously penalized, receiving a score of 0 for Dice and a fixed penalty of 374 for HD95. The mean scores for the teams were calculated. Eight datasets comprising 1303 studies were annotated, with 402 studies (3076 lesions) released on Synapse as publicly available datasets to challenge competitors. Additionally, 31 studies (139 lesions) were held out for validation, and 59 studies (218 lesions) were used for testing. Segmentation accuracy was measured as rank across subjects, with the winning team achieving a LesionWise mean score of 7.9. The Dice score for the winning team was 0.65 ± 0.25. Common errors among the leading teams included false negatives for small lesions and misregistration of masks in space. The Dice scores and lesion detection rates of all algorithms diminished with decreasing tumor size, particularly for tumors smaller than 100 mm3. In conclusion, algorithms for BM segmentation require further refinement to balance high sensitivity in lesion detection with the minimization of false positives and negatives. The BraTS-METS 2023 challenge successfully curated well- annotated, diverse datasets and identified common errors, facilitating the translation of BM segmentation across varied environments and providing the tools for future development of personalized volumetric reports to patients undergoing BM treatment.

Abstract Brain tumor diagnostics have significantly evolved with the use of positron emission tomography (PET) and advanced magnetic resonance imaging (MRI) techniques. In addition to anatomical MRI, these modalities may provide valuable information for several clinical applications such as differential diagnosis, delineation of tumor extent, prognostication, differentiation between tumor relapse and treatment-related changes, and the evaluation of response to anticancer therapy. In particular, joint recommendations of the Response Assessment in Neuro-Oncology (RANO) Group, the European Association of Neuro-oncology, and major European and American Nuclear Medicine societies highlighted that the additional clinical value of radiolabeled amino acids compared to anatomical MRI alone is outstanding and that its widespread clinical use should be supported. For advanced MRI and its steadily increasing use in clinical practice, the Standardization Subcommittee of the Jumpstarting Brain Tumor Drug Development Coalition provided more recently an updated acquisition protocol for the widely used dynamic susceptibility contrast perfusion MRI. Besides amino acid PET and perfusion MRI, other PET tracers and advanced MRI techniques (e.g. MR spectroscopy) are of considerable clinical interest and are increasingly integrated into everyday clinical practice. Nevertheless, these modalities have shortcomings which should be considered in clinical routine. This comprehensive review provides an overview of potential challenges, limitations, and pitfalls associated with PET imaging and advanced MRI techniques in patients with gliomas or brain metastases. Despite these issues, PET imaging and advanced MRI techniques continue to play an indispensable role in brain tumor management. Acknowledging and mitigating these challenges through interdisciplinary collaboration, standardized protocols, and continuous innovation will further enhance the utility of these modalities in guiding optimal patient care.