Velichko, Yury

Abstract Despite growing interest in AI for pancreatic cyst management, no prior study has systematically investigated how lesion characteristics influence model behavior or provided a comprehensive explainability analysis in IPMN malignancy risk stratification. We present the first multi-center study integrating explainable AI with uncertainty quantification to evaluate how cyst type, size, and location affect deep learning performance in IPMN malignancy prediction. Our retrospective study analyzed 170 IPMNs from seven centers using a radiomics-deep learning fusion model. Cases were stratified by dysplasia grade, IPMN type, size, and location; with model interpretability assessed using SHAP, LIME, Grad-CAM, and uncertainty quantification. Overall accuracy was 67.1%, with model uncertainty lower for correct versus incorrect predictions (0.72 vs 0.78, p < 0.001). On subgroup analysis: Low-Risk lesion accuracy exceeded High-Risk (81.3% vs. 42.9%, p < 0.001), BD accuracy was inversely correlated with cyst size while MD remained stable, and body and whole-pancreas cysts stratified more accurately than tail cysts (77.8%, 76.6% vs. 47.8%). AI models face significant, previously uncharacterized performance drops when evaluating complex high-risk IPMNs. Our study shows that integrating uncertainty quantification can successfully flag unreliable predictions, enabling a selective-prediction framework where clinicians can confidently rely on AI for low-risk, low-uncertainty lesions while deferring high-uncertainty cases to expert review.

Abstract Pancreatic cancer, projected to become the second-deadliest malignancy in Western societies by 2030, requires urgent innovations in early detection and risk stratification. Intraductal papillary mucinous neoplasms (IPMNs) represent critical precursor lesions, but current clinical guidelines demonstrate suboptimal accuracy in malignancy prediction, leading to either unnecessary surgeries or missed opportunities for early intervention. In this paper, we present Cyst-X, an artificial intelligence (AI) framework that accurately predicts IPMN malignant transformation using multicenter magnetic resonance imaging (MRI) data. Unlike most previous approaches that rely on computed tomography (CT), our method capitalizes on the superior soft tissue contrast of MRI, allowing for more precise identification of subtle imaging biomarkers. We developed and validated deep learning models on 723 T1-weighted and 738 T2-weighted MRI scans from 764 patients among seven international institutions, demonstrating significantly superior performance (AUC=0.82) compared to current clinical (Kyoto) guidelines (AUC=0.75) and expert radiologists. AI-based imaging features correlate strongly with clinically recognized malignancy markers, providing potential biologically relevant insights. This approach holds promise to significantly refine clinical decision-making, reduce unnecessary surgeries, and better identify high-risk IPMN patients for timely intervention. Our approach integrates a novel pancreas segmentation network with robust classification models that identify subtle imaging biomarkers associated with malignancy risk. Importantly, we demonstrate that these models retain high performance in a privacy-preserving federated learning setting, where institutions collaboratively train AI models without exchanging patient data to address key regulatory and ethical barriers. We publicly release the Cyst-X dataset--the first large-scale, multi-center pancreatic cyst MRI collection--to accelerate research in this field. This study addresses a critical clinical need while establishing technical foundations for privacy-preserving AI in radiology that could transform pancreatic cancer management through earlier intervention and reduced unnecessary procedures. The dataset can be accessed at https://osf.io/74vfs/, and the source code for our deep learning segmentation and classification models is available at https://github.com/NUBagciLab/Cyst-X.

The translation of AI-generated brain metastases (BM) segmentation into clinical practice relies heavily on diverse, high-quality annotated medical imaging datasets. The BraTS-METS 2023 challenge has gained momentum for testing and benchmarking algorithms using rigorously annotated internationally compiled real-world datasets. This study presents the results of the segmentation challenge and characterizes the challenging cases that impacted the performance of the winning algorithms. Untreated brain metastases on standard anatomic MRI sequences (T1, T2, FLAIR, T1PG) from eight contributed international datasets were annotated in stepwise method: published UNET algorithms, student, neuroradiologist, final approver neuroradiologist. Segmentations were ranked based on lesion-wise Dice and Hausdorff distance (HD95) scores. False positives (FP) and false negatives (FN) were rigorously penalized, receiving a score of 0 for Dice and a fixed penalty of 374 for HD95. The mean scores for the teams were calculated. Eight datasets comprising 1303 studies were annotated, with 402 studies (3076 lesions) released on Synapse as publicly available datasets to challenge competitors. Additionally, 31 studies (139 lesions) were held out for validation, and 59 studies (218 lesions) were used for testing. Segmentation accuracy was measured as rank across subjects, with the winning team achieving a LesionWise mean score of 7.9. The Dice score for the winning team was 0.65 ± 0.25. Common errors among the leading teams included false negatives for small lesions and misregistration of masks in space. The Dice scores and lesion detection rates of all algorithms diminished with decreasing tumor size, particularly for tumors smaller than 100 mm3. In conclusion, algorithms for BM segmentation require further refinement to balance high sensitivity in lesion detection with the minimization of false positives and negatives. The BraTS-METS 2023 challenge successfully curated well- annotated, diverse datasets and identified common errors, facilitating the translation of BM segmentation across varied environments and providing the tools for future development of personalized volumetric reports to patients undergoing BM treatment.

Abstract Distinguishing high-risk intraductal papillary mucinous neoplasms (IPMNs), pancreatic cysts requiring surgery, from low-risk lesions remains a clinical challenge, often resulting in unnecessary procedures due to limited specificity of current methods. While radiomics and deep learning (DL) have been explored for pancreatic cancer, cyst-level malignancy risk stratification of IPMNs remains untapped. We conducted a multi-institutional study (seven centers, 359 T2W MRI images) to assess the feasibility of AI for predicting IPMN dysplasia grade using cyst-level image features. We developed and compared 2D and 3D radiomics-only, deep learning (DL)-only, and radiomics-DL fusion models, using expert radiologist scoring as a baseline reference. Model performance was evaluated using held-out test data. The radiomics-DL fusion model showed the highest discriminatory ability on the test set (AUC 0.692), outperforming the radiomics-only model (AUC 0.665). Expert accuracy varied widely (37.4%-66.7%). The fusion model integrating deep learning and radiomics features from routine T2W MRI (AUC: 0.692) demonstrates potential for objective, cyst-level risk stratification of IPMNs in a multi-center cohort, outperforming both radiomics-only models and expert radiologists. While performance requires improvement for standalone clinical use, this approach offers a scalable, non-invasive method to potentially improve diagnostic accuracy and reduce unnecessary surgical interventions.

We describe the design and results from the BraTS 2023 Intracranial Meningioma Segmentation Challenge. The BraTS Meningioma Challenge differed from prior BraTS Glioma challenges in that it focused on meningiomas, which are typically benign extra-axial tumors with diverse radiologic and anatomical presentation and a propensity for multiplicity. Nine participating teams each developed deep-learning automated segmentation models using image data from the largest multi-institutional systematically expert annotated multilabel multi-sequence meningioma MRI dataset to date, which included 1000 training set cases, 141 validation set cases, and 283 hidden test set cases. Each case included T2, FLAIR, T1, and T1Gd brain MRI sequences with associated tumor compartment labels delineating enhancing tumor, non-enhancing tumor, and surrounding non-enhancing FLAIR hyperintensity. Participant automated segmentation models were evaluated and ranked based on a scoring system evaluating lesion-wise metrics including dice similarity coefficient (DSC) and 95% Hausdorff Distance. The top ranked team had a lesion-wise median dice similarity coefficient (DSC) of 0.976, 0.976, and 0.964 for enhancing tumor, tumor core, and whole tumor, respectively and a corresponding average DSC of 0.899, 0.904, and 0.871, respectively. These results serve as state-of-the-art benchmarks for future pre-operative meningioma automated segmentation algorithms. Additionally, we found that 1286 of 1424 cases (90.3%) had at least 1 compartment voxel abutting the edge of the skull-stripped image edge, which requires further investigation into optimal pre-processing face anonymization steps.

Pancreatic cystic lesions (PCLs) represent a spectrum of non-neoplasms and neoplasms with varying malignant potential, posing significant challenges in diagnosis and management. While some PCLs are precursors to pancreatic cancer, others remain benign, necessitating accurate differentiation for optimal patient care. Conventional approaches to PCL management rely heavily on radiographic imaging, and endoscopic ultrasound (EUS) guided fine-needle aspiration (FNA), coupled with clinical and biochemical data. However, the observer-dependent nature of image interpretation and the complex morphology of PCLs can lead to diagnostic uncertainty and variability in patient management strategies. This review critically evaluates current PCL diagnosis and surveillance practices, showing features of the different lesions and highlighting the potential limitations of conventional methods. We then explore the potential of artificial intelligence (AI) to transform PCL management. AI-driven strategies, including deep learning algorithms for automated pancreas and lesion segmentation, and radiomics for analyzing heterogeneity, can improve diagnostic accuracy and risk stratification. These advanced techniques can provide more objective and reproducible assessments, aiding clinicians in decision-making regarding follow-up intervals and surgical interventions. Early results suggest that AI-driven methods can significantly improve patient outcomes by enabling earlier detection of high-risk lesions and reducing unnecessary procedures for benign cysts. Finally, this review emphasizes that AI-driven approaches could potentially reshape the landscape of PCL management, ultimately leading to improved pancreatic cancer prevention.