Schoots, Ivo G.

Abstract Despite growing interest in AI for pancreatic cyst management, no prior study has systematically investigated how lesion characteristics influence model behavior or provided a comprehensive explainability analysis in IPMN malignancy risk stratification. We present the first multi-center study integrating explainable AI with uncertainty quantification to evaluate how cyst type, size, and location affect deep learning performance in IPMN malignancy prediction. Our retrospective study analyzed 170 IPMNs from seven centers using a radiomics-deep learning fusion model. Cases were stratified by dysplasia grade, IPMN type, size, and location; with model interpretability assessed using SHAP, LIME, Grad-CAM, and uncertainty quantification. Overall accuracy was 67.1%, with model uncertainty lower for correct versus incorrect predictions (0.72 vs 0.78, p < 0.001). On subgroup analysis: Low-Risk lesion accuracy exceeded High-Risk (81.3% vs. 42.9%, p < 0.001), BD accuracy was inversely correlated with cyst size while MD remained stable, and body and whole-pancreas cysts stratified more accurately than tail cysts (77.8%, 76.6% vs. 47.8%). AI models face significant, previously uncharacterized performance drops when evaluating complex high-risk IPMNs. Our study shows that integrating uncertainty quantification can successfully flag unreliable predictions, enabling a selective-prediction framework where clinicians can confidently rely on AI for low-risk, low-uncertainty lesions while deferring high-uncertainty cases to expert review.

Abstract Pancreatic cancer, projected to become the second-deadliest malignancy in Western societies by 2030, requires urgent innovations in early detection and risk stratification. Intraductal papillary mucinous neoplasms (IPMNs) represent critical precursor lesions, but current clinical guidelines demonstrate suboptimal accuracy in malignancy prediction, leading to either unnecessary surgeries or missed opportunities for early intervention. In this paper, we present Cyst-X, an artificial intelligence (AI) framework that accurately predicts IPMN malignant transformation using multicenter magnetic resonance imaging (MRI) data. Unlike most previous approaches that rely on computed tomography (CT), our method capitalizes on the superior soft tissue contrast of MRI, allowing for more precise identification of subtle imaging biomarkers. We developed and validated deep learning models on 723 T1-weighted and 738 T2-weighted MRI scans from 764 patients among seven international institutions, demonstrating significantly superior performance (AUC=0.82) compared to current clinical (Kyoto) guidelines (AUC=0.75) and expert radiologists. AI-based imaging features correlate strongly with clinically recognized malignancy markers, providing potential biologically relevant insights. This approach holds promise to significantly refine clinical decision-making, reduce unnecessary surgeries, and better identify high-risk IPMN patients for timely intervention. Our approach integrates a novel pancreas segmentation network with robust classification models that identify subtle imaging biomarkers associated with malignancy risk. Importantly, we demonstrate that these models retain high performance in a privacy-preserving federated learning setting, where institutions collaboratively train AI models without exchanging patient data to address key regulatory and ethical barriers. We publicly release the Cyst-X dataset--the first large-scale, multi-center pancreatic cyst MRI collection--to accelerate research in this field. This study addresses a critical clinical need while establishing technical foundations for privacy-preserving AI in radiology that could transform pancreatic cancer management through earlier intervention and reduced unnecessary procedures. The dataset can be accessed at https://osf.io/74vfs/, and the source code for our deep learning segmentation and classification models is available at https://github.com/NUBagciLab/Cyst-X.

Abstract Distinguishing high-risk intraductal papillary mucinous neoplasms (IPMNs), pancreatic cysts requiring surgery, from low-risk lesions remains a clinical challenge, often resulting in unnecessary procedures due to limited specificity of current methods. While radiomics and deep learning (DL) have been explored for pancreatic cancer, cyst-level malignancy risk stratification of IPMNs remains untapped. We conducted a multi-institutional study (seven centers, 359 T2W MRI images) to assess the feasibility of AI for predicting IPMN dysplasia grade using cyst-level image features. We developed and compared 2D and 3D radiomics-only, deep learning (DL)-only, and radiomics-DL fusion models, using expert radiologist scoring as a baseline reference. Model performance was evaluated using held-out test data. The radiomics-DL fusion model showed the highest discriminatory ability on the test set (AUC 0.692), outperforming the radiomics-only model (AUC 0.665). Expert accuracy varied widely (37.4%-66.7%). The fusion model integrating deep learning and radiomics features from routine T2W MRI (AUC: 0.692) demonstrates potential for objective, cyst-level risk stratification of IPMNs in a multi-center cohort, outperforming both radiomics-only models and expert radiologists. While performance requires improvement for standalone clinical use, this approach offers a scalable, non-invasive method to potentially improve diagnostic accuracy and reduce unnecessary surgical interventions.