Jang, Inyeop

Background: Tumor immune microenvironment (TIME) organization fundamentally shapes cancer progression and immunotherapy outcomes. Traditional 2D spatial molecular approaches inadequately capture the complex three-dimensional architecture and cellular interactions within TIME. We developed an AI-driven platform integrating multiple spatial molecular datasets, enabling comprehensive 3D visualization for therapeutic discovery and patient selection. Methods: Our platform combines holotomography imaging, providing 3D refractive index maps, with diverse spatial molecular data: in situ molecular imaging, spatial proteomics, multiplex immunohistochemistry, and spatial transcriptomics. AI algorithms align datasets within a unified 3D coordinate system, while Poisson implicit surface reconstruction generates subcellular-resolution models. Platform validation used clinical samples from immunotherapy-treated patients. Results: The platform integrated multimodal spatial data into high-resolution 3D TIME representations, revealing novel relationships between protein expression, transcriptional patterns, and cellular architecture. 3D surface protein analysis with subcellular morphology identified patients with target protein expression outside tight junctions, indicating higher risk for adverse effects from antibody-drug conjugates and cellular therapies. This insight, unavailable through 2D analysis, enabled precise patient selection. Conclusions: This platform provides detailed subcellular-resolution TIME architecture analysis, offering actionable insights for therapeutic targeting, biomarker discovery, and patient selection. AI-driven 3D spatial multimodal TIME analysis advances precision medicine across multiple therapeutic approaches, including immunotherapy, targeted therapy, and drug delivery optimization. AI Disclosure: Original abstract content was written by the authors. Claude was used for editorial assistance and formatting without altering the scientific content or context of the work. Citation Format: Inyeop Jang, Yoonho Choi, Minji Kim, Jeonghwan Park, Jiyeon Sung, Byungsoo Ann, Clemenceau R. Jean, TaeHyun Hwang. AI-enabled 3D multimodal integration platform reveals subcellular architecture of tumor immune microenvironment for therapeutic target and biomarker discovery and patient selection [abstract]. In: Proceedings of the American Association for Cancer Research Annual Meeting 2025; Part 1 (Regular Abstracts); 2025 Apr 25-30; Chicago, IL. Philadelphia (PA): AACR; Cancer Res 2025;85(8_Suppl_1):Abstract nr 3648.

Abstract Background: Understanding the spatiotemporal dynamics of the tumor microenvironment (TME) during treatment is crucial for improving outcomes in pancreatic ductal adenocarcinoma (PDAC). This study presents a pre-planned spatiotemporal analysis from a phase II trial evaluating neoadjuvant mFOLFIRINOX in resectable PDAC, aimed at elucidating treatment resistance mechanisms and identifying predictive biomarkers. Methods: This multi-institutional, single-arm phase II trial enrolled treatment-naïve patients with histologically confirmed resectable PDAC (NCT05066802) who underwent six cycles of neoadjuvant mFOLFIRINOX followed by surgery. The primary endpoint was the R0 resection rate. Matched pre-treatment tumor biopsies and post-treatment surgical specimens were analyzed from selected responders (R) and non-responders (NR) using high-resolution spatial transcriptomics (10X Genomics Visium). This approach enabled comprehensive mapping of TME evolution and treatment-induced changes. Results: Between May 2020 and February 2022, 27 patients were enrolled. Of these, 24 patients underwent surgery after neoadjuvant treatment (resection rate: 88.9%), and 23 achieved R0 resection (85.2%), meeting the primary endpoint. However, 20 resected patients (83.3%) recurred. Spatiotemporal analysis was performed on matched samples from four R and four NR. In pre-treatment samples from NR group, clusters dominated by fibroblasts (enriched for ECM, EMT, and CAF phenotypes) and B cell subtypes were distinct compared to R group, which exhibited elevated antibody responses and robust T cell and macrophage activity. NR samples showed increased IgM expression but lacked corresponding Fc receptors, suggesting limited immune effector function. Post-treatment NR surgical specimens displayed elevated expression of MUC5AC and CEACAM6 in malignant ductal cells, alongside genes promoting tumor growth. Neoadjuvant mFOLFIRINOX increased fibroblast, while reducing immune cell components. NR tumors formed distinct "resistance niches" after chemotherapy, marked by ECM production, CAF activation, and RTK signaling. Conversely, R tumors showed enhanced epithelial organization with increased type-I hemidesmosome complexes facilitating epithelial adhesion to the basement membrane. Conclusion: Three months of neoadjuvant mFOLFIRINOX was feasible and tolerable for resectable PDAC but associated with high recurrence rate, emphasizing the need for better patient selection. Spatiotemporal analysis revealed critical differences in TME dynamics according to treatment response, including the emergence of resistance niches and distinct pre-treatment spatial signatures. These findings support the integration of spatial biology into future pancreatic cancer trials to improve stratification and therapy. Citation Format: Choong-kun Lee, Changjin Hong, Ho Kyoung Hwang, Min Hwan Kim, Jean Rene Clemenceau, Seock-Jin Chung, Isabel Barnfather, Sumanth Reddy Nakkireddy, Jeong Hwan Park, Ji-Youn Sung, Minji Kim, Yooho Choi, Inyeop Jang, Sunho Park, Sung Hyun Kim, Chang Moo Kang, Hye Jin Choi, Tae Hyun Hwang. Spatiotemporal evolution of the tumor microenvironment predicts treatment response in phase II trial of neoadjuvant chemotherapy for resectable pancreatic cancer [abstract]. In: Proceedings of the American Association for Cancer Research Annual Meeting 2025; Part 1 (Regular Abstracts); 2025 Apr 25-30; Chicago, IL. Philadelphia (PA): AACR; Cancer Res 2025;85(8_Suppl_1):Abstract nr 771.

Abstract Traditional cancer research methodologies predominantly focus on 2D tumor modeling, including spatial profiling and AI-driven analysis at the 2D level. To advance beyond these limitations, we implemented Holotomography (HT), a 3D, label-free optical imaging method. This technique, leveraging refractive index contrasts, allows for enhanced visualization of tumor tissues, organoids, and cells in three dimensions. Using serial H&E sections and unstained slides, we created detailed 3D tumor models in gastric cancer, providing insights into tumor, immune, and stromal composition, as well as cell-cell interactions and extracellular matrix characteristics. AI algorithms further enhanced our 3D tumor modeling, offering novel perspectives on the initiation and progression of tumor, immune, and stromal components at the subcellular level. Analyzing gastric tumors treated with immune checkpoint inhibitors before, during, and after treatment revealed dynamic changes in spatial composition over time, offering unique insights into the evolution of the 3D tumor ecosystem. Additionally, by integrating spatial transcriptomic and in situ molecular imaging data, we developed a novel Multimodal 3D Tumor Model. This model not only uncovers subcellular-level molecular characteristics but also elucidates cellular interactions during treatment, suggesting potential biomarkers and therapeutic approaches. Lastly, by constructing 3D cellular interaction networks incorporating true 3D interactions, we provided an in-depth view of cellular communication within the tumor microenvironment. This pioneering approach, representing the first Multimodal 3D Tumor Model at the subcellular level, offers novel insights into gastric cancer's spatial evolution, potentially revolutionizing our understanding and treatment of gastric cancer. Citation Format: Yoon Ho Choi, Minji Kim, Katya Redekop, Inyeop Jang, Jean R. Clemenceau, Isabel Barnfather, Sumanth Reddy Nakkireddy, Changjin Hong, Sunho Park, Ji-Youn Sung, Jeong Hwan Park, Shitara Kohei, Aoki Yu, Sung Hak Lee, Sam Wang, Jaeho Cheong, Tae Hyun Hwang. AI-driven multimodal 3D tumor modeling with spatial molecular insights for predicting ICI response in gastric cancer [abstract]. In: Proceedings of the American Association for Cancer Research Annual Meeting 2024; Part 1 (Regular Abstracts); 2024 Apr 5-10; San Diego, CA. Philadelphia (PA): AACR; Cancer Res 2024;84(6_Suppl):Abstract nr 7400.

Abstract Although the majority of HPV (+) oropharyngeal squamous cell carcinoma (OPSCC) patients exhibit a favorable prognosis, approximately 20% face recurrent or metastatic disease, posing management challenges. Therefore, the identification of robust prognostic markers for risk stratification is essential. Our study focused on the comprehensive characterization of intratumor heterogeneity within the tumor immune microenvironment (TME) in both primary tumors and metastatic lymph nodes. Utilizing computational approaches, we integrated hematoxylin and eosin (H&E) and 11 adjacent immunohistochemistry (IHC)-stained slides to investigate the cellular composition and functional characteristics across different regions within the TME. Based on these detailed immune characteristics, we classified patients into specific immune subtypes. Our integrative TME analysis indicated that patients with high tumor-infiltrating lymphocytes (TIL), increased CD8 + levels, and reduced CD163 + cell counts within their primary tumors were likely to have a more favorable progression-free survival outcome. The integration of H&E and IHC data enhances the functional characterization of immune phenotypes of the TME with biological interpretability and improves patient stratification in HPV(+) OPSCC.

Abstract Introduction As total neoadjuvant therapy for locally advanced rectal cancer (LARC) emerged, the possibility of skipping radiotherapy for poorly responsive patients arose. Machine-learning algorithms have focused on the radiopathologic features of tumor segmentation in order to predict responsiveness to radiotherapy. However, in addition to the tumor itself, there are several factors related to responsiveness, such as vasculature affecting hypoxia or MRI-detected extramural vascular invasion status. We aimed to predict poor responders using pretreatment rectal MRI images without segmentation and to identify which factors mainly contribute to the prediction algorithm. Methods Between Jan 1, 2000, and Dec 30, 2020, 689 consecutive patients were retrospectively included in two hospitals. Poor responders were defined by tumor regression grades (TRG) 2 and 3 that were determined through surgical resection. The ResNet-50 model was trained to predict poor responders from pretreatment rectal MRIs (T2-weighted axial, sagittal, and coronal images). We adopted a tenfold cross-validation for training and testing the model and used Gradient-weighted Class Activation Mapping (Grad-CAM) to highlight the important regions in the MRI scans that help predict poor responders. Results The number in each group of TRG was 108 (15.7%), 250 (36.3%), 265 (38.5%), and 66 (9.6%) for TRG0, TRG1, TRG2, and TRG3, respectively. There were 618 patients in the training cohort and 71 patients in the validation cohort. In the training and validation cohort, the accuracy for the prediction of poor responders was 85.6% (area under the curve (AUC) 0.856 [95% CI 0.761-0.950]) and 70.2% (AUC 0.703 [0.682-0.724]), although without segmentation. Our prediction model achieved a sensitivity of 0.724 (95% CI 0.700-0.748), a specificity of 0.684 (0.658-0.710), a positive predictive value of 0.697 (0.656-0.737), and a negative predictive value of 0.708 (0.666-0.751) in the validation cohort. Grad-CAM showed that the most important part of the accurately predicted images to contribute to the prediction was not the tumor (7/355, 1.9%) but the pelvic vasculature (353/355, 99.4%), including iliac vessels, femoral vessels, and presacral plexus, and followed by the mesorectum (38/355, 10.7%). Conclusion The pelvic vasculature contributes more to predicting poor responders to radiotherapy than the tumor itself. Therefore, when creating a prediction model for responsiveness to radiotherapy in LARC, this should be considered. Citation Format: Rumi Shin, Byunho Jo, Inyeop Jang, Cheong-Il Shin, Jin Sun Choi, Seung-Yong Jeong, Seung Chul Heo, Ji Won Park, Min Jung Kim, Tae Hyun Hwang. Why only focus on the tumor?: The crucial role of the extra-tumor environment to predict poor responders for locally advanced rectal cancer. [abstract]. In: Proceedings of the American Association for Cancer Research Annual Meeting 2023; Part 1 (Regular and Invited Abstracts); 2023 Apr 14-19; Orlando, FL. Philadelphia (PA): AACR; Cancer Res 2023;83(7_Suppl):Abstract nr 5374.

Abstract Background: Recent studies support that high levels of tumor-infiltrating lymphocytes (TILs) were associated with better prognosis in HPV(+) oropharyngeal squamous cell carcinoma (OPSCC). While these studies provide a potential role for TILs as a prognostic biomarker, the analyses were relied on manual quantification performed by pathologists, resulting in inter-observer variability. Deep Learning (DL)-based whole slide hematoxylin and eosin (H&E) image analyses may overcome these challenges. However, this analysis only provides the presence of cell types without consideration for the functional roles of each cell within the tumor immune microenvironment (TME). In this work, we develop a computational pipeline to integrate paired H&E and immunohistochemistry (IHC) images to functionally characterize TILs and investigate their prognostic utility. Methods: We analyzed 88 patients: 42 stage I, 39 stage II, and 7 stage III. Our data contain both H&E and IHCs examining FoxP3, CD3, PD-L1, CD20, etc. on serial sections of the tissue. In-house DL-based H&E analysis used to identify TILs, tumors, and stroma in each tumor, then performed registration between adjacent H&E and IHC images from the same tissue. The patients were then classified into three basic immune phenotypes: immune inflamed (IN; high TILs in the tumor region), immune excluded (EX; TILs are mostly localized in stroma), and immune desert (ID; few/no TILs) based on TIL enrichment in the TME. To functionally characterize TILs, we quantified protein expression from the adjacent IHCs. For example, we further classified each patient into different subtypes based on enriched protein expression (e.g., FoxP3 high IN, FoxP3 low IN). We used the Kaplan-Meier method and multivariate Cox analysis to evaluate the prognostic value of different subtypes enriched with different proteins to predict disease-free survival (DFS). Results: The IN group with 43 patients was significantly associated with good prognosis. Interestingly, further stratification of the IN subgroup based on Foxp3 quantification on TIL regions (i.e., high FoxP3 IN and low FoxP3 IN) showed that high protein expression of FoxP3 in TILs in the IN subgroup is significantly associated with a better prognosis compared to other immune subgroups (HR, 0.16; p-value, 0.003). Multivariate analysis, including other clinical covariates showed that the immune subtypes associated with high FoxP3 are independently associated with DFS. These results demonstrate that DL-based integrative IHC and H&E image analysis could be used to identify subgroups with distinct clinical outcomes. Furthermore, our results reveal unknown roles for Foxp3 expression in the TILs in HPV(+) OPSCC as a prognostic biomarker, a finding which should be evaluated in a larger cohort. Citation Format: Sumanth Reddy Nakkireddy, Inyeop Jang, Minji Kim, Linda X. Yin, Michael Rivera, Joaquin J. Garcia MD, Kathleen R. Bartemes, David M. Routman, Eric J. Moore, Daniel J. Ma, Kathryn M. Van Abel, Tae Hyun Hwang. Integrative spatial analysis of paired IHC and H&E images identifies Foxp3 enriched tumor-infiltrating lymphocytes associated with disease-free survival in human papillomavirus (HPV)-related oropharyngeal squamous cell carcinoma. [abstract]. In: Proceedings of the American Association for Cancer Research Annual Meeting 2023; Part 1 (Regular and Invited Abstracts); 2023 Apr 14-19; Orlando, FL. Philadelphia (PA): AACR; Cancer Res 2023;83(7_Suppl):Abstract nr 4638.