Image‐based multiplex immune profiling of cancer tissues: translational implications. A report of the International Immuno‐oncology Biomarker Working Group on Breast Cancer
Spatial analyses of immune cell infiltration in cancer: current methods and future directions: A report of the International Immuno‐Oncology Biomarker Working Group on Breast Cancer
Pitfalls in machine learning‐based assessment of tumor‐infiltrating lymphocytes in breast cancer: A report of the International Immuno‐Oncology Biomarker Working Group on Breast Cancer
Abstract P2-11-34: Mitotic spindle hotspot counting using deep learning networks is highly associated with clinical outcomes in patients with early-stage triple-negative breast cancer who did not receive systemic therapy
Abstract Background: Triple-negative breast cancers (TNBC) exhibit high rates of recurrence and mortality. However, recent studies suggest that a subset of patients (pts) with early-stage TNBC enriched in tumor-infiltrating lymphocytes (TILs) have excellent clinical outcomes even in the absence of systemic therapy. Additional histological biomarkers that could identify pts for future systemic therapy escalation/de-escalation strategies are of great interest. TNBC are frequently highly proliferative with abundant mitoses. However, classic markers of proliferation (manual mitosis counting and Ki-67) appear to offer no prognostic value. Here, we evaluated the prognostic effects of automated mitotic spindle hotspot (AMSH) counting on RFS in independent cohorts of systemically untreated early-stage TNBC. Methods: AMSH counting was conducted with a state-of-the-art deep learning algorithm trained on the detection of mitoses within 2 mm2 areas with the highest mitotic density (i.e. hotspots) in digital H&E images. Details of the development, training and validation of the algorithm were published previously [1] in a cohort of unselected TNBC. We obtained AMSH counts in a centrally confirmed TNBC cohort from Mayo Clinic [2] and focused our analysis on pts who received locoregional therapy but no systemic therapy. Using a fractional polynomial analysis with a multivariable proportional hazards regression model, we confirmed the assumption of linearity in the log hazard for the continuous variable AMSH and evaluated whether AMSH counts were prognostic of RFS. We corroborated our findings in an independent cohort of systemically untreated TNBC pts from the Radboud University Medical Center in the Netherlands (Radboud Cohort). Results are reported at a median follow-up of 8.1 and 6.7 years for the Mayo and Netherlands cohorts, respectively. Results: Among 182 pts with who did not receive systemic therapy in the Mayo Cohort, 140 (77%) with available AMSH counts were included. The mean age was 61 (range: 31-94), 71% were postmenopausal, 67% had tumors ≤ 2cm, and 83% were node-negative. As expected, most tumors were Nottingham grade 3 (84%) and had a high Ki-67 proliferation index (54% with Ki-67 >30%). Most tumors (73%) had stromal TILs ≤ 30%. The median AMSH count was 18 (IQR: 8, 42). AMSH counts were linearly associated with grade and tumor size, with the proportion of pts with grade 3 tumors and size > 2 cm increasing as the AMSH counts increased (p=0.007 and p=0.059, respectively). In a multivariate model controlling for nodal status, tumor size, and stromal TILs, AMSH counts were independently associated with RFS (p< 0.0001). For every 10-point increase in the AMSH count, we observed a 17% increase in the risk of experiencing an RFS event (HR 1.17, 95% CI 1.08-1.26). We corroborated our findings in the Radboud Cohort (n=126). The mean age was 68 (range: 40-96), and 81% were node-negative. While the median AMSH count was 36 (IQR: 16-63), higher than in the Mayo Cohort (p=0.004), the prognostic impact was similar, with a significant association between AMSH count and RFS (p=0.028) in a multivariate model corrected for nodal status, tumor size, and stromal TILs. For every 10-point increase in the AMSH count in the Netherlands cohort, we observed a 9% increase in the risk of experiencing an RFS event (HR 1.09, 95% CI 1.01-1.17). RFS rates according to AMSH counts for both cohorts are shown in the Table. Conclusions: AMSH counting is a new proliferation biomarker that provides prognostic value independent of nodal status, tumor size, and stromal TILs in systemically untreated early-stage TNBC. Plans are underway to evaluate AMSH counts in additional cohorts of systemically untreated TNBC, and in other disease settings such as prior to neoadjuvant systemic therapy. If validated, this biomarker should be prospectively evaluated as a potential selection biomarker in clinical trials of systemic therapy de-escalation. References: 1. PMID: 29994086 2. PMID: 28913760 Table RFS according to AMSH counts in the Mayo and Radboud Cohorts Citation Format: Roberto A. Leon-Ferre, Jodi M. Carter, David Zahrieh, Jason P. Sinnwell, Roberto Salgado, Vera Suman, David Hillman, Judy C. Boughey, Krishna R. Kalari, Fergus J. Couch, James N. Ingle, Maschenka Balkenkohl, Francesco Ciompi, Jeroen van der Laak, Matthew P. Goetz. Mitotic spindle hotspot counting using deep learning networks is highly associated with clinical outcomes in patients with early-stage triple-negative breast cancer who did not receive systemic therapy [abstract]. In: Proceedings of the 2022 San Antonio Breast Cancer Symposium; 2022 Dec 6-10; San Antonio, TX. Philadelphia (PA): AACR; Cancer Res 2023;83(5 Suppl):Abstract nr P2-11-34.
Prognostic value of deep learning based mitotic count in hormonal receptor- and HER2-positive breast cancer
Abstract The discovery of molecular subtypes has corroborated the heterogeneity of breast cancers. But in clinical routine, treatment selection relies on measuring the aggressiveness of the tumor via histopathology, which is routinely based on grading, a prognostic yet laborious, poorly reproducible, and subjective procedure defined more than 30 years ago, before molecular subtypes existed. In this paper, we present an interpretable deep learning-based computer-aided diagnosis method to automate mitotic count, one of the components of grading; the method complies with current guidelines and automates hot-spot finding on full digital whole-slide images of routinely prepared pathologic slides stained with hematoxylin and eosin. We use the computer model to query the current “one-size-fits-all” mitotic count procedure by investigating subtype-specific prognostic value of mitotic count using an external independent large-scale multicentric dataset of 1,709 breast cancers. We show that for human epidermal growth factor-2 (HER2) positive tumors, mitotic count was not prognostic. In hormone-receptor positive/HER2 negative cancers, an average mitotic count density different from clinically used cut offs predicted worse recurrence free survival in multivariable analysis, adjusted for known clinical prognosticators. We provided some first experimental evidence that the prognostic role of mitotic count should be reviewed.
Towards Defining Morphologic Parameters of Normal Parous and Nulliparous Breast Tissues by Artificial Intelligence
Abstract Background:Breast terminal duct lobular units (TDLUs), the source of most breast cancer (BC) precursors, are shaped by age-related involution, a gradual process, and postpartum involution (PPI), a dramatic inflammatory process that restores baseline microanatomy after weaning. Dysregulated PPI is implicated in the pathogenesis of postpartum BCs. We propose that assessment of TDLUs in the postpartum period may have value in risk estimation, but characteristics of these tissues in relation to epidemiological factors are incompletely described.Methods: Using validated Artificial Intelligence and morphometric methods, we analyzed digitized images of tissue sections of normal breast tissues stained with hematoxylin and eosin from donors <45 years from the Komen Tissue Bank (180 parous and 545 nulliparous). Metrics assessed by AI, included: TDLU count; adipose tissue fraction; mean acini count/TDLU; mean dilated acini; mean average acini area; mean “capillary” area; mean epithelial area; mean ratio of epithelial area versus intralobular stroma; mean mononuclear cell count (surrogate of immune cells); mean fat area proximate to TDLUs and TDLU area. We compared epidemiologic characteristics collected via questionnaire by parity status and race, using a Wilcoxon rank sum test or Fisher’s exact test. Histologic features were compared between nulliparous and parous women (overall and by time between last birth and donation [ recent birth: ≤5 years versus remote birth: >5 years]) using multivariable regression models.Results:Normal breast tissues of parous women contained significantly higher TDLU counts and acini counts, more frequent dilated acini, higher mononuclear cell counts in TDLUs and smaller acini area per TDLU than nulliparas (all multivariable analyses p<0.001). Differences in TDLU counts and average acini size persisted for >5 years postpartum whereas increases in immune cells were most marked <5 years of a birth. Relationships were suggestively modified by several other factors, including demographic and reproductive characteristics, ethanol consumption and breastfeeding duration. Conclusions:Our study identified sustained expansion of TDLU numbers and reduced average acini area among parous versus nulliparous women and notable increases in immune responses within five years following childbirth. Further, we show that quantitative characteristics of normal breast samples vary with demographic features and BC risk factors.
Abstract 2113: Discrimination of benign breast disease from normal lobules using an automated computational pathology algorithm
Abstract Background: Biopsy diagnosis of benign breast disease (BBD) based on the most severe lesion in a sample predicts future breast cancer risk and has implications for screening and management. Lobules are the functional unit of the breast and the structures from which BBD arises. We developed and preliminarily validated an automated computational pathology algorithm to discriminate normal from BBD breast lobules as a step toward automated comprehensive characterization of benign biopsies. Methods: 152 BBD biopsies (27 training, 125 validation) from the Mayo Clinic were examined using scanned digital images of H&E stained sections. For each image, a pathologist annotated up to 10 representative lobules as normal or BBD using standard pathology criteria. A deep learning algorithm to quantify lobular features was developed using 129 lobules from 27 subjects. Nine features were identified that discriminate normal vs BBD lobules, expressing lobule size, acini size and number, acinar lumen size, proportion of lobular stroma, and capillaries. Here, we validate their performance to discriminate normal vs BBD lobules in a set of 1250 lobules from 125 subjects using area under the ROC curve (AUC) analysis. Random forest analysis was used for multivariable modeling; model performance was assessed with a tenfold cross-validation approach. Results: Median subject age was 52 years. Among the 125 validation subjects, BBD findings were nonproliferative in 39%, proliferative in 45%, and atypical hyperplasia in 16%. Sections included 552 (44%) normal lobules and 698 BBD (56%) lobules, with representation of both lobule types on each section. In univariate analyses, four individual features showed good discrimination between normal vs. BBD lobules, yielding the following AUCs: lobule size= 0.74, mean acini size= 0.75, epithelial area= 0.75, and number of acini with large lumens= 0.76. Lobule size and epithelial area were highly correlated (Spearman rank correlation r = 0.95), but both of these features showed lower correlation with mean acini size and number of acini with large lumens (each r < 0.5). With random forest modeling, number of acini with large lumens was the strongest discriminating feature, followed by mean acini size, lobule size, and epithelial area. With ten-fold cross validation of the multivariable random forest model, the overall AUC was 0.82 (95% CI: 0.79-0.85). Conclusion: Our validation showed that automated quantitative computational pathology assessment of breast lobules can discriminate normal versus BBD on a per lobule basis. This finding supports the feasibility of developing automated algorithms to classify every lesion in breast biopsies, expanding beyond visual assessment. Further studies using deep learning may reveal novel pathology features for classifying BBD biopsies with the potential to strengthen estimation of breast cancer risk. Citation Format: Amy C. Degnim, Thomas de Bel, Mark E. Sherman, Derek C. Radisky, Stacey J. Winham, Tanya L. Hoskin, Melody L. Stallings Mann, Marlene Frost, Robert A. Vierkant, Brendan T. Broderick, Ethan P. Heinzen, Rushin Brahmbhatt, Muhammad Arshad, Celine M. Vachon, Jodi M. Carter, Lori A. Denison, Daniel W. Visscher, Jeroen van der Laak. Discrimination of benign breast disease from normal lobules using an automated computational pathology algorithm [abstract]. In: Proceedings of the Annual Meeting of the American Association for Cancer Research 2020; 2020 Apr 27-28 and Jun 22-24. Philadelphia (PA): AACR; Cancer Res 2020;80(16 Suppl):Abstract nr 2113.
Deep Learning–Based Histopathologic Assessment of Kidney Tissue
Significance Statement Histopathologic assessment of kidney tissue currently relies on manual scoring or traditional image-processing techniques to quantify and classify tissue features, time-consuming approaches that have limited reproducibility. The authors present an alternative approach, featuring a convolutional neural network for multiclass segmentation of kidney tissue in sections stained by periodic acid–Schiff. Their findings demonstrate applicability of convolutional neural networks for tissue from multiple centers, for biopsies and nephrectomy samples, and for the analysis of both healthy and pathologic tissues. In addition, they validated the network’s results with components from the Banff classification system. Their convolutional neural network may have utility for quantitative studies involving kidney histopathology across centers and potential for application in routine diagnostics. Background The development of deep neural networks is facilitating more advanced digital analysis of histopathologic images. We trained a convolutional neural network for multiclass segmentation of digitized kidney tissue sections stained with periodic acid–Schiff (PAS). Methods We trained the network using multiclass annotations from 40 whole-slide images of stained kidney transplant biopsies and applied it to four independent data sets. We assessed multiclass segmentation performance by calculating Dice coefficients for ten tissue classes on ten transplant biopsies from the Radboud University Medical Center in Nijmegen, The Netherlands, and on ten transplant biopsies from an external center for validation. We also fully segmented 15 nephrectomy samples and calculated the network’s glomerular detection rates and compared network-based measures with visually scored histologic components (Banff classification) in 82 kidney transplant biopsies. Results The weighted mean Dice coefficients of all classes were 0.80 and 0.84 in ten kidney transplant biopsies from the Radboud center and the external center, respectively. The best segmented class was “glomeruli” in both data sets (Dice coefficients, 0.95 and 0.94, respectively), followed by “tubuli combined” and “interstitium.” The network detected 92.7% of all glomeruli in nephrectomy samples, with 10.4% false positives. In whole transplant biopsies, the mean intraclass correlation coefficient for glomerular counting performed by pathologists versus the network was 0.94. We found significant correlations between visually scored histologic components and network-based measures. Conclusions This study presents the first convolutional neural network for multiclass segmentation of PAS-stained nephrectomy samples and transplant biopsies. Our network may have utility for quantitative studies involving kidney histopathology across centers and provide opportunities for deep learning applications in routine diagnostics.
Abstract 651: Analysis of the immune microenvironment to advance breast cancer risk prediction and prevention
Abstract Existing risk models underperform among women who have undergone a benign breast disease (BBD) biopsy (> one million performed annually in the US) and with respect to estimating the risk of aggressive BCs. We've shown that molecular pathologic analysis of BBD biopsies can improve individual risk prediction, compared with standard risk models relying on self-reported factors, and provide insights into mechanisms mediating BC risk. BC risk factors such as obesity and ethanol use are proposed to increase production of cytokines and chemokines, resulting in chronic inflammation, and leading to production of DNA damaging free radicals and growth factors (e.g., VEGF, IGFs) that activate pro-carcinogenic pathways (e.g. NF-KB and JAK/STAT). The effects of most BC risk factors on immunity are poorly understood. Further, whereas experimental models implicate immunity throughout carcinogenesis, knowledge of immune markers and mechanisms related to BC development among women is limited. Therefore, we aim to define tissue immune cell content throughout BC development, and particularly at the earliest stages, to improve risk assessment and discover immune-based prevention strategies. Our study combines novel resources and technologies to define the immune landscape in: 1) normal breast tissues in relation to BC risk factors, 2) BBD with respect to BC risk, and 3) invasive BC in relation to neoantigen expression and molecular subtype. We will perform NanoString GeoMxTM Digital Spatial Profiling (DSP) to quantitatively map expression of key immune proteins in healthy breast tissues donated to the Komen Tissue Bank (KTB) in relation to BC risk factors and in BBD biopsies from two cohorts to predict BC risk. We will re-analyze top prognostic markers in BBD biopsies using Vectra multiplex IF staining with machine learning algorithms to refine how immune cell content and organization impacts prognosis, and assess critical immune pathways related to BBD progression with the NanoString PanCancer IO 360 panel, which provides RNA expression of 770 immune genes (13 signatures). Finally, we will evaluate immune responses in BCs categorized for predicted neoantigen load and underlying mutation type with our novel bioinformatics pipeline that enables accurate prediction of MHC class I and class II missense, fusion and frameshift mutation neoantigens generated through faulty DNA repair, aberrant DNA and RNA splicing, insertions, and deletions. Our project demonstrates a novel approach to defining the immune processes in early stages of BC development which may improve BC risk prediction and prevention. We present a plan to comprehensively analyze immunity throughout BC development and define changes that accompany transitions from normal to BBD and BBD to BC. Citation Format: Doug Hinerfeld, Keith Knutson, Derek Radisky, E. Aubrey Thompson, Yan Asmann, Kim McCoy, Amy Degnim, Jodi Carter, Stacey Winham, Michele Cote, Jeroen van der Laak, Mark Sherman. Analysis of the immune microenvironment to advance breast cancer risk prediction and prevention [abstract]. In: Proceedings of the American Association for Cancer Research Annual Meeting 2019; 2019 Mar 29-Apr 3; Atlanta, GA. Philadelphia (PA): AACR; Cancer Res 2019;79(13 Suppl):Abstract nr 651.