Citations 30

Search and Retrieval in Dermatology Atlases of Histopathology Images for Risk Stratification of Cutaneous Squamous Cell Carcinoma

No container title available | January 7, 2026 | Volume: No volume available | Issue: No issue available | Pages: No page available

10.64898/2026.01.02.26343356

Abstract Cutaneous squamous cell carcinoma (cSCC) poses significant clinical challenges due to its rising incidence and potential for metastasis. Histopathologic risk stratification is further limited by substantial inter-observer variability. Unsupervised AI approaches based on content-based image retrieval offer scalable and interpretable decision support for diagnostic pathology. The objective of this study was to evaluate the use of image retrieval within histopathology atlases to stratify cSCC tumor differentiation from whole-slide images (WSIs), while comparing different patch selection and feature extraction strategies. This retrospective study included 552 archived WSIs comprising 385 well-differentiated, 102 moderately differentiated, and 66 poorly differentiated cases collected across Mayo Clinic sites in Arizona, Florida, and Minnesota. Image atlases were constructed using multiple patch aggregation strategies (Mosaic, Collage, and Montage) and deep learning encoders (KimiaNet, PathDino, and H-Optimus-0). A leave-one-WSI-out evaluation framework was used to assess differentiation classification performance using accuracy, specificity, sensitivity, and F1 score. Mosaic combined with KimiaNet achieved the highest Top-1 accuracy (74.9%) and specificity (92.6%), while Mosaic with H-Optimus-0 yielded the best Top-5 accuracy (79.0%) and macro-F1 score (62.6%). Collage combined with KimiaNet produced the highest Top-5 specificity (99.5%). The generalizability of the evaluated AI models varied across hospitals, reflecting differences in imaging protocols, staining practices, and patient populations. Overall, unsupervised image search and retrieval provides effective, annotation-free support for cSCC differentiation and has the potential to enhance dermatopathology workflows when appropriate combinations of patch selection and feature ex-traction methods are employed.
Differentiating clinical characteristics of perianal inflammatory bowel disease from perianal hidradenitis suppurativa

International Journal of Dermatology | September 22, 2024 | Volume: 64 | Issue: 3 | Pages: 520-530

10.1111/ijd.17498 | PMID 39306801

Abstract Background Perianal draining tunnels in hidradenitis suppurativa (HS) and perianal fistulizing inflammatory bowel disease (IBD) present diagnostic and management dilemmas. Methods We conducted a retrospective chart review of patients with perianal disease evaluated at Mayo Clinic from January 1, 1998, through July 31, 2021. Patients' demographic and clinical data were extracted, and 28 clinical features were collected. After experimenting with several machine learning techniques, random forests were used to select the 15 most important clinical features to construct the diagnostic prediction model to distinguish perianal HS from fistulizing perianal IBD. Results A total of 263 patients were included (98 with HS, 100 with IBD, and 65 with both IBD and HS). Patients with HS had a higher mean body mass index, a higher smoking rate, and more commonly showed cutaneous manifestations of tunnels and comedones, while fistulas, abscesses, induration, anal tags, ulcers, and anal fissures were more common in patients with IBD. In addition to having lesions in the perianal area, patients with IBD often had lesions in the buttocks and perineum, while those with HS had additional lesions in the axillae and groin. Among the statistically significant features, the 15 most important were identified by random forest: fistula , tunnel , digestive symptom , knife‐cut ulcer , perineum , body mass index , age , axilla , abscess , tags , smoking , groin , genital cutaneous edema , erythema , and bilateral/unilateral . Conclusions The results of this study may help differentiate perianal lesions, especially perineal HS and fistulizing perineal IBD, and provide promise for a better therapeutic outcome.
Predictors of Mortality by an Artificial Intelligence Enhanced Electrocardiogram Model for Cardiac Amyloidosis

ESC Heart Failure | August 31, 2024 | Volume: 12 | Issue: 1 | Pages: 677-682

10.1002/ehf2.15061 | PMID 39215684

Abstract Aims We aim to determine if our previously validated, diagnostic artificial intelligence (AI) electrocardiogram (ECG) model is prognostic for survival among patients with cardiac amyloidosis (CA). Methods A total of 2533 patients with CA (1834 with light chain amyloidosis (AL), 530 with wild-type transthyretin amyloid protein (ATTRwt) and 169 with hereditary transthyretin amyloid (ATTRv)] were included. An amyloid AI ECG (A2E) score was calculated for each patient reflecting the likelihood of CA. CA stage was calculated using the European modification of the Mayo 2004 criteria for AL and Mayo stage for transthyretin amyloid (ATTR). Risk of death was modelled using Cox proportional hazards, and Kaplan–Meier was used to estimate survival. Results Median age of the cohort was 67 [inter-quartile ratio (IQR) 59, 74], and 71.6% were male. The median overall survival for the cohort was 35.6 months [95% confidence interval (CI) 32.3, 39.5]. For AL, ATTRwt and ATTRv, respectively, median survival was 22.9 (95% CI 19.2, 28.2), 47.2 (95% CI 43.4, 52.3) and 61.4 (95% CI 48.7, 75.9) months. On univariate analysis, an increasing A2E score was associated with more than a two-fold risk of all-cause death. On multivariable analysis, the A2E score retained its importance with a risk ratio of 2.0 (95% CI 1.58, 2.55) in the AL group and 2.7 (95% CI 1.81, 4.24) in the ATTR group. Conclusions Among patients with AL and ATTR amyloidosis, the A2E model helps to stratify risk of CA and adds another dimension of prognostication.
Analysis and Validation of Image Search Engines in Histopathology

IEEE Reviews in Biomedical Engineering | July 12, 2024 | Volume: 18 | Issue: No issue available | Pages: 350-367

10.1109/rbme.2024.3425769 | PMID 38995713

Artificial Intelligence of Arterial Doppler Waveforms to Predict Major Adverse Outcomes Among Patients Evaluated for Peripheral Artery Disease

Journal of the American Heart Association | January 19, 2024 | Volume: 13 | Issue: 3 | Pages: No page available

10.1161/jaha.123.031880 | PMID 38240202

Background Patients with peripheral artery disease are at increased risk for major adverse cardiac events, major adverse limb events, and all‐cause death. Developing tools capable of identifying those patients with peripheral artery disease at greatest risk for major adverse events is the first step for outcome prevention. This study aimed to determine whether computer‐assisted analysis of a resting Doppler waveform using deep neural networks can accurately identify patients with peripheral artery disease at greatest risk for adverse outcome events. Methods and Results Consecutive patients (April 1, 2015, to December 31, 2020) undergoing ankle–brachial index testing were included. Patients were randomly allocated to training, validation, and testing subsets (60%/20%/20%). Deep neural networks were trained on resting posterior tibial arterial Doppler waveforms to predict major adverse cardiac events, major adverse limb events, and all‐cause death at 5 years. Patients were then analyzed in groups based on the quartiles of each prediction score in the training set. Among 11 384 total patients, 10 437 patients met study inclusion criteria (mean age, 65.8±14.8 years; 40.6% women). The test subset included 2084 patients. During 5 years of follow‐up, there were 447 deaths, 585 major adverse cardiac events, and 161 MALE events. After adjusting for age, sex, and Charlson comorbidity index, deep neural network analysis of the posterior tibial artery waveform provided independent prediction of death (hazard ratio [HR], 2.44 [95% CI, 1.78–3.34]), major adverse cardiac events (HR, 1.97 [95% CI, 1.49–2.61]), and major adverse limb events (HR, 11.03 [95% CI, 5.43–22.39]) at 5 years. Conclusions An artificial intelligence–enabled analysis of Doppler arterial waveforms enables identification of major adverse outcomes among patients with peripheral artery disease, which may promote early adoption and adherence of risk factor modification.
Creating an Atlas of Normal Tissue for Pruning WSI Patching Through Anomaly Detection

No container title available | October 27, 2023 | Volume: No volume available | Issue: No issue available | Pages: No page available

10.21203/rs.3.rs-3429527/v1

Abstract Patching whole slide images (WSIs) is an important task in computational pathology. While most of the are designed to classify or detect the presence of pathological lesions in a WSI, the confounding role and redundant nature of normal histology are generally overlooked. In this paper, we propose and validate the concept of an “atlas of normal tissue” solely using samples of WSIs obtained from normal biopsies. Such atlases can be employed to eliminate normal fragments of tissue samples and hence increase the representativeness the remaining patches. We tested our proposed method by establishing a normal atlas using 107 normal skin WSIs and demonstrated how established search engines like Yottixel can be improved. We used 553 WSIs of cutaneous squamous cell carcinoma to demonstrate the advantage. We also validated our method applied to an external dataset of 451 breast WSIs. The number of selected WSI patches was reduced by 30% to 50% after utilizing the proposed normal atlas while maintaining the same indexing and search performance in leave-one-patient-out validation for both datasets. We show that the proposed concept of establishing and using a normal atlas shows promise for unsupervised selection of the most representative patches of the abnormal WSI patches.
Artificial intelligence for automatic detection of basal cell carcinoma from frozen tissue tangential biopsies

Clinical and Experimental Dermatology | June 15, 2023 | Volume: 49 | Issue: 7 | Pages: 719-721

10.1093/ced/llad209 | PMID 37317975

Abstract Evaluation of basal cell carcinoma (BCC) involves tangential biopsies of a suspicious lesion that is sent for frozen sections and evaluated by a Mohs micrographic surgeon. Advances in artificial intelligence (AI) have made possible the development of sophisticated clinical decision support systems to provide real-time feedback to clinicians that could have a role in optimizing the diagnostic workup of BCC. There were 287 annotated whole-slide images of frozen sections from tangential biopsies, of which 121 contained BCC, that were used to train and test an AI pipeline to recognize BCC. Regions of interest were annotated by a senior dermatology resident, an experienced dermatopathologist and an experienced Mohs surgeon, with concordance of annotations noted on final review. Final performance metrics included a sensitivity and specificity of 0.73 and 0.88, respectively. Our results on a relatively small dataset suggest the feasibility of developing an AI system to aid in the workup and management of BCC.
Artificial Intelligence-Enhanced Models to Predict Light Chain Amyloidosis from Patients with Monoclonal Gammopathy of Undetermined Significance and Smoldering Multiple Myeloma

Blood | November 29, 2022 | Volume: 140 | Issue: Supplement 1 | Pages: 7230-7232

10.1182/blood-2022-168119

Artificial intelligence for the evaluation of peripheral artery disease using arterial Doppler waveforms to predict abnormal ankle-brachial index

Vascular Medicine | May 10, 2022 | Volume: 27 | Issue: 4 | Pages: 333-342

10.1177/1358863x221094082 | PMID 35535982

Background: Patients with peripheral artery disease (PAD) are at increased risk for major adverse limb and cardiac events including mortality. Developing screening tools capable of accurate PAD identification is a necessary first step for strategies of adverse outcome prevention. This study aimed to determine whether machine analysis of a resting Doppler waveform using deep neural networks can accurately identify patients with PAD. Methods: Consecutive patients (4/8/2015 – 12/31/2020) undergoing rest and postexercise ankle–brachial index (ABI) testing were included. Patients were randomly allocated to training, validation, and testing subsets (70%/15%/15%). Deep neural networks were trained on resting posterior tibial arterial Doppler waveforms to predict normal (> 0.9) or PAD (⩽ 0.9) using rest and postexercise ABI. A separate dataset of 151 patients who underwent testing during a period after the model had been created and validated (1/1/2021 – 3/31/2021) was used for secondary validation. Area under the receiver operating characteristic curves (AUC) were constructed to evaluate test performance. Results: Among 11,748 total patients, 3432 patients met study criteria: 1941 with PAD (mean age 69 ± 12 years) and 1491 without PAD (64 ± 14 years). The predictive model with highest performance identified PAD with an AUC 0.94 (CI = 0.92–0.96), sensitivity 0.83, specificity 0.88, accuracy 0.85, and positive predictive value (PPV) 0.90. Results were similar for the validation dataset: AUC 0.94 (CI = 0.91–0.98), sensitivity 0.91, specificity 0.85, accuracy 0.89, and PPV 0.89 (postexercise ABI comparison). Conclusion: An artificial intelligence-enabled analysis of a resting Doppler arterial waveform permits identification of PAD at a clinically relevant performance level.
Abstract 13814: Prediction of Transthyretin Cardiac Amyloidosis in Heart Failure With Preserved Ejection Fraction: Artificial Intelligence Electrocardiogram versus Traditional Risk Scores

Circulation | April 28, 2022 | Volume: 144 | Issue: Suppl_1 | Pages: No page available

10.1161/circ.144.suppl_1.13814

Introduction: Transthyretin cardiac amyloidosis (TTR-CA) can cause heart failure with preserved EF (HFpEF). We previously reported a clinical/echo-based score (TCAS) and defined a cut-off that predicted risk of TTR-CA in HFpEF. Herein, we assess the comparative performance of an artificial-intelligence ECG-based screening tool (AI-ECG). Hypothesis: AI-ECG successfully identifies TTR-CA in HFpEF cohorts across a range of TTR-CA prevalence Methods: Referral HFpEF cohort was constructed from a referral population of HFpEF patients (EF ≥ 40%) undergoing 99m Tc-pyrophosphate scintigraphy (PYP) at Mayo Clinic (2013-2020, n=484, 38% with TTR-CA). Community HFpEF cohort was prospectively screened with PYP (n=275; age ≥ 60, LV wall thickness (WT) ≥ 12 mm, 4% with TTR-CA). TCAS was built using a multivariable logistic regression model and converted to a simple point score comprised of age (60-69, 70-79, ≥ 80: +2, +3, +4 points respectively), male sex (+2), relative WT > 0.57 (+2), posterior WT ≥ 12 mm (+1), EF < 60% (+1), and hypertension diagnosis (-1). TCAS was validated in the community cohort. A deep neural network trained to predict cardiac amyloidosis from a single 12-lead ECG, was applied to both referral and community cohorts. Patients were excluded if ECG was not available ≤ 12 months before PYP or if used in development of the AI-ECG. Standard ROC methods were applied. Youden’s index was used to define optimal cut-off. Results: Predictive characteristics of AI-ECG were strong and compared favorably with TCAS across a range of true TTR-CA prevalence (Table). Conclusions: Using a single ECG, AI-ECG effectively predicts TTR-CA with an excellent negative predictive value to rule out TTR-CA and a positive predictive value sufficient to warrant specific TTR-CA testing. This was particularly evident in the community. AI-ECG holds promise for simple, cost-effective global screening of at-risk populations, especially those with limited access to advanced cardiac imaging.