Background Breast phyllodes tumours (PT) are rare biphasic neoplasms consisting of epithelial and stromal components. They are classified into benign, borderline and malignant categories. Diagnosing and grading PTs present a challenge for pathologists, as there are multiple histological parameters and their own tiers. We aim to investigate the potential role of artificial intelligence (AI) as a diagnostic aid in determining PT grade. Materials and methods We investigated 15 PT whole slide images (WSIs), comprising 5 benign, 5 borderline and 5 malignant cases. We sought to classify and retrieve the most relevant WSIs by matching histological features at different patch sizes, using the Yottixel framework for WSI processing. Patches were extracted at a 20× magnification level. We then used the KimiaNet to extract feature vectors and transformed these into barcode representations. Barcodes of a query WSI were compared with those of others in the archive, allowing us to identify the most similar WSI and determine the PT grades from histological similarities. Results We utilized ‘majority‐n accuracy’ as a measure of correctness, that is when the majority of the top‐n search results have the correct diagnosis as the query patient. We achieved a maximum reported accuracy of 67%, with a 3000 × 3000 patch size when grading PT at majority voting with n = 4. Conclusion Despite the small sample size and absence of fine‐tuning, our study demonstrated the potential of AI‐based PT grade stratification using various patch sizes through histological matching. This serves as a preliminary proof of concept, with the prospect of refinement for potential routine clinical application.
Search and Retrieval in Dermatology Atlases of Histopathology Images for Risk Stratification of Cutaneous Squamous Cell Carcinoma
Abstract Cutaneous squamous cell carcinoma (cSCC) poses significant clinical challenges due to its rising incidence and potential for metastasis. Histopathologic risk stratification is further limited by substantial inter-observer variability. Unsupervised AI approaches based on content-based image retrieval offer scalable and interpretable decision support for diagnostic pathology. The objective of this study was to evaluate the use of image retrieval within histopathology atlases to stratify cSCC tumor differentiation from whole-slide images (WSIs), while comparing different patch selection and feature extraction strategies. This retrospective study included 552 archived WSIs comprising 385 well-differentiated, 102 moderately differentiated, and 66 poorly differentiated cases collected across Mayo Clinic sites in Arizona, Florida, and Minnesota. Image atlases were constructed using multiple patch aggregation strategies (Mosaic, Collage, and Montage) and deep learning encoders (KimiaNet, PathDino, and H-Optimus-0). A leave-one-WSI-out evaluation framework was used to assess differentiation classification performance using accuracy, specificity, sensitivity, and F1 score. Mosaic combined with KimiaNet achieved the highest Top-1 accuracy (74.9%) and specificity (92.6%), while Mosaic with H-Optimus-0 yielded the best Top-5 accuracy (79.0%) and macro-F1 score (62.6%). Collage combined with KimiaNet produced the highest Top-5 specificity (99.5%). The generalizability of the evaluated AI models varied across hospitals, reflecting differences in imaging protocols, staining practices, and patient populations. Overall, unsupervised image search and retrieval provides effective, annotation-free support for cSCC differentiation and has the potential to enhance dermatopathology workflows when appropriate combinations of patch selection and feature ex-traction methods are employed.
Rotation-Agnostic Image Representation Learning for Digital Pathology
2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) | September 16, 2024 | Volume: No volume available | Issue: No issue available | Pages: 11683-11693
2023 45th Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC) | December 11, 2023 | Volume: No volume available | Issue: No issue available | Pages: 1-4
2023 45th Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC) | December 11, 2023 | Volume: No volume available | Issue: No issue available | Pages: 1-5