Faghani, Shahriar

Oropharyngeal Squamous Cell Carcinoma (OPSCC) is one of the common forms of heterogeneity in head and neck cancer. Infection with human papillomavirus (HPV) has been identified as a major risk factor for OPSCC. Therefore, differentiating the HPV-positive and negative cases in OPSCC patients is an essential diagnostic factor influencing future treatment decisions. In this study, we investigated the accuracy of a deep learning-based method for image interpretation and automatically detected the HPV status of OPSCC in routinely acquired Computed Tomography (CT) and Positron Emission Tomography (PET) images. We introduce a 3D CNN-based multi-modal feature fusion architecture for HPV status prediction in primary tumor lesions. The architecture is composed of an ensemble of CNN networks and merges image features in a softmax classification layer. The pipeline separately learns the intensity, contrast variation, shape, texture heterogeneity, and metabolic assessment from CT and PET tumor volume regions and fuses those multi-modal features for final HPV status classification. The precision, recall, and AUC scores of the proposed method are computed, and the results are compared with other existing models. The experimental results demonstrate that the multi-modal ensemble model with soft voting outperformed single-modality PET/CT, with an AUC of 0.76 and F1 score of 0.746 on publicly available TCGA and MAASTRO datasets. In the MAASTRO dataset, our model achieved an AUC score of 0.74 over primary tumor volumes of interest (VOIs). In the future, more extensive cohort validation may suffice for better diagnostic accuracy and provide preliminary assessment before the biopsy.

Machine-learning (ML) and deep-learning (DL) algorithms are part of a group of modeling algorithms that grasp the hidden patterns in data based on a training process, enabling them to extract complex information from the input data. In the past decade, these algorithms have been increasingly used for image processing, specifically in the medical domain. Cardiothoracic imaging is one of the early adopters of ML/DL research, and the COVID-19 pandemic resulted in more research focus on the feasibility and applications of ML/DL in cardiothoracic imaging. In this scoping review, we systematically searched available peer-reviewed medical literature on cardiothoracic imaging and quantitatively extracted key data elements in order to get a big picture of how ML/DL have been used in the rapidly evolving cardiothoracic imaging field. During this report, we provide insights on different applications of ML/DL and some nuances pertaining to this specific field of research. Finally, we provide general suggestions on how researchers can make their research more than just a proof-of-concept and move toward clinical adoption.

Abstract INTRODUCTION Glioblastomas (GBMs) are highly aggressive tumors. Despite multimodal treatment, its median overall survival ranges between 16 and 20 months. The standard treatment regimen consists of surgical resection followed by concurrent chemoradiotherapy and adjuvant temozolomide. Despite temozolomide’s effectiveness, it may cause the clinical challenge of treatment-related progression also known as pseudoprogression(PsP). Usually, PSP resolves or stabilizes without further treatment, whereas a true progression (TP) requires more aggressive management. Identifying PSP from TP will affect the patient’s treatment plan. Conventional magnetic resonance imaging (MRI) reading techniques cannot distinguish these entities. This study investigated the feasibility of using deep learning to distinguish PsP from TP. METHOD We included GBM patients who met our inclusion criteria. We evaluated all cases to see if they had a new enhancing lesion within the original radiation field or an increase in the size of an existing lesion. The challenging MRIs were collected. Clinical notes regarding tumor and recurrence location, clinical history, and medication were collected. We labeled the ones who stayed stable or improved in the imaging and clinical situation as PSP and those with further imaging and clinical deterioration as TP. We coregistered Contrast-enhanced-T1 MRIs with T2-weighted images for each patient. We performed five-fold cross-validation to generalize the performance. We trained A 3-D Densenet121 model to establish the prediction. We selected the best models with the highest accuracy. RESULT After reviewing 1000 patients, we included 124 patients whose imaging showed suspicious progression and their medicational histories were completely retrievable; 63 PsP, and 61 TP. We developed a deep learning model based on the whole dataset. The 5-fold cross-validation revealed that the mean area under the curve (AUC) was 0.81. CONCLUSION We report the development of a deep learning model that diagnoses PsP from TP in patients who received temozolomide. Further refinement and external validation are required prior to widespread adoption in clinical practice.

Background: Establishing imaging registries for large patient cohorts is challenging because manual labeling is tedious and relying solely on DICOM (digital imaging and communications in medicine) metadata can result in errors. We endeavored to establish an automated hip and pelvic radiography registry of total hip arthroplasty (THA) patients by utilizing deep-learning pipelines. The aims of the study were (1) to utilize these automated pipelines to identify all pelvic and hip radiographs with appropriate annotation of laterality and presence or absence of implants, and (2) to automatically measure acetabular component inclination and version for THA images. Methods: We retrospectively retrieved 846,988 hip and pelvic radiography DICOM files from 20,378 patients who underwent primary or revision THA performed at our institution from 2000 to 2020. Metadata for the files were screened followed by extraction of imaging data. Two deep-learning algorithms (an EfficientNetB3 classifier and a YOLOv5 object detector) were developed to automatically determine the radiographic appearance of all files. Additional deep-learning algorithms were utilized to automatically measure the acetabular angles on anteroposterior pelvic and lateral hip radiographs. Algorithm performance was compared with that of human annotators on a random test sample of 5,000 radiographs. Results: Deep-learning algorithms enabled appropriate exclusion of 209,332 DICOM files (24.7%) as misclassified non-hip/pelvic radiographs or having corrupted pixel data. The final registry was automatically curated and annotated in <8 hours and included 168,551 anteroposterior pelvic, 176,890 anteroposterior hip, 174,637 lateral hip, and 117,578 oblique hip radiographs. The algorithms achieved 99.9% accuracy, 99.6% precision, 99.5% recall, and a 99.6% F1 score in determining the radiograph appearance. Conclusions: We developed a highly accurate series of deep-learning algorithms to rapidly curate and annotate THA patient radiographs. This efficient pipeline can be utilized by other institutions or registries to construct radiography databases for patient care, longitudinal surveillance, and large-scale research. The stepwise approach for establishing a radiography registry can further be utilized as a workflow guide for other anatomic areas. Level of Evidence: Diagnostic Level IV . See Instructions for Authors for a complete description of levels of evidence.