Erickson, Bradley J.

Abstract INTRODUCTION Glioblastomas (GBMs) are highly aggressive tumors. A common clinical challenge after standard of care treatment is differentiating tumor progression from treatment-related changes, also known as pseudoprogression (PsP). Usually, PsP resolves or stabilizes without further treatment or a course of steroids, whereas true progression (TP) requires more aggressive management. Differentiating PsP from TP will affect the patient's outcome. This study investigated using deep learning to distinguish PsP MRI features from progressive disease. METHOD We included newly diagnosed GBM patients who met the inclusion criteria, including a new or increasing enhancing lesion size within the original radiation field and who had clinical, medication, and any histopathology available. The interpretation of the MR images at the image inclusion time point had to be indeterminate. We labeled those who subsequently were stable or improved on imaging and clinically as PSP and those with clinical and imaging deterioration as TP. A subset of subjects underwent a second resection. We labeled these subjects as PSP or TP based on the histological diagnosis. We performed skull stripping, coregistered contrast-enhanced T1 MRIs with T2-weighted images for each patient and used them as input to a 3-D Densenet121 model. We used several augmentation techniques and five-fold cross-validation to achieve more robust predictions. RESULT We included 124 patients who met the criteria, and of those, 63 were PsP and 61 were TP. We trained a deep learning model that achieved 76.4% (ranged 70%-84%, SD 5.122) mean accuracy over the 5 folds, 0.7560(ranged 0.6553-0.8535, SD 0.069) mean AUROCC, 88.72% (SD 6.86) mean sensitivity, and 62.05%(SD 9.11) mean specificity. CONCLUSION We report the development of a deep learning model that distinguishes PsP from TP in GBM patients treated per the Stupp protocol. Further refinement and external validation are required prior to widespread adoption in clinical practice.

Abstract PURPOSE Though patients with glioblastoma generally have poor overall survival (OS), OS estimates range significantly. We sought to develop a radiomics-based model predictive of OS in glioblastoma using preoperative MRI scans to identify these differences and guide clinical care. METHODS The primary endpoint was OS, determined from the date of surgery to death or last follow-up. T1, FLAIR, T2, and post-contrast T1 (T1c) MRI sequences were obtained for all patients. Using HD-GLIO-AUTO, lesion segmentation yielded three masks corresponding to the regions of contrast enhancement, non-enhancement, and total volume. Radiomics features were extracted from each region from the T2 and T1c sequences independently (i.e. either from T2 or T1c) and in combination. Age at surgery and gender were also considered. The data was split into training (75%) and test (25%) sets, stratifying for age at surgery. Kaplan-Meier analysis and the Coxnet model were used. For Coxnet, Elastic Net was used as the penalty, with optimization of the L1 coefficient using 5-fold cross-validation and evaluation via the concordance index (C-index). RESULTS From 3 institutions, 383 patients were included. Median OS was 395 days: 346 patients died, and 37 were right-censored. Age > 65 years was predictive of decreased OS (p < 0.005), but gender was not (p=0.16). For the Coxnet model, the C-index was 0.67 (standard deviation: 0.01) considering T2 and T1c sequences for the total lesion volume, with a C-index of 0.65 for the test set. For the enhancing volume, the model had a C-index of 0.71 for the test set using T1c sequences. Overall, C-indices ranged from 0.62-0.71. CONCLUSIONS We present a novel radiomics-based model predictive of OS in glioblastoma across a multi-institutional dataset. Ongoing efforts will incorporate immediate postoperative imaging and IDH and MGMT status into the proposed model to further improve prognostic ability and help guide clinical decision-making.

Abstract: Electronic health records (EHRs) have created great opportunities to collect various information from clinical patient encounters. However, most EHR data are stored in unstructured form (e.g., clinical notes, surgical notes, and medication instructions), and researchers need data to be in computable form (structured) to extract meaningful relationships involving variables that can influence patient outcomes. Clinical natural language processing (NLP) is the field of extracting structured data from unstructured text documents in EHRs. Clinical text has several characteristics that mandate the use of special techniques to extract structured information from them compared with generic NLP methods. In this article, we define clinical NLP models, introduce different methods of information extraction from unstructured data using NLP, and describe the basic technical aspects of how deep learning-based NLP models work. We conclude by noting the challenges of working with clinical NLP models and summarizing the general steps needed to launch an NLP project.

Machine-learning (ML) and deep-learning (DL) algorithms are part of a group of modeling algorithms that grasp the hidden patterns in data based on a training process, enabling them to extract complex information from the input data. In the past decade, these algorithms have been increasingly used for image processing, specifically in the medical domain. Cardiothoracic imaging is one of the early adopters of ML/DL research, and the COVID-19 pandemic resulted in more research focus on the feasibility and applications of ML/DL in cardiothoracic imaging. In this scoping review, we systematically searched available peer-reviewed medical literature on cardiothoracic imaging and quantitatively extracted key data elements in order to get a big picture of how ML/DL have been used in the rapidly evolving cardiothoracic imaging field. During this report, we provide insights on different applications of ML/DL and some nuances pertaining to this specific field of research. Finally, we provide general suggestions on how researchers can make their research more than just a proof-of-concept and move toward clinical adoption.

Abstract INTRODUCTION Glioblastomas (GBMs) are highly aggressive tumors. Despite multimodal treatment, its median overall survival ranges between 16 and 20 months. The standard treatment regimen consists of surgical resection followed by concurrent chemoradiotherapy and adjuvant temozolomide. Despite temozolomide’s effectiveness, it may cause the clinical challenge of treatment-related progression also known as pseudoprogression(PsP). Usually, PSP resolves or stabilizes without further treatment, whereas a true progression (TP) requires more aggressive management. Identifying PSP from TP will affect the patient’s treatment plan. Conventional magnetic resonance imaging (MRI) reading techniques cannot distinguish these entities. This study investigated the feasibility of using deep learning to distinguish PsP from TP. METHOD We included GBM patients who met our inclusion criteria. We evaluated all cases to see if they had a new enhancing lesion within the original radiation field or an increase in the size of an existing lesion. The challenging MRIs were collected. Clinical notes regarding tumor and recurrence location, clinical history, and medication were collected. We labeled the ones who stayed stable or improved in the imaging and clinical situation as PSP and those with further imaging and clinical deterioration as TP. We coregistered Contrast-enhanced-T1 MRIs with T2-weighted images for each patient. We performed five-fold cross-validation to generalize the performance. We trained A 3-D Densenet121 model to establish the prediction. We selected the best models with the highest accuracy. RESULT After reviewing 1000 patients, we included 124 patients whose imaging showed suspicious progression and their medicational histories were completely retrievable; 63 PsP, and 61 TP. We developed a deep learning model based on the whole dataset. The 5-fold cross-validation revealed that the mean area under the curve (AUC) was 0.81. CONCLUSION We report the development of a deep learning model that diagnoses PsP from TP in patients who received temozolomide. Further refinement and external validation are required prior to widespread adoption in clinical practice.

Background: Establishing imaging registries for large patient cohorts is challenging because manual labeling is tedious and relying solely on DICOM (digital imaging and communications in medicine) metadata can result in errors. We endeavored to establish an automated hip and pelvic radiography registry of total hip arthroplasty (THA) patients by utilizing deep-learning pipelines. The aims of the study were (1) to utilize these automated pipelines to identify all pelvic and hip radiographs with appropriate annotation of laterality and presence or absence of implants, and (2) to automatically measure acetabular component inclination and version for THA images. Methods: We retrospectively retrieved 846,988 hip and pelvic radiography DICOM files from 20,378 patients who underwent primary or revision THA performed at our institution from 2000 to 2020. Metadata for the files were screened followed by extraction of imaging data. Two deep-learning algorithms (an EfficientNetB3 classifier and a YOLOv5 object detector) were developed to automatically determine the radiographic appearance of all files. Additional deep-learning algorithms were utilized to automatically measure the acetabular angles on anteroposterior pelvic and lateral hip radiographs. Algorithm performance was compared with that of human annotators on a random test sample of 5,000 radiographs. Results: Deep-learning algorithms enabled appropriate exclusion of 209,332 DICOM files (24.7%) as misclassified non-hip/pelvic radiographs or having corrupted pixel data. The final registry was automatically curated and annotated in <8 hours and included 168,551 anteroposterior pelvic, 176,890 anteroposterior hip, 174,637 lateral hip, and 117,578 oblique hip radiographs. The algorithms achieved 99.9% accuracy, 99.6% precision, 99.5% recall, and a 99.6% F1 score in determining the radiograph appearance. Conclusions: We developed a highly accurate series of deep-learning algorithms to rapidly curate and annotate THA patient radiographs. This efficient pipeline can be utilized by other institutions or registries to construct radiography databases for patient care, longitudinal surveillance, and large-scale research. The stepwise approach for establishing a radiography registry can further be utilized as a workflow guide for other anatomic areas. Level of Evidence: Diagnostic Level IV . See Instructions for Authors for a complete description of levels of evidence.

The analysis and interpretation of cardiac magnetic resonance (CMR) images are often time-consuming. The automated segmentation of cardiac structures can reduce the time required for image analysis. Spatial similarities between different CMR image types were leveraged to jointly segment multiple sequences using a segmentation model termed a multi-image type UNet (MI-UNet). This model was developed from 72 exams (46% female, mean age 63 ± 11 years) performed on patients with hypertrophic cardiomyopathy. The MI-UNet for steady-state free precession (SSFP) images achieved a superior Dice similarity coefficient (DSC) of 0.92 ± 0.06 compared to 0.87 ± 0.08 for a single-image type UNet (p < 0.001). The MI-UNet for late gadolinium enhancement (LGE) images also had a superior DSC of 0.86 ± 0.11 compared to 0.78 ± 0.11 for a single-image type UNet (p = 0.001). The difference across image types was most evident for the left ventricular myocardium in SSFP images and for both the left ventricular cavity and the left ventricular myocardium in LGE images. For the right ventricle, there were no differences in DCS when comparing the MI-UNet with single-image type UNets. The joint segmentation of multiple image types increases segmentation accuracy for CMR images of the left ventricle compared to single-image models. In clinical practice, the MI-UNet model may expedite the analysis and interpretation of CMR images of multiple types.