Abstract Identification of key phenotypic regions such as necrosis, contrast enhancement, and edema on magnetic resonance imaging (MRI) is important for understanding disease evolution and treatment response in patients with glioma. Manual delineation is time intensive and not feasible for a clinical workflow. Automating phenotypic region segmentation overcomes many issues with manual segmentation, however, current glioma segmentation datasets focus on pre-treatment, diagnostic scans, where treat-ment effects and surgical cavities are not present. Thus, existing automatic segmenta-tion models are not applicable to post-treatment imaging that is used for longitudinal evaluation of care. Here, we present a comparison of three-dimensional convolutional neural networks (nnU-Net architecture) trained on large temporally defined pre-treatment, post-treatment, and mixed cohorts. We used a total of 1563 imaging timepoints from 854 patients curated from 13 different institutions as well as diverse public data sets to understand the capabilities and limitations of automatic segmenta-tion on glioma images with different phenotypic and treatment appearance. We as-sessed the performance of models using Dice coefficients on test cases from each group comparing predictions with manual segmentations generated by trained techni-cians. We demonstrate that training a combined model can be as effective as models trained on just one temporal group. The results highlight the importance of a diverse training set, that includes images from the course of disease and with effects from treatment, in the creation of a model that can accurately segment glioma MRIs at multiple treatment time points.
Deep neural network to locate and segment brain tumors outperformed the expert technicians who created the training data
Artificial intelligence (AI) is rapidly moving from an experimental phase to an implementation phase in many fields, including medicine. The combination of improved availability of large datasets, increasing computing power, and advances in learning algorithms has created major performance breakthroughs in the development of AI applications. In the last 5 years, AI techniques known as deep learning have delivered rapidly improving performance in image recognition, caption generation, and speech recognition. Radiology, in particular, is a prime candidate for early adoption of these techniques. It is anticipated that the implementation of AI in radiology over the next decade will significantly improve the quality, value, and depth of radiology's contribution to patient care and population health, and will revolutionize radiologists' workflows. The Canadian Association of Radiologists (CAR) is the national voice of radiology committed to promoting the highest standards in patient-centered imaging, lifelong learning, and research. The CAR has created an AI working group with the mandate to discuss and deliberate on practice, policy, and patient care issues related to the introduction and implementation of AI in imaging. This white paper provides recommendations for the CAR derived from deliberations between members of the AI working group. This white paper on AI in radiology will inform CAR members and policymakers on key terminology, educational needs of members, research and development, partnerships, potential clinical applications, implementation, structure and governance, role of radiologists, and potential impact of AI on radiology in Canada.
Computed Tomography-Based Texture Analysis to Determine Human Papillomavirus Status of Oropharyngeal Squamous Cell Carcinoma
ObjectiveTo determine whether machine learning can accurately classify human papillomavirus (HPV) status of oropharyngeal squamous cell carcinoma (OPSCC) using computed tomography (CT)-based texture analysis.MethodsTexture analyses were retrospectively applied to regions of interest from OPSCC primary tumors on contrast-enhanced neck CT, and machine learning was used to create a model that classified HPV status with the highest accuracy. Results were compared against the blinded review of 2 neuroradiologists.ResultsThe HPV-positive (n = 92) and -negative (n = 15) cohorts were well matched clinically. Neuroradiologist classification accuracies for HPV status (44.9%, 55.1%) were not significantly different (P= 0.13), and there was a lack of agreement between the 2 neuroradiologists (κ = −0.145). The best machine learning model had an accuracy of 75.7%, which was greater than either neuroradiologist (P< 0.001,P= 0.002).ConclusionsUseful diagnostic information regarding HPV infection can be extracted from the CT appearance of OPSCC beyond what is apparent to the trained human eye.