AbstractObjectiveThis study investigated the comparative performance of ear, nose, and throat (ENT) physicians in correctly detecting ear abnormalities when reviewing digital otoscopy imaging using 3 different visualization methods, including computer‐assisted composite images called “SelectStitch,” single video frame “Still” images, and video clips. The study also explored clinicians' diagnostic confidence levels and the time to make a diagnosis.Study DesignClinician diagnostic reader study.SettingOnline diagnostic survey of ENT physicians.MethodsNine ENT physicians reviewed digital otoscopy examinations from 86 ears with various diagnoses (normal, perforation, retraction, middle ear effusion, tympanosclerosis). Otoscopy examinations used artificial‐intelligence (AI)‐based computer‐aided composite image generation from a video clip (SelectStitch), manually selected best still frame from a video clip (Still), or the entire video clip. Statistical analyses included comparisons of ability to detect correct diagnosis, confidence levels, and diagnosis times.ResultsThe ENT physicians' ability to detect ear abnormalities (33.2%‐68.7%) varied depending on the pathologies. SelectStitch and Still images were not statistically different in detecting abnormalities (P > .50), but both were different from Video (P < .01). However, the performance improvement observed with Videos came at the cost of significantly longer time to determining the diagnosis. The level of confidence in the diagnosis was positively associated with correct diagnoses, but varied by particular pathology.ConclusionThis study explores the potential of computer‐assisted techniques like SelectStitch in enhancing otoscopic diagnoses and time‐saving, which could benefit telemedicine settings. Comparable performance between computer‐generated and manually selected images suggests the potential of AI algorithms for otoscopy applications.
Machine Learning Models for Predicting the Outcomes of Surgical Treatment of Colorectal Liver Metastases
BACKGROUND: Surgical intervention remains the cornerstone of a multidisciplinary approach in the treatment of colorectal liver metastases (CLM). Nevertheless, patient outcomes vary greatly. While predictive tools can assist decision-making and patient counseling, decades of efforts have yet to result in generating a universally adopted tool in clinical practice. STUDY DESIGN: An international collaborative database of CLM patients who underwent surgical therapy between 2000 and 2018 was used to select 1,004 operations for this study. Two different machine learning methods were applied to construct 2 predictive models for recurrence and death, using 128 clinicopathologic variables: gradient-boosted trees (GBTs) and logistic regression with bootstrapping (LRB) in a leave-one-out cross-validation. RESULTS: Median survival after resection was 47.2 months, and disease-free survival was 19.0 months, with a median follow-up of 32.0 months in the cohort. Both models had good predictive power, with GBT demonstrating a superior performance in predicting overall survival (area under the receiver operating curve [AUC] 0.773, 95% CI 0.743 to 0.801 vs LRB: AUC 0.648, 95% CI 0.614 to 0.682) and recurrence (AUC 0.635, 95% CI 0.599 to 0.669 vs LRB: AUC 0.570, 95% CI 0.535 to 0.601). Similarly, better performances were observed predicting 3- and 5-year survival, as well as 3- and 5-year recurrence, with GBT methods generating higher AUCs. CONCLUSIONS: Machine learning provides powerful tools to create predictive models of survival and recurrence after surgery for CLM. The effectiveness of both machine learning models varies, but on most occasions, GBT outperforms LRB. Prospective validation of these models lays the groundwork to adopt them in clinical practice.