Moon, Sungrim

AbstractAn increasing number of studies have reported using natural language processing (NLP) to assist observational research by extracting clinical information from electronic health records (EHRs). Currently, no standardized reporting guidelines for NLP‐assisted observational studies exist. The absence of detailed reporting guidelines may create ambiguity in the use of NLP‐derived content, knowledge gaps in the current research reporting practices, and reproducibility challenges. To address these issues, we conducted a scoping review of NLP‐assisted observational clinical studies and examined their reporting practices, focusing on NLP methodology and evaluation. Through our investigation, we discovered a high variation regarding the reporting practices, such as inconsistent use of references for measurement studies, variation in the reporting location (reference, appendix, and manuscript), and different granularity of NLP methodology and evaluation details. To promote the wide adoption and utilization of NLP solutions in clinical research, we outline several perspectives that align with the six principles released by the World Health Organization (WHO) that guide the ethical use of artificial intelligence for health.

PURPOSEThe advancement of natural language processing (NLP) has promoted the use of detailed textual data in electronic health records (EHRs) to support cancer research and to facilitate patient care. In this review, we aim to assess EHR for cancer research and patient care by using the Minimal Common Oncology Data Elements (mCODE), which is a community-driven effort to define a minimal set of data elements for cancer research and practice. Specifically, we aim to assess the alignment of NLP-extracted data elements with mCODE and review existing NLP methodologies for extracting said data elements.METHODSPublished literature studies were searched to retrieve cancer-related NLP articles that were written in English and published between January 2010 and September 2020 from main literature databases. After the retrieval, articles with EHRs as the data source were manually identified. A charting form was developed for relevant study analysis and used to categorize data including four main topics: metadata, EHR data and targeted cancer types, NLP methodology, and oncology data elements and standards.RESULTSA total of 123 publications were selected finally and included in our analysis. We found that cancer research and patient care require some data elements beyond mCODE as expected. Transparency and reproductivity are not sufficient in NLP methods, and inconsistency in NLP evaluation exists.CONCLUSIONWe conducted a comprehensive review of cancer NLP for research and patient care using EHRs data. Issues and barriers for wide adoption of cancer NLP were identified and discussed.

Abstract Objective Determine if information regarding hypertrophic cardiomyopathy (HCM) can be accurately retrieved from cardiac magnetic resonance (CMR) reports using natural language processing (NLP). Background CMR imaging is used for diagnosis and risk stratification of HCM. Manual annotation of information from CMR is time-consuming. NLP is an artificial intelligence method for automating extraction of information from narrative text. Methods We identified 200 HCM patients who had CMR reports from 1998 to 2018. These patients were randomly allocated into training (100 patients with 185 CMR reports) and testing sets (100 patients with 206 reports). An NLP system with 2 tiers was developed; the first extracted information regarding HCM diagnosis while second extracted categorical or numeric concepts for HCM classification. NLP performance was compared with gold-standard manual annotation. Results NLP algorithms achieved very high performance across all concepts with mean positive predictive value (PPV) = 0.96. An outlier was the performance for abstracting the presence of an apical pouch from CMR reports, which had noticeably lower PPV= 0.78 which be attributed to the low number of cases with this finding. Conclusions The algorithms developed can be translated to clinical decision support systems to increase efficiency and contribute to improved quality of care. Funding Acknowledgement Type of funding source: Other. Main funding source(s): Study supported by the National Heart, Lung and Blood Institute of National Institutes of Health (K01HL124045), the Mayo Clinic Center for Clinical and Translational Science (CCaTS), and the Mayo Clinic K2R award. Content is solely the responsibility of authors and does not necessarily represent official views of the National Institutes of Health.

Background Automated individualized risk prediction tools linked to electronic health records ( EHR s) are not available for management of patients with peripheral arterial disease. The goal of this study was to create a prognostic tool for patients with peripheral arterial disease using data elements automatically extracted from an EHR to enable real‐time and individualized risk prediction at the point of care. Methods and Results A previously validated phenotyping algorithm was deployed to an EHR linked to the Rochester Epidemiology Project to identify peripheral arterial disease cases from Olmsted County, MN, for the years 1998 to 2011. The study cohort was composed of 1676 patients: 593 patients died over 5‐year follow‐up. The c‐statistic for survival in the overall data set was 0.76 (95% confidence interval [CI], 0.74–0.78), and the c‐statistic across 10 cross‐validation data sets was 0.75 (95% CI, 0.73–0.77). Stratification of cases demonstrated increasing mortality risk by subgroup (low: hazard ratio, 0.35 [95% CI, 0.21–0.58]; intermediate‐high: hazard ratio, 2.98 [95% CI, 2.37–3.74]; high: hazard ratio, 8.44 [95% CI, 6.66–10.70], all P <0.0001 versus the reference subgroup). An equation for risk calculation was derived from Cox model parameters and β estimates. Big data infrastructure enabled deployment of the real‐time risk calculator to the point of care via the EHR . Conclusions This study demonstrates that electronic tools can be deployed to EHR s to create automated real‐time risk calculators to predict survival of patients with peripheral arterial disease. Moreover, the prognostic model developed may be translated to patient care as an automated and individualized real‐time risk calculator deployed at the point of care.