Dual‐stream algorithms for dementia detection: Harnessing structured and unstructured electronic health record data, a novel approach to prevalence estimation
AbstractINTRODUCTIONIdentifying individuals with dementia is crucial for prevalence estimation and service planning, but reliable, scalable methods are lacking. We developed novel set algorithms using both structured and unstructured electronic health record (EHR) data, applying Diagnostic and Statistical Manual of Mental Disorders criteria for dementia case identification.METHODSOur cohort (n = 1082) included individuals aged ≥ 60 with dementia identified through specialist clinics and a comparison group without dementia. Clinicians from Australia and the United States informed predictor selection. We developed algorithms through a biostatistics stream for structured data and a natural language processing (NLP) stream for text, synthesizing results via logistic regression.RESULTSThe final structured model retained 16 variables (area under the receiver operating characteristic curve [AUC] 0.853, specificity 72.2%, sensitivity 80.6%). NLP classifiers (logistic regression, support vector machine, and random forest models) performed comparably. The final, combined model outperformed all others (AUC = 0.951, P < 0.001 for comparison to structured model).DISCUSSIONEmbedding text‐derived insights within algorithms trained on structured medical data significantly enhances dementia identification capacity.Highlights Algorithmic tools for detection of individuals with dementia are available; however, previous work has used heterogeneous case definitions which are not clinically meaningful, and has relied on proxies such as diagnostic codes or medications for case ascertainment. We used a novel, dual‐stream algorithmic development approach, simultaneously and separately modeling a clinically meaningful outcome (diagnosis of dementia according to specialized clinical impression) using structured and unstructured electronic health record datasets. Our clinically grounded case definition supported the inclusion of key structured variables (such as dementia International Classification of Disease codes and medications) as modeling predictors rather than outcomes. Our algorithms, published in detail to support validation and replication, represent a major step forward in the use of routinely collected data for detection of diagnosed dementia.
Pursuing dementia detection for better prevalence estimation with artificial intelligence and traditional modelling techniques in electronic health data
AbstractBackgroundPopulation dementia prevalence is traditionally estimated using cohort studies, surveys, routinely‐collected administrative data, and registries. Hospital Electronic Health Records (EHRs) are comprised of rich structured and unstructured (text) clinical data that are underutilised for this purpose.We aimed to develop a suite of algorithms using routinely‐collected EHR data to reliably identify cases of dementia, as a key step towards incorporating such data in prevalence estimation. Towards this, we developed a novel predictive framework integrating data‐science and biostatistical methods.MethodTraining data were sourced via the National Centre for Healthy Ageing (NCHA) Data Platform, a linked, curated, EHR‐derived data warehouse. Individuals within the platform catchment aged >60 years with confirmed dementia were identified through hospital specialist dementia clinics. A comparison group of individuals aged >60years with EHR records without dementia was recruited from the community.A panel of clinical experts (Neurology, Geriatric Medicine) informed variable and concept selection and guided data cleaning efforts within both streams. Algorithms were developed via two work‐streams; a traditional biostatistical approach to fit logistic regression models using structured data elements, and a data science stream used Natural Language Processing (NLP) to fit models to the unstructured (text) parts of the EHR, for the same individuals.ResultOf 568 individuals (362 with dementia), 434 had clinical notes available. In the data science stream using unstructured data, among a range of NLP derived models, the Random Forest classifier performed best in assigning dementia status, with Area Under the Curve (AUC) 0.95, specificity 90.2% and sensitivity 88.4%. In the biostatistics stream, 15 structured variables were included in the final model, covering demographics, health service attendance, medications, and ICD‐10 Codes, with AUC 0.94, specificity 85.9% and sensitivity 85.6%.ConclusionArtificial intelligence techniques applied to unstructured electronic health data and guided by human clinical expertise may be powerful tools in capturing the presence of dementia, at least comparable to traditional techniques using structured data, and conferring practical and scientific advantages for dementia prevalence estimation. Future validation is required in less crisply delineated real‐world settings.
Association between brain health outcomes and metabolic risk factors in persons with diabetes
AbstractWe performed a cross‐sectional study to determine associations between cognition and MRI‐derived brain outcomes, with obesity, diabetes duration, and metabolic risk factors in 51 Pima American Indians with longstanding type 2 diabetes (T2d) (mean [SD] age: 48.4 [11.3] years, T2d duration: 20.1 [9.1] years). Participants had similar cognition (NIH Toolbox Cognition Battery composite: 45.3 [9.8], p = 0.64, n = 51) compared to normative data. T2d duration, but not other metabolic risk factors, associated with decreased cortical thickness (Point Estimate (PE): −0.0061, 95%CI: −0.0113, −0.0009, n = 45), gray matter volume (PE: −830.39, 95%CI: −1503.14, −157.64, n = 45), and increased white matter hyperintensity volume (PE: 0.0389, 95%CI: 0.0049, 0.0729, n = 45).