Abstract Background Computational phenotyping from electronic health records (EHRs) is essential for clinical research, decision support, and quality/population health assessment, but the proliferation of algorithms for the same conditions makes it difficult to identify which algorithm is most appropriate for reuse. Objective To develop a framework for assessing phenotyping algorithm fitness for purpose and reuse. Fitness for Purpose Phenotyping algorithms are fit for purpose when they identify the intended population with performance characteristics appropriate for the intended application. Fitness for Reuse Phenotyping algorithms are fit for reuse when the algorithm is implementable and generalizable—that is, it identifies the same intended population with similar performance characteristics when applied to a new setting. Conclusions The PhenoFit framework provides a structured approach to evaluate and adapt phenotyping algorithms for new contexts increasing efficiency and consistency of identifying patient populations from EHRs.
Abstract 4361649: Polysocial Risk Scores and Genetic Risk Factors Are Independently and Additively Associated with Cardiometabolic Diseases Across Self-Identified Race/Ethnicity Groups
Background: Susceptibility to cardiometabolic diseases (CDs) is shaped by genetic, socio-environmental, and lifestyle factors. We evaluated the associations of disease-specific polysocial risk scores (PSSs)— derived from social determinants of health (SDOH) and lifestyle factors—and genetic risk factors with six CDs, across self-identified race/ethnicity (SIRE) groups in the eMERGE IV cohort. Methods: The six CDs included: atrial fibrillation, coronary heart disease, chronic kidney disease, hyperlipidemia, obesity, and type 2 diabetes. Disease-specific PSSs were developed using machine-learning models based on 65 SDOH and lifestyle factors. Participants were grouped based on their SIRE as Asian, Black, Hispanic/Latino, and White. We evaluated PSS distributions across SIRE groups. Genetic risk was assessed through disease-specific polygenic risk scores (PRSs), monogenic etiologies, and family history (FamHx). High PSS and high PRS were defined as the top 5th percentile. Associations were tested using multivariable logistic regression; model performance was assessed using the C-statistic. Results: Among 20178 participants (50±15 years, 68% female, 40% non-White), the most frequently associated PSS components were physical activity, sleep, self-perceived health, and income. PSS distributions varied across SIRE groups, with Whites having the lowest and Black and Hispanic/Latinos the highest scores for most CDs (Figure 1). All PSSs were significantly associated with their respective CDs, independent of confounders (OR per 1 SD increase: 1.19–2.68; Figure 2-A). No significant interactions were observed between PSSs and PRSs or monogenic etiologies. However, significant interactions were noted between PSSs and FamHx for CKD and obesity. PSS and PRS effects on the odds of CDs were independent (Figure 2-B) and additive (Figure 2-C). Incorporating PSSs into models that included clinical and genetic risk factors improved predictive performance of risk prediction models (Figure 3). Conclusion: PSSs, reflecting socio-environmental and lifestyle disadvantage, varied significantly across SIRE groups and were associated with risk of six CDs, independent of and additive to PRS. Given the substantial variation in socio-environmental and lifestyle risks across SIRE groups, integrating these factors into risk prediction models for CDs may help address health disparities and enhance preventive efforts, especially in marginalized populations.
Author response: Risk factors affecting polygenic score performance across diverse cohorts
Apart from ancestry, personal or environmental covariates may contribute to differences in polygenic score (PGS) performance. We analyzed the effects of covariate stratification and interaction on body mass index (BMI) PGS (PGS BMI ) across four cohorts of European (N = 491,111) and African (N = 21,612) ancestry. Stratifying on binary covariates and quintiles for continuous covariates, 18/62 covariates had significant and replicable R 2 differences among strata. Covariates with the largest differences included age, sex, blood lipids, physical activity, and alcohol consumption, with R 2 being nearly double between best- and worst-performing quintiles for certain covariates. Twenty-eight covariates had significant PGS BMI –covariate interaction effects, modifying PGS BMI effects by nearly 20% per standard deviation change. We observed overlap between covariates that had significant R 2 differences among strata and interaction effects – across all covariates, their main effects on BMI were correlated with their maximum R 2 differences and interaction effects (0.56 and 0.58, respectively), suggesting high-PGS BMI individuals have highest R 2 and increase in PGS effect. Using quantile regression, we show the effect of PGS BMI increases as BMI itself increases, and that these differences in effects are directly related to differences in R 2 when stratifying by different covariates. Given significant and replicable evidence for context-specific PGS BMI performance and effects, we investigated ways to increase model performance taking into account nonlinear effects. Machine learning models (neural networks) increased relative model R 2 (mean 23%) across datasets. Finally, creating PGS BMI directly from GxAge genome-wide association studies effects increased relative R 2 by 7.8%. These results demonstrate that certain covariates, especially those most associated with BMI, significantly affect both PGS BMI performance and effects across diverse cohorts and ancestries, and we provide avenues to improve model performance that consider these effects.
Multiplicative Impact of Adverse Social Determinants of Health on Outcomes in Lupus Nephritis: A Meta‐analysis and Systematic Review
Objective Social determinants of health (SDoH) likely contribute to outcome disparities in lupus nephritis (LN). Understanding the overall burden and contribution of each domain could guide future health equity–focused interventions to improve outcomes and reduce disparities in LN. Objectives of this meta‐analysis were to 1) determine the association of overall SDoH and specific SDoH domains on LN outcomes and 2) develop a framework for the multidimensional impact of SDoH on LN outcomes. Methods We performed a comprehensive search of studies measuring associations between SDoH and LN outcomes. We examined pooled odds of poor LN outcomes including death, end‐stage kidney disease, or cardiovascular disease in patients with and without adverse SDoH. Additionally, we calculated the pooled odds ratios of outcomes by four SDoH domains: individual (eg, insurance), health care (eg, fragmented care), community (eg, neighborhood socioeconomic status), and health behaviors (eg, smoking). Results Among 531 screened studies, 31 meeting inclusion criteria and 13 with raw data were included in meta‐analysis. Pooled odds of poor outcomes were 1.47‐fold higher in patients with any adverse SDoH. Patients with adverse SDoH in individual and health care domains had 1.64‐fold and 1.77‐fold higher odds of poor outcomes. We found a multiplicative impact of having two or more adverse SDoH on LN outcomes. Black patients with public insurance and fragmented care had 12‐fold higher odds of poor LN outcomes. Conclusion Adverse SDoH is associated with poor LN outcomes. Having two or more adverse SDoH, specifically in different SDoH domains, had a multiplicative impact leading to worse LN outcomes, widening disparities. image
Advanced Age in Humans and Mouse Models of Glioblastoma Show Decreased Survival from Extratumoral Influence
Abstract Purpose: Glioblastoma (GBM) is the most common aggressive primary malignant brain tumor in adults with a median age of onset of 68 to 70 years old. Although advanced age is often associated with poorer GBM patient survival, the predominant source(s) of maladaptive aging effects remains to be established. Here, we studied intratumoral and extratumoral relationships between adult patients with GBM and mice with brain tumors across the lifespan. Experimental Design: Electronic health records at Northwestern Medicine and the NCI SEER databases were evaluated for GBM patient age and overall survival. The commercial Tempus and Caris databases, as well as The Cancer Genome Atlas were profiled for gene expression, DNA methylation, and mutational changes with varying GBM patient age. In addition, gene expression analysis was performed on the extratumoral brain of younger and older adult mice with or without a brain tumor. The survival of young and old wild-type or transgenic (INK-ATTAC) mice with a brain tumor was evaluated after treatment with or without senolytics and/or immunotherapy. Results: Human patients with GBM ≥65 years of age had a significantly decreased survival compared with their younger counterparts. While the intra-GBM molecular profiles were similar between younger and older patients with GBM, non-tumor brain tissue had a significantly different gene expression profile between young and old mice with a brain tumor and the eradication of senescent cells improved immunotherapy-dependent survival of old but not young mice. Conclusions: This work suggests a potential benefit for combining senolytics with immunotherapy in older patients with GBM.
Risk factors affecting polygenic score performance across diverse cohorts
Apart from ancestry, personal or environmental covariates may contribute to differences in polygenic score (PGS) performance. We analyzed the effects of covariate stratification and interaction on body mass index (BMI) PGS (PGS BMI ) across four cohorts of European (N = 491,111) and African (N = 21,612) ancestry. Stratifying on binary covariates and quintiles for continuous covariates, 18/62 covariates had significant and replicable R 2 differences among strata. Covariates with the largest differences included age, sex, blood lipids, physical activity, and alcohol consumption, with R 2 being nearly double between best- and worst-performing quintiles for certain covariates. Twenty-eight covariates had significant PGS BMI –covariate interaction effects, modifying PGS BMI effects by nearly 20% per standard deviation change. We observed overlap between covariates that had significant R 2 differences among strata and interaction effects – across all covariates, their main effects on BMI were correlated with their maximum R 2 differences and interaction effects (0.56 and 0.58, respectively), suggesting high-PGS BMI individuals have highest R 2 and increase in PGS effect. Using quantile regression, we show the effect of PGS BMI increases as BMI itself increases, and that these differences in effects are directly related to differences in R 2 when stratifying by different covariates. Given significant and replicable evidence for context-specific PGS BMI performance and effects, we investigated ways to increase model performance taking into account nonlinear effects. Machine learning models (neural networks) increased relative model R 2 (mean 23%) across datasets. Finally, creating PGS BMI directly from GxAge genome-wide association studies effects increased relative R 2 by 7.8%. These results demonstrate that certain covariates, especially those most associated with BMI, significantly affect both PGS BMI performance and effects across diverse cohorts and ancestries, and we provide avenues to improve model performance that consider these effects.
Characterizing variability of electronic health record-driven phenotype definitions
AbstractObjectiveThe aim of this study was to analyze a publicly available sample of rule-based phenotype definitions to characterize and evaluate the variability of logical constructs used.Materials and MethodsA sample of 33 preexisting phenotype definitions used in research that are represented using Fast Healthcare Interoperability Resources and Clinical Quality Language (CQL) was analyzed using automated analysis of the computable representation of the CQL libraries.ResultsMost of the phenotype definitions include narrative descriptions and flowcharts, while few provide pseudocode or executable artifacts. Most use 4 or fewer medical terminologies. The number of codes used ranges from 5 to 6865, and value sets from 1 to 19. We found that the most common expressions used were literal, data, and logical expressions. Aggregate and arithmetic expressions are the least common. Expression depth ranges from 4 to 27.DiscussionDespite the range of conditions, we found that all of the phenotype definitions consisted of logical criteria, representing both clinical and operational logic, and tabular data, consisting of codes from standard terminologies and keywords for natural language processing. The total number and variety of expressions are low, which may be to simplify implementation, or authors may limit complexity due to data availability constraints.ConclusionsThe phenotype definitions analyzed show significant variation in specific logical, arithmetic, and other operators but are all composed of the same high-level components, namely tabular data and logical expressions. A standard representation for phenotype definitions should support these formats and be modular to support localization and shared logic.