Convergent and criterion validity of a computer adaptive self‐administered word list memory test and the Mayo Test Drive composite: correlations with traditional measures and group difference by PET imaging biomarker status in persons without dementia.
AbstractBackgroundMayo Test Drive (MTD): Test Development through Rapid Iteration, Validation and Expansion, is a web‐based platform optimized for remote self‐administered assessment that includes a computer adaptive word list memory test (Stricker Learning Span; SLS) and a measure of processing speed (Symbols Test). Study aims were to determine 1) convergent validity of MTD through correlations with in‐person neuropsychological measures and 2) criterion validity of MTD by qualitatively comparing the ability of Mayo Test Drive and in‐person administered neuropsychological measures to differentiate biomarker‐defined groups, independent of clinical diagnosis.MethodsMayo Clinic Study of Aging participants (N = 282) completed a brief remote cognitive assessment (mean age = 74, SD = 12; 262 CU and 20 MCI per consensus conference diagnosis; see Table 1). A subset of participants had brain amyloid and/or brain tau PET scans available within 3 years; overlapping groups were formed for 1) those on the Alzheimer’s disease (AD) continuum (A+, n = 31) or not (A‐, n = 57) and for 2) those with biological AD (A+T+, n = 19) or without any AD biomarkers (A‐T‐, n = 47). Primary outcome variables were SLS sum of trials, AVLT sum of trials, SYM Correct Trials response time, Digit Symbol Coding, MTD composite and Mayo‐PACC (AVLT sum of trials, Trails B, animals). Bivariate correlations were performed across all participants. Linear model ANOVAs were used to investigate biomarker subgroup differences; Hedge’s g effect sizes are reported.ResultsConvergent validity was supported through significant correlation (p’s < .001) of SLS and AVLT (r = .63), SYM and Coding (r = ‐.64), and MTD composite with Mayo‐PACC (r = .67); see Table 2. MTD subtests showed expected relationships with age and education (p’s < .05; Table 3). All MTD performances were significantly lower for A+ and A+T+ participants relative to A‐ or A‐T‐ (p’s<.001; Table 4). All MTD outcome measures showed a similar or greater group difference effect size relative to traditional in‐person administered neuropsychological measures for separating A+ vs. A‐ and A+T+ vs. A‐T‐ groups. See Figure 1 and Table 4.ConclusionsMTD subtests show evidence of convergent validity through strong correlations with traditional in‐person cognitive measures. Preliminary analyses suggest MTD has promise for differentiating PET biomarker groups.
Diagnostic accuracy of the Stricker Learning Span and Mayo Test Drive Composite for amnestic Mild Cognitive Impairment.
AbstractBackgroundRemote assessment tools offer significant promise for aiding early detection of cognitive impairment. Mayo Test Drive (MTD): Test Development through Rapid Iteration, Validation and Expansion, is a web‐based platform for remote self‐administered assessment that includes a computer adaptive word list memory test (Stricker Learning Span; SLS) and a measure of processing speed (Symbols Test). We examined the diagnostic accuracy of the SLS and a MTD composite (SLS max span, SLS trials 1–5 total correct, SLS delay correct, [Symbols correct item response time*‐1]) for amnestic mild cognitive impairment (aMCI). We also explored diagnostic accuracy for a broader group that included individuals with possible MCI (pMCI; see Figure 1).MethodsParticipants were recruited from the Mayo Clinic Study of Aging for this ancillary remote study. 226 were cognitively unimpaired (CU; concordant CU diagnosis by 3 independent raters). Fifty‐six participants had possible MCI (at least 1 of 3 raters indicated MCI) and 16 had a consensus diagnosis of aMCI. Primary outcome variables were SLS sum of trials, AVLT sum of trials, Symbols correct items response time, and MTD composite. Mean difference analyses used linear model ANOVAs (alpha = .05). Receiver operating characteristic (ROC) curves were applied; we derived optimal cutoff scores based on the Youden index method.ResultsBoth aMCI and possible MCI groups showed significantly lower performance than the CU group on SLS (Hedge’s g aMCI = ‐1.72, pMCI = ‐1.04), Symbols (Hedge’s g aMCI = 1.38, pMCI = 0.64), and MTD composite (Hedge’s g aMCI = ‐1.89, pMCI = ‐1.09); see Tables 1 and 2 (all p‘s<.01 even when additionally covarying age, education, sex). Total area under the curve was high for differentiating of CU vs. aMCI (MTD Composite = 0.91, SLS = 0.91) and acceptable for CU vs. pMCI (MTD Composite = 0.77, SLS = 0.77); see Table 2. Consistent with our flexible platform, a variety of device types were used to complete remote testing (32% smartphone, 12% tablet, 56% PC).ConclusionsMTD and the SLS show high diagnostic accuracy for aMCI. MTD is a flexible, brief, and easy‐to‐use remote cognitive assessment tool with great potential for scalable use in future studies seeking to maximize inclusion of individuals with aMCI in clinical trials or for cognitive screening in clinical settings.
An examination of the usability of the Mayo Test Drive remote cognitive testing platform in older adults with and without cognitive impairment
AbstractBackgroundMayo Test Drive (MTD): Test Development through Rapid Iteration, Validation and Expansion, is a web‐based platform for self‐administered assessment for novel (Stricker Learning Span) and open access (Symbols Test) cognitive measures with previously demonstrated validity and reliability. Our study aim was to examine the usability of MTD, defined as the extent to which MTD was used to achieve the desired study goal of completing a testing session among participants willing to engage in an all‐remote study.Methods248 Mayo Clinic Study of Aging and Mayo Alzheimer’s Disease Research Center participants were invited to participate in this ancillary, uncompensated remote pilot study via email. To examine 1) willingness to participate in a remote cognitive assessment study and 2) usability of MTD, the initiation and completion rates of MTD were examined by cognitively unimpaired (CU; n = 142) and cognitively impaired (CI; n = 106) groups (see Figure 1). These rates and other factors associated with MTD feasibility were further explored across age in CU (i.e., 50–69, 70–79, and 80+ years) and specific diagnostic groups in CI (i.e., individuals with dementia, mild cognitive impairment (MCI), and possible MCI).ResultsSession completion rate (usability) was 98% across all participants who chose to participate, and, surprisingly, completion rates did not vary by age or diagnostic groups (p = .69; see Table 1). As expected, more individuals chose to participate in the CU (77%) versus CI (52%) group (p < .001). In terms of feasibility, individuals over 80 and with CI were more likely to have some contact with the study coordinator. Use of smartphones decreased with age, with most CU individuals over 70 using a personal computer (69‐73%; Table 2).ConclusionsThough the CI group was less likely to choose to participate than the CU group, out of those that did choose to participate the rate of completion was 98%. This demonstrates high usability of MTD. Study coordinator support and a flexible testing platform is critical for facilitating participation in remote testing across the aging population, and more supports and incentives may be needed for individuals with cognitive impairment to improve participation rates.
Gait Correlates of Cognitive Function and Future Decline
AbstractBackgroundSlow walking speed is associated with numerous negative health outcomes including global cognitive decline.1 More detailed gait analysis can differentiate among different dementia subtypes,10 but the predictive power of baseline gait metrics for domain‐specific cognitive decline needs further characterization.MethodWe conducted a follow up study on 534 participants of the Mayo Clinic Study of Aging who underwent evaluations every 15 months (median follow‐up = 5.4 years). We analyzed quantitative gait metrics, acquired with a pressure‐sensing walkway (GAITRite® instrument), and cognitive scores using a linear mixed effects model to identify correlations between z‐scored baseline gait metrics (cadence, swing time, stance time, velocity, double support time (DST), stride length, stride length standard deviation (SD), stride time SD, swing time SD, stance time SD, DST SD) and cognitive domain z‐scores (memory, attention, language, visuospatial, global) at baseline and over time. Models controlled for age, sex, and probable REM sleep behavior disorder at baseline.ResultThe table includes both baseline associations and difference in slopes (Δ), relative to the average person, in cognitive domains. These slopes ranged from about ‐0.05 for visuospatial to ‐0.12 for attention.ConclusionIncreased gait velocity and stride length are associated with less severe domain‐specific and global cognitive decline while increased swing time SD and DST are associated with more severe rates of decline in some domains. These findings suggest that baseline gait characteristics could be a helpful predictor of future cognitive changes.References:1. Savica R, Wennberg AMV, Hagen C, et al. Comparison of Gait Parameters for Predicting Cognitive Decline: The Mayo Clinic Study of Aging. Journal of Alzheimer's disease : JAD. 2017;55(2):559. doi:10.3233/JAD‐1606972. Mc Ardle R, del Din S, Galna B, Thomas A, Rochester L. Differentiating dementia disease subtypes with gait analysis: feasibility of wearable sensors? Gait & Posture. 2020;76:372–376. doi:10.1016/j.gaitpost.2019.12.028
Identification of Novel Modifiers of Tau Aggregation and Pathology using a Proximity Proteomics Approach
AbstractBackgroundAlzheimer's disease (AD) and related neurodegenerative diseases are characterized by the accumulation of abnormal protein aggregates. A defining hallmark of AD is the formation of neurofibrillary tangles (NFTs) by aggregation of the microtubule‐associated protein tau into pathological oligomers and fibrils. Although NFTs are believed to play a pivotal role in the disease process, we have a poor understanding of how their formation, toxicity, and spread across brain regions is regulated. Recent data suggest that the seeding behavior of tau is governed by patterns of posttranslational modifications and varying filament structures. Understanding how tau‐associated proteins regulate the oligomerization, pathological accumulation, and seeding of tau in affected neurons and glia is of critical importance for therapy development.MethodTo profile the interactome of tau aggregates, we have established proximity‐dependent biotin‐identification (BioID) as a novel method to identify the composition and proximal molecular environment of insoluble protein aggregates in the context of living brain cells and tissue. Using an in vitro and ex vivo model approach coupled with mass spectrometry, we are generating datasets containing top identified proteins, stratified based on significance and molecular pathway. Once we validate their co‐localization with NFTs in the context of human AD pathology, functional characterization of putative modifiers will be performed to assess their impact on tau‐aggregate and toxicity.ResultTo determine the physiological and aggregate specific interacting partners of tau, we are comparing wild type tau (TauWT) with mutant tau (Tau3xMUT) carrying three tauopathy‐associated mutations (A152T/P301L/S320F) that form hyper‐phosphorylated and thioflavin S‐positive aggregates even in the absence of seeding. The proteomic analysis from our pilot study revealed that significantly changed proteins included candidates involved in RNA processing, as well as protein ubiquitination and proteasome degradation.ConclusionThis study provides novel insights into cellular pathways and molecular mechanisms of neurodegeneration, by identifying in the context of living neurons and brain tissue different functional classes of tau‐associated proteins with relevance for AD pathophysiology. These are expected to include proteins that may mediate the toxic effect of NFTs, facilitate the formation or degradation of pathological tau aggregates, and catalyze posttranslational modifications of tau oligomers and associated proteins.
AD‐causing variants that affect PSEN1 transmembrane domains are associated with faster neurodegeneration and cognitive decline compared to those affecting cytoplasmic domains
AbstractBackgroundRates of cognitive and biomarker change in Autosomal Dominant Alzheimer disease (ADAD) vary substantially across individuals. Prior cross‐sectional work suggests that the location of the pathogenic variant within PSEN1, specifically whether the underlying variant affects transmembrane (TM) or cytoplasmic (CY) domains in PSEN1, may be a key determinant in these differential rates of progression. Here we use longitudinal data from the Dominantly Inherited Alzheimer Network observational study (DIAN‐Obs) to examine whether variants affecting TM versus CY domains in PSEN1 have differential rates of change in key cognitive and neurodegenerative markers, and whether these differences are relevant to ADAD clinical trials.MethodsUsing longitudinal clinical, cognitive, and MRI data from PSEN1 pathogenic variant carriers [TM group N=76 and CY group N=44; Table 1], we assessed rates of change in Mini‐Mental State Exam (MMSE), Clinical Dementia Rating® Sum of Boxes (CDR®‐SOB), and hippocampal volume (HV) using linear mixed effects models accounting for disease stage (estimated years to symptom onset [EYO]). We further assessed how PSEN1 mutation location (TM versus CY) impacts sample size and detectable effect size in a potential ADAD clinical trial (modeled as a 4‐year trial with annual assessments; 80% power; α = 0.05).ResultsPSEN1 TM and PSEN1 CY groups did not differ on baseline age, EYO, or CDR®. The PSEN1 TM group had significantly greater rates of change on MMSE (B[SE] = ‐0.42[0.1], p=0.002), CDR®‐SOB (B[SE] = 0.23[0.1], p=0.001), and HV atrophy (B[SE] = ‐58.93[14.3], p=0.0006 compared to the PSEN1 CY group (Fig.1). Consistent with these differential rates of change, power analyses indicated the required sample size to detect a 30% treatment effect on MMSE or HV would be reduced by 59.6% for MMSE and 91.0% for HV for a trial population comprised of PSEN1 TM versus CY carriers (Fig.2).ConclusionsIndividuals who had a variant affecting the transmembrane domains of PSEN1 had greater rates of cognitive decline and neurodegeneration compared to those with variants affecting cytoplasmic domains. In addition to having implications for ADAD pathophysiology, these results suggest that incorporating information regarding the location of PSEN1 variants may be beneficial in analyzing and designing stratification approaches for ADAD trials.
AD‐causing variants that affect PSEN1 transmembrane domains are associated with faster neurodegeneration and cognitive decline compared to those affecting cytoplasmic domains.
AbstractBackgroundRates of cognitive and biomarker change in Autosomal Dominant Alzheimer disease (ADAD) vary substantially across individuals. Prior cross‐sectional work suggests that the location of the pathogenic variant within PSEN1, specifically whether the underlying variant affects transmembrane (TM) or cytoplasmic (CY) domains in PSEN1, may be a key determinant in these differential rates of progression. Here we use longitudinal data from the Dominantly Inherited Alzheimer Network observational study (DIAN‐Obs) to examine whether variants affecting TM versus CY domains in PSEN1 have differential rates of change in key cognitive and neurodegenerative markers, and whether these differences are relevant to ADAD clinical trials.MethodsUsing longitudinal clinical, cognitive, and MRI data from PSEN1 pathogenic variant carriers [TM group N=76 and CY group N=44; Table 1], we assessed rates of change in Mini‐Mental State Exam (MMSE), Clinical Dementia Rating® Sum of Boxes (CDR®‐SOB), and hippocampal volume (HV) using linear mixed effects models accounting for disease stage (estimated years to symptom onset [EYO]). We further assessed how PSEN1 mutation location (TM versus CY) impacts sample size and detectable effect size in a potential ADAD clinical trial (modeled as a 4‐year trial with annual assessments; 80% power; α = 0.05).Results PSEN1 TM and PSEN1 CY groups did not differ on baseline age, EYO, or CDR®. The PSEN1 TM group had significantly greater rates of change on MMSE (B[SE] = ‐0.42[0.1], p=0.002), CDR®‐SOB (B[SE] = 0.23[0.1], p=0.001), and HV atrophy (B[SE] = ‐58.93[14.3], p=0.0006 compared to the PSEN1 CY group (Fig.1). Consistent with these differential rates of change, power analyses indicated the required sample size to detect a 30% treatment effect on MMSE or HV would be reduced by 59.6% for MMSE and 91.0% for HV for a trial population comprised of PSEN1 TM versus CY carriers (Fig.2).ConclusionsIndividuals who had a variant affecting the transmembrane domains of PSEN1 had greater rates of cognitive decline and neurodegeneration compared to those with variants affecting cytoplasmic domains. In addition to having implications for ADAD pathophysiology, these results suggest that incorporating information regarding the location of PSEN1 variants may be beneficial in analyzing and designing stratification approaches for ADAD trials.
An examination of the usability of the Mayo Test Drive remote cognitive testing platform in older adults with and without cognitive impairment
AbstractBackgroundMayo Test Drive (MTD): Test Development through Rapid Iteration, Validation and Expansion, is a web‐based platform for self‐administered assessment for novel (Stricker Learning Span) and open access (Symbols Test) cognitive measures with previously demonstrated validity and reliability. Our study aim was to examine the usability of MTD, defined as the extent to which MTD was used to achieve the desired study goal of completing a testing session among participants willing to engage in an all‐remote study.Methods248 Mayo Clinic Study of Aging and Mayo Alzheimer’s Disease Research Center participants were invited to participate in this ancillary, uncompensated remote pilot study via email. To examine 1) willingness to participate in a remote cognitive assessment study and 2) usability of MTD, the initiation and completion rates of MTD were examined by cognitively unimpaired (CU; n = 142) and cognitively impaired (CI; n = 106) groups (see Figure 1). These rates and other factors associated with MTD feasibility were further explored across age in CU (i.e., 50‐69, 70‐79, and 80+ years) and specific diagnostic groups in CI (i.e., individuals with dementia, mild cognitive impairment (MCI), and possible MCI).ResultsSession completion rate (usability) was 98% across all participants who chose to participate, and, surprisingly, completion rates did not vary by age or diagnostic groups (p =.69; see Table 1). As expected, more individuals chose to participate in the CU (77%) versus CI (52%) group (p < .001). In terms of feasibility, individuals over 80 and with CI were more likely to have some contact with the study coordinator. Use of smartphones decreased with age, with most CU individuals over 70 using a personal computer (69‐73%; Table 2).ConclusionsThough the CI group was less likely to choose to participate than the CU group, out of those that did choose to participate the rate of completion was 98%. This demonstrates high usability of MTD. Study coordinator support and a flexible testing platform is critical for facilitating participation in remote testing across the aging population, and more supports and incentives may be needed for individuals with cognitive impairment to improve participation rates.
Paging the Clinical Informatics Community: Respond STAT to Dobbs v. Jackson's Women's Health Organization
Abstract Purpose: IgM monoclonal gammopathy of undetermined significance (MGUS) and Waldenström macroglobulinemia (WM) represent a disease spectrum with highly varied therapeutic management, ranging from observation to chemoimmunotherapy. The current classification relies solely on clinical features and does not explain the heterogeneity that exists within each of these conditions. Further investigation is warranted to shed light on the biology that may account for the clinical differences. Experimental Design: We used bone marrow (BM) clonal CD19+ and/or CD138+ sorted cells, matched BM supernatant, and peripheral blood serum from 32 patients (7 MGUS, 25 WM) to perform the first multi-omics approach including whole-exome sequencing, RNA sequencing, proteomics, metabolomics, and mass cytometry. Results: We identified three clusters with distinct pathway activation, immune content, metabolomic, and clinical features. Cluster 1 included only patients with WM and was characterized by transcriptional silencing of genes involved in cell cycle and immune response, enrichment of mitochondrial metabolism, infiltration of senescent T effector memory cells, and aggressive clinical behavior. Genetic/structural alterations of TNFAIP3 were distinct events of this cluster. Cluster 2 comprised both MGUS and WM patients with upregulation of inflammatory response, senescence and glycolysis signatures, increased activated T follicular helper and T regulatory cells, and indolent clinical behavior. Cluster 3 also included both MGUS and WM patients and exhibited intermediate features, including proliferative and inflammatory signaling, as well as glycolysis and mitochondrial metabolism. Conclusions: We have identified three distinct molecular clusters, suggesting a potential biologic classification that may have therapeutic implications.