Convergent and criterion validity of a computer adaptive self‐administered word list memory test and the Mayo Test Drive composite: correlations with traditional measures and group difference by PET imaging biomarker status in persons without dementia.
AbstractBackgroundMayo Test Drive (MTD): Test Development through Rapid Iteration, Validation and Expansion, is a web‐based platform optimized for remote self‐administered assessment that includes a computer adaptive word list memory test (Stricker Learning Span; SLS) and a measure of processing speed (Symbols Test). Study aims were to determine 1) convergent validity of MTD through correlations with in‐person neuropsychological measures and 2) criterion validity of MTD by qualitatively comparing the ability of Mayo Test Drive and in‐person administered neuropsychological measures to differentiate biomarker‐defined groups, independent of clinical diagnosis.MethodsMayo Clinic Study of Aging participants (N = 282) completed a brief remote cognitive assessment (mean age = 74, SD = 12; 262 CU and 20 MCI per consensus conference diagnosis; see Table 1). A subset of participants had brain amyloid and/or brain tau PET scans available within 3 years; overlapping groups were formed for 1) those on the Alzheimer’s disease (AD) continuum (A+, n = 31) or not (A‐, n = 57) and for 2) those with biological AD (A+T+, n = 19) or without any AD biomarkers (A‐T‐, n = 47). Primary outcome variables were SLS sum of trials, AVLT sum of trials, SYM Correct Trials response time, Digit Symbol Coding, MTD composite and Mayo‐PACC (AVLT sum of trials, Trails B, animals). Bivariate correlations were performed across all participants. Linear model ANOVAs were used to investigate biomarker subgroup differences; Hedge’s g effect sizes are reported.ResultsConvergent validity was supported through significant correlation (p’s < .001) of SLS and AVLT (r = .63), SYM and Coding (r = ‐.64), and MTD composite with Mayo‐PACC (r = .67); see Table 2. MTD subtests showed expected relationships with age and education (p’s < .05; Table 3). All MTD performances were significantly lower for A+ and A+T+ participants relative to A‐ or A‐T‐ (p’s<.001; Table 4). All MTD outcome measures showed a similar or greater group difference effect size relative to traditional in‐person administered neuropsychological measures for separating A+ vs. A‐ and A+T+ vs. A‐T‐ groups. See Figure 1 and Table 4.ConclusionsMTD subtests show evidence of convergent validity through strong correlations with traditional in‐person cognitive measures. Preliminary analyses suggest MTD has promise for differentiating PET biomarker groups.
Diagnostic accuracy of the Stricker Learning Span and Mayo Test Drive Composite for amnestic Mild Cognitive Impairment.
AbstractBackgroundRemote assessment tools offer significant promise for aiding early detection of cognitive impairment. Mayo Test Drive (MTD): Test Development through Rapid Iteration, Validation and Expansion, is a web‐based platform for remote self‐administered assessment that includes a computer adaptive word list memory test (Stricker Learning Span; SLS) and a measure of processing speed (Symbols Test). We examined the diagnostic accuracy of the SLS and a MTD composite (SLS max span, SLS trials 1–5 total correct, SLS delay correct, [Symbols correct item response time*‐1]) for amnestic mild cognitive impairment (aMCI). We also explored diagnostic accuracy for a broader group that included individuals with possible MCI (pMCI; see Figure 1).MethodsParticipants were recruited from the Mayo Clinic Study of Aging for this ancillary remote study. 226 were cognitively unimpaired (CU; concordant CU diagnosis by 3 independent raters). Fifty‐six participants had possible MCI (at least 1 of 3 raters indicated MCI) and 16 had a consensus diagnosis of aMCI. Primary outcome variables were SLS sum of trials, AVLT sum of trials, Symbols correct items response time, and MTD composite. Mean difference analyses used linear model ANOVAs (alpha = .05). Receiver operating characteristic (ROC) curves were applied; we derived optimal cutoff scores based on the Youden index method.ResultsBoth aMCI and possible MCI groups showed significantly lower performance than the CU group on SLS (Hedge’s g aMCI = ‐1.72, pMCI = ‐1.04), Symbols (Hedge’s g aMCI = 1.38, pMCI = 0.64), and MTD composite (Hedge’s g aMCI = ‐1.89, pMCI = ‐1.09); see Tables 1 and 2 (all p‘s<.01 even when additionally covarying age, education, sex). Total area under the curve was high for differentiating of CU vs. aMCI (MTD Composite = 0.91, SLS = 0.91) and acceptable for CU vs. pMCI (MTD Composite = 0.77, SLS = 0.77); see Table 2. Consistent with our flexible platform, a variety of device types were used to complete remote testing (32% smartphone, 12% tablet, 56% PC).ConclusionsMTD and the SLS show high diagnostic accuracy for aMCI. MTD is a flexible, brief, and easy‐to‐use remote cognitive assessment tool with great potential for scalable use in future studies seeking to maximize inclusion of individuals with aMCI in clinical trials or for cognitive screening in clinical settings.
An examination of the usability of the Mayo Test Drive remote cognitive testing platform in older adults with and without cognitive impairment
AbstractBackgroundMayo Test Drive (MTD): Test Development through Rapid Iteration, Validation and Expansion, is a web‐based platform for self‐administered assessment for novel (Stricker Learning Span) and open access (Symbols Test) cognitive measures with previously demonstrated validity and reliability. Our study aim was to examine the usability of MTD, defined as the extent to which MTD was used to achieve the desired study goal of completing a testing session among participants willing to engage in an all‐remote study.Methods248 Mayo Clinic Study of Aging and Mayo Alzheimer’s Disease Research Center participants were invited to participate in this ancillary, uncompensated remote pilot study via email. To examine 1) willingness to participate in a remote cognitive assessment study and 2) usability of MTD, the initiation and completion rates of MTD were examined by cognitively unimpaired (CU; n = 142) and cognitively impaired (CI; n = 106) groups (see Figure 1). These rates and other factors associated with MTD feasibility were further explored across age in CU (i.e., 50–69, 70–79, and 80+ years) and specific diagnostic groups in CI (i.e., individuals with dementia, mild cognitive impairment (MCI), and possible MCI).ResultsSession completion rate (usability) was 98% across all participants who chose to participate, and, surprisingly, completion rates did not vary by age or diagnostic groups (p = .69; see Table 1). As expected, more individuals chose to participate in the CU (77%) versus CI (52%) group (p < .001). In terms of feasibility, individuals over 80 and with CI were more likely to have some contact with the study coordinator. Use of smartphones decreased with age, with most CU individuals over 70 using a personal computer (69‐73%; Table 2).ConclusionsThough the CI group was less likely to choose to participate than the CU group, out of those that did choose to participate the rate of completion was 98%. This demonstrates high usability of MTD. Study coordinator support and a flexible testing platform is critical for facilitating participation in remote testing across the aging population, and more supports and incentives may be needed for individuals with cognitive impairment to improve participation rates.
An examination of the usability of the Mayo Test Drive remote cognitive testing platform in older adults with and without cognitive impairment
AbstractBackgroundMayo Test Drive (MTD): Test Development through Rapid Iteration, Validation and Expansion, is a web‐based platform for self‐administered assessment for novel (Stricker Learning Span) and open access (Symbols Test) cognitive measures with previously demonstrated validity and reliability. Our study aim was to examine the usability of MTD, defined as the extent to which MTD was used to achieve the desired study goal of completing a testing session among participants willing to engage in an all‐remote study.Methods248 Mayo Clinic Study of Aging and Mayo Alzheimer’s Disease Research Center participants were invited to participate in this ancillary, uncompensated remote pilot study via email. To examine 1) willingness to participate in a remote cognitive assessment study and 2) usability of MTD, the initiation and completion rates of MTD were examined by cognitively unimpaired (CU; n = 142) and cognitively impaired (CI; n = 106) groups (see Figure 1). These rates and other factors associated with MTD feasibility were further explored across age in CU (i.e., 50‐69, 70‐79, and 80+ years) and specific diagnostic groups in CI (i.e., individuals with dementia, mild cognitive impairment (MCI), and possible MCI).ResultsSession completion rate (usability) was 98% across all participants who chose to participate, and, surprisingly, completion rates did not vary by age or diagnostic groups (p =.69; see Table 1). As expected, more individuals chose to participate in the CU (77%) versus CI (52%) group (p < .001). In terms of feasibility, individuals over 80 and with CI were more likely to have some contact with the study coordinator. Use of smartphones decreased with age, with most CU individuals over 70 using a personal computer (69‐73%; Table 2).ConclusionsThough the CI group was less likely to choose to participate than the CU group, out of those that did choose to participate the rate of completion was 98%. This demonstrates high usability of MTD. Study coordinator support and a flexible testing platform is critical for facilitating participation in remote testing across the aging population, and more supports and incentives may be needed for individuals with cognitive impairment to improve participation rates.
Mayo normative studies: A conditional normative model for longitudinal change on the Auditory Verbal Learning Test and preliminary validation in preclinical Alzheimer's disease
Abstract Introduction The aim of this study was to develop a conditional normative model for Rey's Auditory Verbal Learning Test (AVLT) that accounts for practice effects. Methods In our normative sample, robust conditional norms were derived from 1001 cognitively unimpaired (CU) adults ages 50 to 89 who completed the AVLT up to eight times. Linear mixed‐effects models adjusted for baseline performance, prior test exposures, time, demographics, and interaction terms. In our preliminary validation, mean performance on conditional and typical normative scores across two to four completed follow‐up tests in preclinical Alzheimer's disease participants at baseline with positive amyloid and tau positron emission ( n = 27 CU amyloid [A]+tau[T]+) was compared to biomarker negative individuals ( n = 269 CU A–T–). Results AVLT performance using typical norms did not differ across A+T+ and A–T– groups. Conditional norms z‐scores were lower in the A+T+ relative to the A–T– group for 30‐minute recall ( P = .033) and sum of trials ( P = .030). Discussion Conditional normative methods that account for practice effects show promise for identifying longitudinal cognitive decline.
Abstract 193: Cerebral Cavernous Malformation Location and Mode of Presentation Predict the Risk of Hemorrhage During Their Untreated Clinical Course: Individual Patient Data Meta-Analysis
INTRODUCTION: Cerebral cavernous malformations (CCM) are the second commonest incidental finding on brain MRI and may cause symptomatic intracranial hemorrhage (ICH). However, the risk and predictors of ICH from CCM remain uncertain. HYPOTHESIS: Presentation with ICH or non-hemorrhagic focal neurological deficit (FND) attributable to CCM, brainstem CCM location, female sex, increasing age and multiple CCM predict ICH occurrence during follow-up without CCM treatment. METHODS: Three hospital-based cohorts and two cohorts from a population-based study provided individual patient data on clinical course from CCM diagnosis until either first CCM treatment or last available follow-up. We used survival analysis of each cohort to estimate the 5-year risk of symptomatic ICH or new FND, multivariable Cox regression to identify baseline predictors of outcome, and random-effects models to pool estimates in meta-analysis. RESULTS: Among 988 adults who experienced 62 ICHs during 3,232 person-years of follow-up, clinical presentation with ICH or FND (hazard ratio [HR] 7.4, 95% confidence interval [CI] 2.9-19.2) and brainstem CCM location (HR 5.7, 95% CI 3.2-10.3) were associated with a higher risk of a first ICH within five years of CCM diagnosis, but age, sex and CCM multiplicity were not. The 5-year estimated risk of ICH during untreated follow-up was 2.4% (95% CI 1.0-3.8) for 566 adults without ICH/FND from CCM outside the brainstem, 5.5% (95% CI 0-12.9) for 51 adults without ICH/FND from brainstem CCM, 10.6% (95% CI 5.1-16.1) for 198 adults with ICH/FND from CCM outside the brainstem, and 25.7% (95% CI 18.3-33.1) for 173 adults with ICH/FND from brainstem CCM. In secondary analyses of first ICH or FND, event rates increased but predictors remained unchanged. CONCLUSION: Mode of clinical presentation and CCM location are independently associated with ICH or FND within five years of CCM diagnosis, which can inform decisions about CCM treatment.
A longitudinal investigation of Aβ, anxiety, depression, and mild cognitive impairment
Abstract Introduction We investigated the longitudinal relationship between cortical amyloid deposition, anxiety, and depression and the risk of incident mild cognitive impairment (MCI). Methods We followed 1440 community‐dwelling, cognitively unimpaired individuals aged ≥ 50 years for a median of 5.5 years. Clinical anxiety and depression were assessed using Beck Anxiety and Depression Inventories (BAI, BDI‐II). Cortical amyloid beta (Aβ) was measured by Pittsburgh compound B positron emission tomography (PiB‐PET) and elevated deposition (PiB+) was defined as standardized uptake value ratio ≥ 1.48. We calculated Cox proportional hazards models with age as the time scale, adjusted for sex, education, and medical comorbidity. Results Cortical Aβ deposition (PiB+) independent of anxiety (BAI ≥ 10) or depression (BDI‐II ≥ 13) increased the risk of MCI. There was a significant additive interaction between PiB+ and anxiety (joint effect hazard ratio 6.77; 95% confidence interval 3.58–12.79; P = .031) that is, being PiB+ and having anxiety further amplified the risk of MCI. Discussion Anxiety modified the association between PiB+ and incident MCI.
Abstract 3541: Do Periodic Assessments Of Bleeding Risks Identify More Patients With Major Bleeding Events? A Population-based Cohort Study Among Warfarin-treated Stroke Patients.
Background We sought to determine the occurrence of major bleeding events in a population-based cohort of stroke patients with atrial fibrillation in a population-based cohort who were risk-stratified at baseline, one and five years, following initiation of warfarin treatment. Methods The resources of the Rochester Epidemiology Project Medical Linkage System were used to identify acute ischemic stroke patients with atrial fibrillation undergoing warfarin treatment for secondary stroke prevention from 1980 to 1995. These patients were risk-stratified according to the HAS-BLED and HEMORRHAGES scores prior to warfarin initiation following stroke onset; these scores were reassessed one and five years later. Major bleeding was considered in patients with fatal or clinically overt bleeding associated with either transfusion of >2 units of blood or >2 g/dl decrease in hemoglobin. Results One hundred patients (mean age, 79.3 years; 68% women) were studied. Median duration of warfarin treatment was 2.4 years (interquartile range, 0.4-6.6) and duration from stroke onset to death was 3.7 years (1.1-8.8). Major bleeding events occurred in 41 patients at a median duration of 19 months (5-58) following warfarin initiation. Sixteen events occurred within a year of treatment, 25 events from years 1-5, and 14 events in patients treated for >5 years. Patients with baseline HAS-BLED scores ≥2 had higher life-time risks of major bleeding events compared with those ≤1 (95% vs 5%, p=0.002), while those with HEMORRHAGES score ≥2 had higher life-time risks of major bleeding events compared with those ≤1 (90% vs 10%, p=0.030). Periodic reassessments of these risks were associated with a higher detection of major bleeding events. Patients with an increase in the HAS-BLED scores had a higher subsequent risk of major bleeding events compared with those with no change (year one, 64% vs 34%, p=0.043; year five, 75% vs 29%, p=0.018). Similarly, patients with an increase in the HEMORRHAGES scores had a higher risks of major bleeding events compared to those with no change (year one, 57% vs 33%, p=0.063; year five, 71% vs 10%, p<0.001). Conclusions Periodic assessments of bleeding risks using prognostic scales are associated with a higher detection of major bleeding events. These scales should be periodically reassessed in the years following warfarin initiation to determine if the benefit of ongoing use outweighs the bleeding risk.