Stricker, John L.

Abstract Background Easily accessible and self‐administered cognitive assessments that can aide early identification of individuals at risk for Alzheimer’s disease (AD) dementia are critical for timely intervention. Mayo Test Drive (MTD) is a remote, self‐administered, multi‐device compatible, web‐based cognitive assessment (Stricker et al., 2022). We investigated continuous associations between MTD and amyloid and tau PET biomarkers and compared the strength of association to PET biomarkers and in‐person cognitive measures. Method 556 adults from the Mayo Clinic Study of Aging participated (mean age = 70.6; mean education = 16.0 years; 50.7% female; 97.5% white). Participants were predominantly cognitively unimpaired (95.3%; 4.7% had a consensus diagnosis of mild cognitive impairment). Participants completed (1) brain amyloid and tau PET scans, (2) in‐person neuropsychological assessment including Mayo Preclinical Alzheimer’s disease Cognitive Composite (Mayo‐PACC) and Global‐z, and (3) remote MTD comprised of the Stricker Learning Span (SLS) and the Symbols test, which are combined into an MTD composite. Multiple regressions adjusted for age, sex, and education queried associations between imaging biomarkers [amyloid meta‐region of interest (ROI), tau meta‐ROI, and tau entorhinal cortex (EC)‐ROI)] and composite and subtest scores from remote and in‐person measures. Davidson‐Mackinnon J‐test compared R‐squared values of models with remote versus in‐person composites. Result Lower performances on MTD composite and Mayo‐PACC were associated with higher amyloid meta‐ROI (p’s<.05; Table 1). MTD composite was also negatively associated with tau meta‐ROI and EC‐ROI (p’s<.05). For memory measures, SLS sum of trials was negatively associated with tau meta‐ROI (p = .01) and EC‐ROI (p<.001) with no associations between AVLT sum of trials and PET (p’s = .06; Table 2). Among processing speed/executive function measures, worse Trails B performance was associated with higher amyloid meta‐ROI (p<.001). Symbols and Digit Symbol Coding were not associated with PET (p’s = .29). A multivariable model with MTD explained significantly less variance (p = .04) for amyloid meta‐ROI (adjusted R‐squared = 0.165) than a multivariable model with Mayo‐PACC (adjusted R‐squared = 0.176); remote and in‐person composite measures were comparable for other associations (p’s>.05). Conclusion MTD is associated with continuous measures of amyloid and tau PET biomarkers of AD, demonstrating criterion validity for MTD. Several associations were comparable to relationships between gold‐standard in‐person neuropsychological tests and imaging biomarkers.

Abstract Background Brief self‐administered cognitive assessments deployed remotely and combined with plasma biomarkers of Alzheimer’s disease (AD) are well suited to assess clinical symptoms and underlying biology in large‐scale decentralized studies. We investigated whether associations of self‐administered cognitive measures and plasma biomarkers were comparable to associations of in‐person cognitive measures and plasma biomarkers. Method Participants included 327 adults from the Mayo Clinic Study of Aging (mean age = 70.8; 48% female; mean education = 16.0 years; 96.9% white). Most (94.5%) were cognitively unimpaired; 5.5% had consensus diagnosis of mild cognitive impairment. Participants completed Mayo Test Drive (MTD; Stricker et al., 2022), a remote, self‐administered, multi‐device compatible web‐based cognitive assessment comprised of the Stricker Learning Span (SLS) and Symbols test that are combined into a MTD composite. Participants also completed in‐person neuropsychological assessment (global‐z; Mayo Preclinical Alzheimer’s disease Cognitive Composite [Mayo‐PACC]) and fasting venipuncture. Plasma was assayed via HD‐X simoa platform for amyloid‐beta (Aß)‐42 and Aß‐40 to create an Aß42/40 ratio, glial fibrillary acidic protein (GFAP), and neurofilament light chain (NfL) using the N4PE Quanterix kit as well as phosphorylated‐tau protein 181 (p‐tau181). P‐tau181, GFAP, and NfL were log10‐transformed. Multiple regression analyses adjusting for age, sex, and education examined associations between plasma biomarkers and composite and subtest scores from remote and in‐person measures. Davidson‐Mackinnon J‐test compared R‐squared values of models with remote versus in‐person composites. Result Lower performances on MTD, global‐z, and Mayo‐PACC (Table 1) were associated with higher GFAP (p’s = .02), NfL (p’s = .003), and p‐tau181 (p’s = .04). For memory, worse SLS and AVLT sum of trials were associated with higher GFAP (p’s = .01) and NfL (p’s = .03). For processing speed/executive function, worse Symbols and Trails B were associated with higher p‐tau181 (p’s = .02). Worse Trails B and Digit Symbol Coding were associated with higher NfL (p’s = .02), and worse Digit Symbol Coding was associated with lower Aß42/40 (p = 0.03; Table 2). A multivariable model with MTD explained significantly more variance (p = .04) for NfL (adjusted R‐squared = 0.461) than a multivariable model with Mayo‐PACC (adjusted R‐squared = 0.447); remote and in‐person composite measures were comparable for other associations (p’s>.05). Conclusion Remote and in‐person composite measures showed comparable associations with AD‐related plasma biomarkers, supporting MTD’s criterion validity.

AbstractBackgroundMayo Test Drive (MTD): Test Development through Rapid Iteration, Validation and Expansion, is a web‐based platform optimized for remote self‐administered assessment that includes a computer adaptive word list memory test (Stricker Learning Span; SLS) and a measure of processing speed (Symbols Test). Study aims were to determine 1) convergent validity of MTD through correlations with in‐person neuropsychological measures and 2) criterion validity of MTD by qualitatively comparing the ability of Mayo Test Drive and in‐person administered neuropsychological measures to differentiate biomarker‐defined groups, independent of clinical diagnosis.MethodsMayo Clinic Study of Aging participants (N = 282) completed a brief remote cognitive assessment (mean age = 74, SD = 12; 262 CU and 20 MCI per consensus conference diagnosis; see Table 1). A subset of participants had brain amyloid and/or brain tau PET scans available within 3 years; overlapping groups were formed for 1) those on the Alzheimer’s disease (AD) continuum (A+, n = 31) or not (A‐, n = 57) and for 2) those with biological AD (A+T+, n = 19) or without any AD biomarkers (A‐T‐, n = 47). Primary outcome variables were SLS sum of trials, AVLT sum of trials, SYM Correct Trials response time, Digit Symbol Coding, MTD composite and Mayo‐PACC (AVLT sum of trials, Trails B, animals). Bivariate correlations were performed across all participants. Linear model ANOVAs were used to investigate biomarker subgroup differences; Hedge’s g effect sizes are reported.ResultsConvergent validity was supported through significant correlation (p’s < .001) of SLS and AVLT (r = .63), SYM and Coding (r = ‐.64), and MTD composite with Mayo‐PACC (r = .67); see Table 2. MTD subtests showed expected relationships with age and education (p’s < .05; Table 3). All MTD performances were significantly lower for A+ and A+T+ participants relative to A‐ or A‐T‐ (p’s<.001; Table 4). All MTD outcome measures showed a similar or greater group difference effect size relative to traditional in‐person administered neuropsychological measures for separating A+ vs. A‐ and A+T+ vs. A‐T‐ groups. See Figure 1 and Table 4.ConclusionsMTD subtests show evidence of convergent validity through strong correlations with traditional in‐person cognitive measures. Preliminary analyses suggest MTD has promise for differentiating PET biomarker groups.

AbstractBackgroundRemote assessment tools offer significant promise for aiding early detection of cognitive impairment. Mayo Test Drive (MTD): Test Development through Rapid Iteration, Validation and Expansion, is a web‐based platform for remote self‐administered assessment that includes a computer adaptive word list memory test (Stricker Learning Span; SLS) and a measure of processing speed (Symbols Test). We examined the diagnostic accuracy of the SLS and a MTD composite (SLS max span, SLS trials 1–5 total correct, SLS delay correct, [Symbols correct item response time*‐1]) for amnestic mild cognitive impairment (aMCI). We also explored diagnostic accuracy for a broader group that included individuals with possible MCI (pMCI; see Figure 1).MethodsParticipants were recruited from the Mayo Clinic Study of Aging for this ancillary remote study. 226 were cognitively unimpaired (CU; concordant CU diagnosis by 3 independent raters). Fifty‐six participants had possible MCI (at least 1 of 3 raters indicated MCI) and 16 had a consensus diagnosis of aMCI. Primary outcome variables were SLS sum of trials, AVLT sum of trials, Symbols correct items response time, and MTD composite. Mean difference analyses used linear model ANOVAs (alpha = .05). Receiver operating characteristic (ROC) curves were applied; we derived optimal cutoff scores based on the Youden index method.ResultsBoth aMCI and possible MCI groups showed significantly lower performance than the CU group on SLS (Hedge’s g aMCI = ‐1.72, pMCI = ‐1.04), Symbols (Hedge’s g aMCI = 1.38, pMCI = 0.64), and MTD composite (Hedge’s g aMCI = ‐1.89, pMCI = ‐1.09); see Tables 1 and 2 (all p‘s<.01 even when additionally covarying age, education, sex). Total area under the curve was high for differentiating of CU vs. aMCI (MTD Composite = 0.91, SLS = 0.91) and acceptable for CU vs. pMCI (MTD Composite = 0.77, SLS = 0.77); see Table 2. Consistent with our flexible platform, a variety of device types were used to complete remote testing (32% smartphone, 12% tablet, 56% PC).ConclusionsMTD and the SLS show high diagnostic accuracy for aMCI. MTD is a flexible, brief, and easy‐to‐use remote cognitive assessment tool with great potential for scalable use in future studies seeking to maximize inclusion of individuals with aMCI in clinical trials or for cognitive screening in clinical settings.

AbstractBackgroundMayo Test Drive (MTD): Test Development through Rapid Iteration, Validation and Expansion, is a web‐based platform for self‐administered assessment for novel (Stricker Learning Span) and open access (Symbols Test) cognitive measures with previously demonstrated validity and reliability. Our study aim was to examine the usability of MTD, defined as the extent to which MTD was used to achieve the desired study goal of completing a testing session among participants willing to engage in an all‐remote study.Methods248 Mayo Clinic Study of Aging and Mayo Alzheimer’s Disease Research Center participants were invited to participate in this ancillary, uncompensated remote pilot study via email. To examine 1) willingness to participate in a remote cognitive assessment study and 2) usability of MTD, the initiation and completion rates of MTD were examined by cognitively unimpaired (CU; n = 142) and cognitively impaired (CI; n = 106) groups (see Figure 1). These rates and other factors associated with MTD feasibility were further explored across age in CU (i.e., 50–69, 70–79, and 80+ years) and specific diagnostic groups in CI (i.e., individuals with dementia, mild cognitive impairment (MCI), and possible MCI).ResultsSession completion rate (usability) was 98% across all participants who chose to participate, and, surprisingly, completion rates did not vary by age or diagnostic groups (p = .69; see Table 1). As expected, more individuals chose to participate in the CU (77%) versus CI (52%) group (p < .001). In terms of feasibility, individuals over 80 and with CI were more likely to have some contact with the study coordinator. Use of smartphones decreased with age, with most CU individuals over 70 using a personal computer (69‐73%; Table 2).ConclusionsThough the CI group was less likely to choose to participate than the CU group, out of those that did choose to participate the rate of completion was 98%. This demonstrates high usability of MTD. Study coordinator support and a flexible testing platform is critical for facilitating participation in remote testing across the aging population, and more supports and incentives may be needed for individuals with cognitive impairment to improve participation rates.

AbstractBackgroundMayo Test Drive (MTD): Test Development through Rapid Iteration, Validation and Expansion, is a web‐based platform for self‐administered assessment for novel (Stricker Learning Span) and open access (Symbols Test) cognitive measures with previously demonstrated validity and reliability. Our study aim was to examine the usability of MTD, defined as the extent to which MTD was used to achieve the desired study goal of completing a testing session among participants willing to engage in an all‐remote study.Methods248 Mayo Clinic Study of Aging and Mayo Alzheimer’s Disease Research Center participants were invited to participate in this ancillary, uncompensated remote pilot study via email. To examine 1) willingness to participate in a remote cognitive assessment study and 2) usability of MTD, the initiation and completion rates of MTD were examined by cognitively unimpaired (CU; n = 142) and cognitively impaired (CI; n = 106) groups (see Figure 1). These rates and other factors associated with MTD feasibility were further explored across age in CU (i.e., 50‐69, 70‐79, and 80+ years) and specific diagnostic groups in CI (i.e., individuals with dementia, mild cognitive impairment (MCI), and possible MCI).ResultsSession completion rate (usability) was 98% across all participants who chose to participate, and, surprisingly, completion rates did not vary by age or diagnostic groups (p =.69; see Table 1). As expected, more individuals chose to participate in the CU (77%) versus CI (52%) group (p < .001). In terms of feasibility, individuals over 80 and with CI were more likely to have some contact with the study coordinator. Use of smartphones decreased with age, with most CU individuals over 70 using a personal computer (69‐73%; Table 2).ConclusionsThough the CI group was less likely to choose to participate than the CU group, out of those that did choose to participate the rate of completion was 98%. This demonstrates high usability of MTD. Study coordinator support and a flexible testing platform is critical for facilitating participation in remote testing across the aging population, and more supports and incentives may be needed for individuals with cognitive impairment to improve participation rates.

AbstractIntroductionThis study established the psychometric properties and preliminary validity of the Stricker Learning Span (SLS), a novel computer adaptive word list memory test designed for remote assessment and optimized for smartphone use.MethodsWomen enrolled in the Mayo Clinic Specialized Center of Research Excellence (SCORE) were recruited via e‐mail or phone to complete two remote cognitive testing sessions. Convergent validity was assessed through correlation with previously administered in‐person neuropsychological tests (n = 96, ages 55–79) and criterion validity through associations with magnetic resonance imaging measures of neurodegeneration sensitive to Alzheimer's disease (n = 47).ResultsSLS performance significantly correlated with the Auditory Verbal Learning Test and measures of neurodegeneration (temporal meta‐regions of interest and entorhinal cortical thickness, adjusting for age and education). Test–retest reliabilities across two sessions were 0.71–0.76 (two‐way mixed intraclass correlation coefficients).DiscussionThe SLS is a valid and reliable self‐administered memory test that shows promise for remote assessment of aging and neurodegenerative disorders.

AbstractBackgroundMayo Test Drive (MTD): Test Development through Rapid Iteration, Validation and Expansion, is a web‐based platform for remote self‐administered assessment for novel (Stricker Learning Span; SLS) and open access (Symbols Test) cognitive measures. The SLS is a computer adaptive word‐list memory test that matches test difficulty to user performance. The SLS visually presents words for learning exposures and 4‐choice recognition to test encoding across 5 trials. Symbols is a measure of processing speed being used in many remote assessment studies and typically employs a burst design; in MTD participants complete 4 trials (12‐items each). We examine validity and reliability of the SLS and Symbols via MTD.MethodForty‐five women enrolled in an ongoing study of the Sex‐Specific Effects of Endocrine Disruption on Aging and Alzheimer’s Disease were recruited via email or phone. The Auditory Verbal Learning Test (AVLT) and Digit Symbol Coding (Coding), administered in person within the past 2 years (Mean=11 months), were used to establish construct validity. Participants (91.3% White, Mean age=66.2 years, Mean education=15.3 years) were emailed a link to complete the SLS and Symbols remotely at their convenience on their own device and emailed to repeat testing after approximately 1 week. Pearson correlations (n=45) and 2‐way mixed intraclass correlation coefficients (ICC; n=42) determined construct validity and test‐retest reliability, respectively. Significance was set at p<.05.ResultAcross all test sessions initiated, 97% were successfully completed. Most were completed at home (92.6%; vs. at work or in a public space), and device type varied (48% smartphone, 2% tablet, 50% PC). Median session completion time was 15 minutes. SLS learning scores (max span, total correct trials 1‐5) significantly correlated with AVLT 1‐5 total (r’s .37‐.39) and AVLT Trial 5 (r’s .51‐.52). SLS delay significantly correlated with AVLT delay (r=0.45) and recognition (r=0.61). Symbols time‐based scores averaged across trials were significantly correlated with Coding (r’s=‐.48‐(‐).50). Test‐retest reliabilities across 2 sessions were high for SLS (ICC’s=.80‐.88) and Symbols (ICC’s=.81‐.82).ConclusionSLS and Symbols are valid and reliable self‐administered remote tests in older females. Future work will examine effects of Alzheimer’s disease neuroimaging biomarkers and risk factors on these tests.