Patel, Jay Sureshbhai

AbstractBackgroundRemote assessment tools offer significant promise for aiding early detection of cognitive impairment. Mayo Test Drive (MTD): Test Development through Rapid Iteration, Validation and Expansion, is a web‐based platform for remote self‐administered assessment that includes a computer adaptive word list memory test (Stricker Learning Span; SLS) and a measure of processing speed (Symbols Test). We examined the diagnostic accuracy of the SLS and a MTD composite (SLS max span, SLS trials 1–5 total correct, SLS delay correct, [Symbols correct item response time*‐1]) for amnestic mild cognitive impairment (aMCI). We also explored diagnostic accuracy for a broader group that included individuals with possible MCI (pMCI; see Figure 1).MethodsParticipants were recruited from the Mayo Clinic Study of Aging for this ancillary remote study. 226 were cognitively unimpaired (CU; concordant CU diagnosis by 3 independent raters). Fifty‐six participants had possible MCI (at least 1 of 3 raters indicated MCI) and 16 had a consensus diagnosis of aMCI. Primary outcome variables were SLS sum of trials, AVLT sum of trials, Symbols correct items response time, and MTD composite. Mean difference analyses used linear model ANOVAs (alpha = .05). Receiver operating characteristic (ROC) curves were applied; we derived optimal cutoff scores based on the Youden index method.ResultsBoth aMCI and possible MCI groups showed significantly lower performance than the CU group on SLS (Hedge’s g aMCI = ‐1.72, pMCI = ‐1.04), Symbols (Hedge’s g aMCI = 1.38, pMCI = 0.64), and MTD composite (Hedge’s g aMCI = ‐1.89, pMCI = ‐1.09); see Tables 1 and 2 (all p‘s<.01 even when additionally covarying age, education, sex). Total area under the curve was high for differentiating of CU vs. aMCI (MTD Composite = 0.91, SLS = 0.91) and acceptable for CU vs. pMCI (MTD Composite = 0.77, SLS = 0.77); see Table 2. Consistent with our flexible platform, a variety of device types were used to complete remote testing (32% smartphone, 12% tablet, 56% PC).ConclusionsMTD and the SLS show high diagnostic accuracy for aMCI. MTD is a flexible, brief, and easy‐to‐use remote cognitive assessment tool with great potential for scalable use in future studies seeking to maximize inclusion of individuals with aMCI in clinical trials or for cognitive screening in clinical settings.

AbstractBackgroundMayo Test Drive (MTD): Test Development through Rapid Iteration, Validation and Expansion, is a web‐based platform for self‐administered assessment for novel (Stricker Learning Span) and open access (Symbols Test) cognitive measures with previously demonstrated validity and reliability. Our study aim was to examine the usability of MTD, defined as the extent to which MTD was used to achieve the desired study goal of completing a testing session among participants willing to engage in an all‐remote study.Methods248 Mayo Clinic Study of Aging and Mayo Alzheimer’s Disease Research Center participants were invited to participate in this ancillary, uncompensated remote pilot study via email. To examine 1) willingness to participate in a remote cognitive assessment study and 2) usability of MTD, the initiation and completion rates of MTD were examined by cognitively unimpaired (CU; n = 142) and cognitively impaired (CI; n = 106) groups (see Figure 1). These rates and other factors associated with MTD feasibility were further explored across age in CU (i.e., 50–69, 70–79, and 80+ years) and specific diagnostic groups in CI (i.e., individuals with dementia, mild cognitive impairment (MCI), and possible MCI).ResultsSession completion rate (usability) was 98% across all participants who chose to participate, and, surprisingly, completion rates did not vary by age or diagnostic groups (p = .69; see Table 1). As expected, more individuals chose to participate in the CU (77%) versus CI (52%) group (p < .001). In terms of feasibility, individuals over 80 and with CI were more likely to have some contact with the study coordinator. Use of smartphones decreased with age, with most CU individuals over 70 using a personal computer (69‐73%; Table 2).ConclusionsThough the CI group was less likely to choose to participate than the CU group, out of those that did choose to participate the rate of completion was 98%. This demonstrates high usability of MTD. Study coordinator support and a flexible testing platform is critical for facilitating participation in remote testing across the aging population, and more supports and incentives may be needed for individuals with cognitive impairment to improve participation rates.

AbstractBackgroundMayo Test Drive (MTD): Test Development through Rapid Iteration, Validation and Expansion, is a web‐based platform for self‐administered assessment for novel (Stricker Learning Span) and open access (Symbols Test) cognitive measures with previously demonstrated validity and reliability. Our study aim was to examine the usability of MTD, defined as the extent to which MTD was used to achieve the desired study goal of completing a testing session among participants willing to engage in an all‐remote study.Methods248 Mayo Clinic Study of Aging and Mayo Alzheimer’s Disease Research Center participants were invited to participate in this ancillary, uncompensated remote pilot study via email. To examine 1) willingness to participate in a remote cognitive assessment study and 2) usability of MTD, the initiation and completion rates of MTD were examined by cognitively unimpaired (CU; n = 142) and cognitively impaired (CI; n = 106) groups (see Figure 1). These rates and other factors associated with MTD feasibility were further explored across age in CU (i.e., 50‐69, 70‐79, and 80+ years) and specific diagnostic groups in CI (i.e., individuals with dementia, mild cognitive impairment (MCI), and possible MCI).ResultsSession completion rate (usability) was 98% across all participants who chose to participate, and, surprisingly, completion rates did not vary by age or diagnostic groups (p =.69; see Table 1). As expected, more individuals chose to participate in the CU (77%) versus CI (52%) group (p < .001). In terms of feasibility, individuals over 80 and with CI were more likely to have some contact with the study coordinator. Use of smartphones decreased with age, with most CU individuals over 70 using a personal computer (69‐73%; Table 2).ConclusionsThough the CI group was less likely to choose to participate than the CU group, out of those that did choose to participate the rate of completion was 98%. This demonstrates high usability of MTD. Study coordinator support and a flexible testing platform is critical for facilitating participation in remote testing across the aging population, and more supports and incentives may be needed for individuals with cognitive impairment to improve participation rates.