AbstractBackgroundIn vivo tau‐positron emission tomography (PET) is an attractive biomarker for Alzheimer’s disease (AD) diagnosis and treatment. However, tau‐PET is less widely available than other modalities. In this study, we tested cross‐modality synthesis of tau‐PET brain images from fluorodeoxyglucose F‐18 (FDG)‐PET using a deep convolutional neural network (CNN).MethodParticipants (n=1,192) who had brain FDG‐PET with 18F‐FDG and tau‐PET with Flortaucipir (F‐18‐AV‐1451) were included for training and testing. This cohort spanned normal aging (ages 26‐98), pre‐clinical, and clinical AD and related disorders including the FTD and DLB spectrum. External validation was done using ADNI (n=288). The PET scans were co‐registered to the corresponding MRI and subsequently warped to Mayo Clinic Adult Lifespan Template (MCALT) space. Tau‐PET images were SUVR‐normalized to the cerebellar crus, and FDG to the pons. A 3D dense‐U‐net model was utilized as an architecture. Cross‐validation experiments were conducted using 5‐fold validations (60% training set, 20% validation set, and 20% test set) with mean squared error as the loss function.ResultOur dense‐U‐net model successfully synthesized tau‐PET from metabolic images with good correlation and low prediction error for regional SUVRs (Figure 1A‐C). The model showed a robust prediction ability, performing accurately in an independent, external ADNI cohort (Figure 1D‐F). The model‐imputed tau‐PET significantly improved performance in classifying tau positivity (mean AUROC(±SD)=0.78±0.04 and 0.85±0.03 for FDG‐PET and synthesized tau‐PET, respectively) and diagnostic groups (cognitively unimpaired with abnormal amyloid‐PET vs. cognitively impaired with abnormal amyloid‐PET) compared to the original input FDG data (mean AUROC(±SD)=0.89±0.04, 0.85±0.05 0.91±0.04 for actual tau‐PET, FDG‐PET and synthesized tau‐PET, respectively) (Figure 2), suggesting enhanced clinical utility for metabolic images. The ADNI cohort also showed similar results (for tau positivity: AUROC=0.66 and 0.78 for FDG‐PET and synthesized tau‐PET, respectively; for CU A+ vs. CI A+: AUROC=0.86, 0.62, and 0.73 for actual tau‐PET, FDG‐PET, and synthesized tau‐PET; Figure 3).ConclusionWe showed that using a CNN model to predict tau‐PET from FDG‐PET is feasible. The synthesized tau‐PET can augment the value of FDG‐PET, facilitating the multi‐modal diagnosis of AD.
Deep learning to harmonize MRI scans for better diagnosis and prognosis in multi‐center studies
AbstractBackgroundData heterogeneity due to cross‐scanner variations is a major challenge in multi‐center aging and dementia studies. Brain structural measures for the same participant can vary due to scanner differences (manufacturer, scanner age/technology, signal‐to‐noise ratio, pulse sequence design, contrast, resolution) and result in biomarker variability. In this work, we applied basic image processing and deep learning methods (style transfer (ST) and generative adversarial networks (GANs)) for harmonizing T1‐weighted MRI scans across change in vendors (GE to Siemens) and resolution (1x1x1.2mm to 0.8x0.8x0.8mm) and test whether this harmonization improved compatibility of AD biomarker measures.MethodWe utilized training (n=814) and test (n=113 same participants scanned on two scanners close‐in‐time, typically on the same day, with different resolution) data from cognitively impaired and unimpaired participants scanned on GE and Siemens scanners from Mayo Clinic Study of Aging and Mayo ADRC. The harmonization was conducted to translate GE to Siemens. All scans were affine transformed to the same template space, resampled to 1.5 mm3, and bias corrected. Histogram matching was performed using cumulative density functions. A ResNet18 was trained for the ST’s content and style layers. Two types of GANs, conditional GANs (cGAN) and cycle‐consistent GANs (cycleGAN), were constructed. We then measured regional cortical thickness from each image using FreeSurfer‐7.1.1 and compared the thickness measurements from the original and translated scans using intraclass‐correlation (ICC) and Deming regression.ResultIn the test dataset, ST and cycleGAN showed the best performances when comparing the translated GE to Siemens. With ST, the ICC increased (vs. the original scans) slightly for the temporal meta‐ROI (0.956 from 0.954) and more substantially for the frontal pole ROI (0.706 from 0.594). The cycleGAN showed an increase in ICC for the frontal pole ROI (0.610 from 0.594) but not the meta‐ROI (Fig. 1).ConclusionEach method leveraged a different strength. Histogram matching captures contrast, ST extracts textural information, and GANs learn combination of contrast, edge and texture properties. We found that deep learning is a promising approach to cross‐scanner variability. Our comparisons revealed anatomical differences across methods; thus, disease specific measure should be considered for selection of the scanner harmonization method.
TAR DNA‐binding protein 43 (TDP‐43) contributes to the mismatch between medial temporal volumes and flortaucipir uptake in elderly patients with Alzheimer’s disease neuropathologic changes
AbstractBackgroundWe previously demonstrated that Alzheimer’s disease (AD) patients ≥70 y/o tend to have smaller medial temporal volumes in the presence of relatively less medial temporal 18F‐flortaucipir‐PET uptake compared to young AD patients. TAR DNA‐binding protein 43 (TDP‐43) is frequently found in the brains of AD patients and is associated with old age and medial temporal atrophy. In this study, we aimed to determine whether TDP‐43 could be contributing to the mismatch between medial temporal volumes and flortaucipir‐PET uptake in older AD patients.MethodWe identified 77 participants (median age at death 79 years [range: 51‐99]) who had been enrolled into the Mayo Clinic Alzheimer’s Disease Research Center or Neurodegenerative Research Group (NRG), had undergone flortaucipir‐PET and volumetric MRI scans close to death, and autopsy confirmed AD neuropathological changes, as well as TDP‐43 assessments. Grey matter volumes and flortaucipir standard uptake value ratios (SUVRs) were calculated for hippocampus, amygdala, entorhinal, inferior temporal, and midfrontal cortices. We used bivariate‐response linear regression modelling, adjusting for Braak neurofibrillary tangle stage, to estimate the effect of TDP‐43 and age on gray matter volume and flortaucipir uptake, and tested whether TDP‐43 effect sizes varied according to age.ResultAfter accounting for Braak stage, older individuals tended to have significantly lower flortaucipir uptake across regions and lower hippocampal and entorhinal cortex (ERC) volumes. TDP‐43 was associated with reduced hippocampus and ERC volumes but was unrelated to flortaucipir SUVRs (Figure 1). Notably, the TDP‐43 effect size for the hippocampus and ERC was largely consistent across age, i.e., at any age, TDP‐43‐positive participants had significantly smaller hippocampal (∼12% decrease) and ERC (13% decrease) volumes than TDP‐43‐negative participants. However, at older ages, the mean volumes in the whole cohort and, more evidently, in those with dementia moved closer towards the mean of those with TDP‐43 (Figure 1), likely attributable to the increasing frequency of TDP‐43 with age.ConclusionTDP‐43 is a major contributor to the mismatch between flortaucipir uptake and medial temporal lobe volumes in older AD patients where lower medial temporal regional volumes are observed in the presence of less flortaucipir uptake.
Harmonizing machine learning imaging biomarkers – CDESH and the case for harmonization in both MR image and low‐dimensional (scalar) output space
AbstractBackgroundIn 2018 we presented the Computational DESH (CDESH) metric (DOI:10.1016/j.nicl.2018.11.015), a machine learning measure of abnormal CSF space patterns commonly observed on MRI in Disproportionately Enlarged Subarachnoid‐space Hydrocephalus (DESH‐type) NPH. We have shown that CDESH positive individuals often have discordant CSF and PET amyloid measures (DOI:10.1016/j.jalz.2019.06.4921). Positive CDESH scores are predictive of cognitive decline (DOI:10.1016/j.neuroimage.2021.117899, DOI: 10.1212/WNL.0000000000008616). The score is calculated from regional CSF volumes in a sulcal atlas and within the ventricles using a support vector machine (SVM). The Mayo Clinic Study of Aging (MCSA) changed scanner platforms (GE to Siemens) and T1‐weighted image resolution (1.2mm x 1.05mm x 1.05mm to 0.8mm isotropic) in 2017. We refer to these as “isotropic” or “anisotropic” scans. Our objective was to assess the dependence of a machine learning method (specifically CDESH) to image input variation and, if necessary, determine what needed corrections.MethodAll data considered is from the MCSA or Mayo Clinic ADRC. The SVM was trained on anisotropic images with laboriously labelled ground truth. We resampled the isotropic data from a crossover study (N=112, typically scanned same‐day with both platforms/resolutions) to match the anisotropic resolution. Two approaches to correction were evaluated (Figure 1). In Figure 2 we compare of the score with and without correction cross‐sectionally in 998 MCSA participants. In Figure 3 we present longitudinal series from 23 participants with multiple scans using the isotropic resolution protocol and at least one prior anisotropic image.ResultsComparisons of data from the crossover study are presented in Figure 1. Matching voxel resolution to the data used to train the SVM is critical and a subsequent mild linear score adjustment may be warranted. Cross‐sectional comparisons (Figure 2) confirm improvement matching voxel resolution with a possible mild linear score adjustment. After matching voxel resolution CDESH score trajectories (Figure 3) are markedly more stable across this scanner/protocol change.ConclusionThe SVM‐based CDESH score is sensitive to voxel resolution. Corrections are needed in image processing and possibly in the scalar output score to achieve stability across protocol and scanner changes. The resulting correction supports coherent long timeseries data and longitudinal extension of previous work.
Latent space projection of brain FDG‐PET creates a powerful classifier for neurodegenerative diseases
AbstractBackgroundFluorodeoxyglucose positron emission tomography (FDG‐PET) is an established modality for differential diagnosis of dementia. Deriving phenotypic signatures from FDG‐PET via machine learning is challenging due to the high dimensional nature of brain images relative to the generally small number of labeled examples available for training, the class imbalance among those labels, and the cooccurrence of multiple pathologies. In this study, we developed a multi‐class, multi‐label framework to address these challenges.MethodA database of clinically acquired PET/CT images from 3,000 unique patients was used to develop a latent space model using matrix decomposition. This model was then applied to images from a separate cohort of Mayo Clinic Alzheimer’s Disease Research Center participants (n=1,745) labeled as cognitively unimpaired (CU) (n=1,436) or with the following potentially co‐occurring phenotypes: Alzheimer’s disease (AD) (n=165), Lewy body dementia (DLB) (n=92), behavioral variant frontotemporal dementia (bvFTD) (n=43), semantic (svPPA) (n=10) and logopenic (lvPPA) (n=13) variant PPA, and posterior cortical atrophy (PCA) (n=17). A k‐nearest neighbors classifier that is robust to these imbalanced and overlapping labels was then trained on these examples. The resulting classifier was evaluated by area under receiver‐operator characteristic curve (ROC‐AUC) via leave one out cross validation, using clinical diagnosis as the gold standard.ResultROC curves and AUC scores for each phenotype are illustrated in Fig. 1a. Because the classifier is based on a k‐nearest neighbors connectivity matrix, it has a convenient graphical representation, where images are nodes and edges are drawn between an image and its set of nearest neighbors in latent space. A self‐organizing force directed graph constructed in this way is illustrated in Fig 1b, highlighting the strong separation of CU and degenerative images, as well as the segregation of each phenotype within the neurodegenerative region of the graph.ConclusionIn this study, we developed a machine learning framework for classification of neurodegenerative disease based on k‐nearest neighbor analysis in a low dimensional latent space projection of FDG‐PET images. By leveraging low‐dimensional representations and k‐nearest neighbors analysis, this framework is robust in multi‐class, multi‐label tasks with strong class imbalance and provides a highly interpretable graphical representation.
Regional white matter hyperintensities in posterior cortical atrophy and logopenic progressive aphasia
AbstractBackgroundWhite matter hyperintensities (WMH) are markers of cerebral small vessel disease and have been associated with higher risk of typical amnestic Alzheimer’s disease (AD), however, little is known about the role of WMHs in atypical variants of AD. This study aimed to determine the frequency and distribution of WMH in two atypical variants of AD: logopenic progressive aphasia (LPA) and posterior cortical atrophy (PCA), and determine whether WMH are associated with demographic and clinical outcomes in these cohorts.MethodSeventy‐five LPA and 39 PCA patients were recruited by the Neurodegenerative Research Group and underwent two‐ dimensional fluid‐attenuated inversion recovery (FLAIR) MRI and Pittsburgh Compound B (PiB) PET. All patients were PiB‐positive. All FLAIR images were segmented using an in‐house software, then were manually edited by a trained imaging analyst. WMH volume was scaled by total intracranial volume to correct for differences in head size. Adjusted WMH burdens were compared between LPA and PCA, and associations were assessed between WMH burden and age, global PiB standard uptake value ratios (SUVRs), and clinical metrics, including tests of general cognitive impairment, executive function, naming, repetition, visuospatial and visuoperceptual function, and parkinsonism. Associations between WMHs and clinical scores were adjusted for age and brain volume to correct for atrophy.ResultTotal WMH burden was similar in PCA and LPA, however, regional differences were identified with PCA having greater subcortical WMH burden in right occipital, parietal, and temporal lobes compared to LPA, and LPA having greater WMH burden in left deep grey and white matter and greater subcortical burden in left parietal lobe compared to PCA. Total WMH burden was greater with older age in both groups but was not related to global PiB SUVR either globally or locally. Greater total WMH was associated with visuoperceptual performance in both cohorts after correcting for atrophy. When assessed regionally, visuoperceptual performance was associated with right subcortical occipital WMH across the cohort.ConclusionRegional distribution of WMHs differ across clinical variants of atypical AD and WMHs may impact clinical outcomes, although further work is needed to determine whether they reflect cerebrovascular disease or regionally specific neurodegenerative changes.
Potential for Re‐Identifying Brain PET Research Participants using Face Recognition
AbstractBackgroundStudies of aging and dementia often acquire brain MRI and PET images, then de‐identify and share these widely with other researchers. It is known that research participants can potentially be re‐identified from brain MRI and CT using face recognition, but this has not been tested with PET imaging.MethodWe generated face reconstruction images of 182 volunteers using their existing amyloid (PiB), tau (FTP), and FDG PET scans from clinical GE PET/CT scanners, and we measured how often commercial automatic face recognition (Microsoft Azure) correctly matched these reconstructions with photographs of their faces. We additionally compared these match rates with face reconstructions from CT (from PET/CT) and MRI. When testing face recognition from PET scans, CT was used only during PET reconstruction, not for face recognition. We also validated our updated mri_reface software, originally developed to de‐identify (“de‐face”) faces in MRI, with new support for PET images. We measured face recognition rates before and after applying mri_reface to PET, CT, and MRI. In addition, we measured effects of de‐facing on biomarker measurements (global and regional SUVR) using 244 ADNI Florbetapir (FBP) amyloid PET scans with two automated pipelines: FreeSurfer 6.0 (PETSurfer) and an in‐house SPM12‐based pipeline.ResultRates of successful face recognition with PET ranged from 32‐41% (Table 1) across tracers. These were lower than MRI (98%) and CT (78%) but still concerning for participant privacy. Using mri_reface reduced face recognition to 0‐3.5% for PET, 5% for CT, and 8% for MRI. mri_reface had little effect on global amyloid SUVR measurements from ADNI PET images (Figure 1). ICC values between original and de‐faced images were 1.00 with biases and median absolute differences < 0.5%, across both pipelines. Effects on individual regions all had ICC values > 0.98 with biases and median absolute differences < 2%.ConclusionFace reconstructions from PET images have sufficient quality for potential re‐identification using publicly available face recognition technology. Research studies should consider using face de‐identification (de‐facing) software on PET images in addition to CT and structural MRI. Our free, automatic mri_reface software greatly reduced the potential for face recognition without substantially affecting SUVR measurements.
Unique brain iron profiles associated with logopenic progressive aphasia and posterior cortical atrophy
AbstractBackgroundQuantitative susceptibility mapping (QSM) can detect iron distribution in the brain by estimating the local tissue magnetic susceptibility of every voxel. Dysregulation of neuronal iron has been correlated with typical Alzheimer’s disease (tAD), but little is known about iron distribution in atypical clinical presentations of AD such as logopenic progressive aphasia (LPA) and posterior cortical atrophy (PCA).MethodEleven PCA patients and eight LPA patients were recruited by the Neurodegenerative Research Group at Mayo Clinic, Rochester, MN, and underwent MRI that included a five‐echo gradient echo sequence for calculation of QSM. Mean QSM signal was extracted from gray and white matter for regions‐of‐interest across the brain using the Mayo Clinic Adult Lifespan Template. Hierarchical models were fit per‐region and per‐hemisphere to compare PCA and LPA to each other, to 20 healthy controls, and to 20 patients with tAD recruited by the Alzheimer’s Disease Research Center.ResultStrong evidence (posterior probability>0.99) was observed for greater susceptibility in the left middle occipital gyrus and amygdala in both LPA and PCA, and in the right precuneus and inferior temporal gyrus in PCA compared to controls. Moderate evidence for greater susceptibility (posterior probability>0.90) was also observed in the left insula, inferior occipital gyrus, entorhinal cortex, and right inferior parietal gyrus and amygdala in both LPA and PCA, along with right angular gyrus and middle occipital gyrus in PCA and right insula and caudate in LPA, when compared to controls. Comparing between phenotypes, LPA showed moderate evidence for greater susceptibility in the caudate, hippocampus, substantia nigra, left supramarginal gyrus and posterior cingulate compared to PCA, while PCA showed greater susceptibility in the right precuneus compared to LPA. Both LPA and PCA showed moderate‐strong evidence for greater susceptibility than tAD, particularly in medial and lateral parietal regions.ConclusionUnique iron profiles were identified in LPA and PCA within cortical and subcortical structures. These changes are in line with disease‐related neurodegenerative changes in the clinical phenotypes, suggesting that QSM could be an informative marker to study iron deposition in these patients.
TDP‐43 pathology effect on volume and flortaucipir uptake in Alzheimer's disease
AbstractIntroductionAlzheimer's disease (AD) patients ≥70 years show smaller medial temporal volumes despite less 18F‐flortaucipir‐positron emission tomography (PET) uptake than younger counterparts. We investigated whether TAR DNA‐binding protein 43 (TDP‐43) was contributing to this volume‐uptake mismatch.MethodsSeventy‐seven participants with flortaucipir‐PET and volumetric magnetic resonance imaging underwent postmortem AD and TDP‐43 pathology assessments. Bivariate‐response linear regression estimated the effect of age and TDP‐43 pathology on volume and/or flortaucipir standardized uptake volume ratios of the hippocampus, amygdala, entorhinal, inferior temporal, and midfrontal cortices.ResultsOlder participants had lower hippocampal volumes and overall flortaucipir uptake. TDP‐43‐immunoreactivity correlated with reduced medial temporal volumes but was unrelated to flortaucipir uptake. TDP‐43 effect size was consistent across the age spectrum. However, at older ages, the cohort mean volumes moved toward those of TDP‐43‐positives, reflecting the increasing TDP‐43 pathology frequency with age.DiscussionTDP‐43 pathology is a relevant contributor driving the volume‐uptake mismatch in older AD participants.Highlights TDP‐43 pathology affects medial temporal volume loss but not tau radiotracer uptake. Greater TDP‐43 pathology effect is seen in old age due to its increasing frequency. TDP‐43 pathology is a relevant driver of the volume‐uptake mismatch in old AD patients.
Cross-sectional Associations of β-Amyloid, Tau, and Cerebrovascular Biomarkers With Neurodegeneration in Probable Dementia With Lewy Bodies