AbstractBackgroundRecent advances in automatic face recognition have increased the risk that de‐identified research imaging data could be re‐identified from face imagery in brain scans.MethodAn ADNI committee of independent imaging experts evaluated 11 published techniques for face‐deidentification (“de‐facing”) and selected four algorithms (FSL‐UK Biobank, HCP/XNAT, mri_reface, and BIC) for formal testing using 183 longitudinal scans of 61 racially and ethnically diverse ADNI participants, evaluated by their facial feature removal on 3D rendered surfaces (confirming sufficient privacy protection) and by comparing measurements from ADNI routine image analyses on unmodified vs. de‐faced images (confirming negligible side effects on analyses).ResultEffects of the de‐facing methods on FreeSurfer at UCSF (Figure 1‐top), ASHS at University of Pennsylvania (Figure 1 bottom‐left), and longitudinal atrophy at Mayo Clinic (Figure 1 bottom‐right) were comparable with each other and sufficiently small vs. unmodified scans to recommend de‐facing in ADNI‐4. The FSL and mri_reface methods were more thorough in removing facial features, partly because these also removed ears (Figure 2‐top). mri_reface was recommended for ADNI‐4 primarily because fewer (zero) images had modified brain (Figure 2‐bottom), and ADNI leadership approved de‐facing with mri_reface. ADNI performed a second validation of its latest version on another diverse sample of 100 ADNI‐3 participants. These analyses included: boundary shift interval at University College London, where average differences in measurements were all <0.05%; cortical white matter hyperintensities at UC Davis, where they found “minimum impact” (R>0.97); and others.ConclusionADNI‐4 de‐faces all indicated image types (Table 1) before subsequent pre‐processing, analyses, and public release. Sites upload images to the central repository (LONI), where they are queued to the MRI Core at Mayo Clinic for de‐facing. Image types requiring de‐facing are de‐faced using mri_reface. Trained analysts inspect de‐faced images to confirm complete removal of the face and complete non‐modification of the brain, and any flagged images are re‐processed manually until issues are resolved. De‐faced images are converted back to DICOM and re‐uploaded for further distribution. Image types not requiring de‐facing are indicated to proceed directly to subsequent steps. In summary, ADNI‐4 has adopted mri_reface because it successfully de‐faces without substantially affecting brain measurements.
Implementation and Validation of Face De‐Identification (de‐facing) in ADNI‐4
AbstractBackgroundRecent advances in automatic face recognition have increased the risk that de‐identified research imaging data could be re‐identified from face imagery in brain scans.MethodAn ADNI committee of independent imaging experts evaluated 11 published techniques for face‐deidentification (“de‐facing”) and selected four algorithms (FSL‐UK Biobank, HCP/XNAT, mri_reface, and BIC) for formal testing using 183 longitudinal scans of 61 racially and ethnically diverse ADNI participants, evaluated by their facial feature removal on 3D rendered surfaces (confirming sufficient privacy protection) and by comparing measurements from ADNI routine image analyses on unmodified vs. de‐faced images (confirming negligible side effects on analyses).ResultEffects of the de‐facing methods on FreeSurfer at UCSF (Figure 1‐top), ASHS at University of Pennsylvania (Figure 1 bottom‐left), and longitudinal atrophy at Mayo Clinic (Figure 1 bottom‐right) were comparable with each other and sufficiently small vs. unmodified scans to recommend de‐facing in ADNI‐4. The FSL and mri_reface methods were more thorough in removing facial features, partly because these also removed ears (Figure 2‐top). mri_reface was recommended for ADNI‐4 primarily because fewer (zero) images had modified brain (Figure 2‐bottom), and ADNI leadership approved de‐facing with mri_reface. ADNI performed a second validation of its latest version on another diverse sample of 100 ADNI‐3 participants. These analyses included: boundary shift interval at University College London, where average differences in measurements were all <0.05%; cortical white matter hyperintensities at UC Davis, where they found “minimum impact” (R>0.97); and others.ConclusionADNI‐4 de‐faces all indicated image types (Table 1) before subsequent pre‐processing, analyses, and public release. Sites upload images to the central repository (LONI), where they are queued to the MRI Core at Mayo Clinic for de‐facing. Image types requiring de‐facing are de‐faced using mri_reface. Trained analysts inspect de‐faced images to confirm complete removal of the face and complete non‐modification of the brain, and any flagged images are re‐processed manually until issues are resolved. De‐faced images are converted back to DICOM and re‐uploaded for further distribution. Image types not requiring de‐facing are indicated to proceed directly to subsequent steps. In summary, ADNI‐4 has adopted mri_reface because it successfully de‐faces without substantially affecting brain measurements.
Implementation and validation of face de‐identification (de‐facing) in ADNI4
AbstractINTRODUCTIONRecent technological advances have increased the risk that de‐identified brain images could be re‐identified from face imagery. The Alzheimer's Disease Neuroimaging Initiative (ADNI) is a leading source of publicly available de‐identified brain imaging, who quickly acted to protect participants’ privacy.METHODSAn independent expert committee evaluated 11 face‐deidentification (“de‐facing”) methods and selected four for formal testing.RESULTSEffects of de‐facing on brain measurements were comparable across methods and sufficiently small to recommend de‐facing in ADNI. The committee ultimately recommended mri_reface for advantages in reliability, and for some practical considerations. ADNI leadership approved the committee's recommendation, beginning in ADNI4.DISCUSSIONADNI4 de‐faces all applicable brain images before subsequent pre‐processing, analyses, and public release. Trained analysts inspect de‐faced images to confirm complete face removal and complete non‐modification of brain. This paper details the history of the algorithm selection process and extensive validation, then describes the production workflows for de‐facing in ADNI.Highlights ADNI is implementing “de‐facing” of MRI and PET beginning in ADNI4. “De‐facing” alters face imagery in brain images to help protect privacy. Four algorithms were extensively compared for ADNI and mri_reface was chosen. Validation confirms mri_reface is robust and effective for ADNI sequences. Validation confirms mri_reface negligibly affects ADNI brain measurements.