Abstract Background An international Delphi panel has defined a harmonized protocol (HarP) for the manual segmentation of the hippocampus on MR. The aim of this study is to study the concurrent validity of the HarP toward local protocols, and its major sources of variance. Methods Fourteen tracers segmented 10 Alzheimer's Disease Neuroimaging Initiative (ADNI) cases scanned at 1.5 T and 3T following local protocols, qualified for segmentation based on the HarP through a standard web‐platform and resegmented following the HarP. The five most accurate tracers followed the HarP to segment 15 ADNI cases acquired at three time points on both 1.5 T and 3T. Results The agreement among tracers was relatively low with the local protocols (absolute left/right ICC 0.44/0.43) and much higher with the HarP (absolute left/right ICC 0.88/0.89). On the larger set of 15 cases, the HarP agreement within (left/right ICC range: 0.94/0.95 to 0.99/0.99) and among tracers (left/right ICC range: 0.89/0.90) was very high. The volume variance due to different tracers was 0.9% of the total, comparing favorably to variance due to scanner manufacturer (1.2), atrophy rates (3.5), hemispheric asymmetry (3.7), field strength (4.4), and significantly smaller than the variance due to atrophy (33.5%, P < .001), and physiological variability (49.2%, P < .001). Conclusions The HarP has high measurement stability compared with local segmentation protocols, and good reproducibility within and among human tracers. Hippocampi segmented with the HarP can be used as a reference for the qualification of human tracers and automated segmentation algorithms.
Harmonized benchmark labels of the hippocampus on magnetic resonance: The EADC‐ADNI project
AbstractBackgroundA globally harmonized protocol (HarP) for manual hippocampal segmentation based on magnetic resonance has been recently developed by a task force from European Alzheimer's Disease Consortium (EADC) and Alzheimer's Disease Neuroimaging Initiative (ADNI). Our aim was to produce benchmark labels based on the HarP for manual segmentation.MethodsFive experts of manual hippocampal segmentation underwent specific training on the HarP and segmented 40 right and left hippocampi from 10 ADNI subjects on both 1.5 T and 3 T scans. An independent expert visually checked segmentations for compliance with the HarP. Descriptive measures of agreement between tracers were intraclass correlation coefficients (ICCs) of crude volumes and similarity coefficients of three‐dimensional volumes.ResultsTwo hundred labels have been provided for the 20 magnetic resonance images. Intra‐ and interrater ICCs were >0.94, and mean similarity coefficients were 1.5 T, 0.73 (95% confidence interval [CI], 0.71–0.75); 3 T, 0.75 (95% CI, 0.74–0.76).ConclusionCertified benchmark labels have been produced based on the HarP to be used for tracers' training and qualification.
Delphi definition of the EADC‐ADNI Harmonized Protocol for hippocampal segmentation on magnetic resonance
Abstract Background This study aimed to have international experts converge on a harmonized definition of whole hippocampus boundaries and segmentation procedures, to define standard operating procedures for magnetic resonance (MR)‐based manual hippocampal segmentation. Methods The panel received a questionnaire regarding whole hippocampus boundaries and segmentation procedures. Quantitative information was supplied to allow evidence‐based answers. A recursive and anonymous Delphi procedure was used to achieve convergence. Significance of agreement among panelists was assessed by exact probability on Fisher's and binomial tests. Results Agreement was significant on the inclusion of alveus/fimbria ( P = .021), whole hippocampal tail ( P = .013), medial border of the body according to visible morphology ( P = .0006), and on this combined set of features ( P = .001). This definition captures 100% of hippocampal tissue, 100% of Alzheimer’s disease‐related atrophy, and demonstrated good reliability on preliminary intrarater (0.98) and inter‐rater (0.94) estimates. Discussion Consensus was achieved among international experts with respect to hippocampal segmentation using MR resulting in a harmonized segmentation protocol.
O2‐11‐02: Definition of harmonized protocol for hippocampal segmentation