Shackelton, L

Abstract Background Progress in clinical trials and drug development for paediatric perianal fistulising CD (pfCD) depends upon accurate, reproducible imaging to assess disease activity and measure treatment response. We evaluated the inter- and intra-rater reliability of existing radiologic disease activity indices and anatomical classification systems previously identified as appropriate for assessment of paediatric pfCD.1 Methods A retrospective cohort (N=50) of magnetic resonance imaging (MRI) exams representing a full spectrum of paediatric (<18 years) perianal CD severity was selected by a single expert paediatric radiologist. Methods described by Zou2 were used to estimate sample size. Three separate radiologists (2 paediatric) blinded to clinical information assessed pfCD in the exams using the Magnetic Resonance Novel Index for Fistula Imaging in CD (MAGNIFI-CD), Van Assche Index (VAI), modified VAI (mVAI), Paediatric MRI based Perianal Crohn’s disease (PEMPAC) index, a visual analogue scale (VAS) of overall pfCD disease severity (range, 0-100 mm), as well as with the Park’s and St. James University Hospital anatomic classification systems. Two radiologists read all exams twice, separated by 2 weeks, and 1 radiologist read the exams once (250 total reads). Intra- and inter-rater reliability was evaluated using intraclass correlation coefficients (ICC; equivalent to weighted kappa). Precision of the ICC estimates was quantified with 95% confidence intervals (CIs) obtained using clustered bootstrapping. Degree of reliability was interpreted with benchmarks proposed by Landis and Koch3. Results Median age of children was 13.5 years (IQR 11.4-16.1), and 64% were male. Median Paediatric Crohn’s Disease Activity Index score at time of imaging was 17.5 (IQR 10-32.5). Substantial (ICC>0.61) inter-rater reliability was observed for MAGNIFI-CD, VAI, and mVAI (Table 1), with the highest ICCs observed for the mVAI (0.72 [0.6 to 0.79]). Moderate (ICC>0.41) inter-rater reliability was observed for PEMPAC, St. James University Hospital classification, and the VAS, and fair (ICC>0.21) inter-rater reliability was observed for Parks classification. Intra-rater reliability was nearly perfect (ICC>0.81) for the VAS, and substantial for all indices except for Parks classification, which had moderate (0.60 [0.44 to 0.75]) intra-rater reliability (Table 1). Conclusion Most existing multi-item MRI-based disease activity indices and the St. James Hospital classification were reliable for the assessment of paediatric pfCD in our cohort. Our preliminary results suggest that the disease activity indices may have utility to measure treatment effect in paediatric pfCD clinical trials. References 1.Crowley E, Ma C, Guizzetti L, Zou G, Lewindon PJ, Gee MS, et al. Recommendations for Standardizing MRI-based Evaluation of Perianal Fistulizing Disease Activity in Pediatric Crohn's Disease Clinical Trials. Inflamm Bowel Dis. 2024;30(3):357-69. 2.Zou GY. Sample size formulas for estimating intraclass correlation coefficients with precision and assurance. Statistics in Medicine. 2012;31(29):3972-398 3.Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;33(1):159-74.

Abstract Background Computed tomography enterography (CTE) is frequently used to assess stricturing Crohn’s disease (CD). However, the reliability of CTE items used for assessment has not been established and there is no validated radiologic stricture severity index. Methods We conducted a retrospective study of 43 patients with symptomatic, terminal ileal stricturing CD. Four radiologists assessed a comprehensive list of pre-defined radiologic items potentially associated with stricture severity in 48 CTE scans in two separate rounds in random order. Reliability was quantified using the intraclass correlation coefficient (ICC). Items with at least moderate (ICC≥0.41) inter-rater reliability that were correlated with a visual analogue scale of overall stricture severity were candidate items for the development of a CTE stricture index. Results Inter-rater reliability was almost perfect for assessment of luminal diameter of pre-stenotic dilation (ICC 0.817 [95% confidence interval 0.703, 0.878]), substantial for stricture length (ICC 0.628 [0.419, 0.797]), and moderate for stricture wall thickness (0.482 [0.330, 0.601]). Intra-rater reliability was almost perfect (ICC ≥ 0.850) for all three items. A stricture severity index was derived and was well calibrated (optimism-adjusted calibration slope = 1.009), with scores calculated as the sum of stricture length (cm) + luminal diameter of pre-stenotic dilation (mm) + 5 x stricture wall thickness (mm). Conclusion Stricture length, prestenotic dilation, and stricture wall thickness can be reliably assessed, and are component items for a novel CTE stricture index (CTE-SI) of stricture severity for CD-related terminal ileal strictures. Additional external index validation for clinical and research contexts is required.