Ye, Xiang Y.

AbstractObjectiveTo evaluate inter‐rater agreement for sonographic classification of stomach position (as a surrogate for liver herniation) in fetal left congenital diaphragmatic hernia (LCDH) among: (i) fetal medicine specialists from the North American Fetal Therapy Network (NAFTNet) centers within and without the fetal endoscopic tracheal occlusion (FETO) consortium and in comparison to an expert external reviewer (ER1); and (iii) among two expert ERs (ER1 and ER2).MethodsForty‐eight physicians from 26 NAFTNet centers and 2 ERs were asked to assess 13 sonographic clips of isolated LCDH and classify stomach position as “intra‐abdominal,” “anterior left chest,” “mid to posterior left chest,” or “retro‐cardiac" based on the classification published by Basta et al.8 Interrater agreement was assessed by determining proportion of stomach position ratings concordant amongst NAFTNet participants and ER1. Agreement for stomach position between ERs was calculated using kappa statistics.ResultsAgreement for stomach position was 69% (39%–85%; n = 19) and 54% (23%–92%; n = 29) among FETO and non‐FETO NAFTNet participants, respectively, when compared to ER1. Most disagreement in stomach position was related to a discrepancy of one position. ERs were in agreement for stomach position in 5 of 13 cases (38.5%) and inter‐rater agreement was highest for “anterior” stomach position.ConclusionInterrater agreement for stomach position assessment in CDH was poor across NAFTNet and indeed amongst expert reviewers.

AbstractObjectiveTo determine the antenatal sonographic lung area measurement method in left congenital diaphragmatic hernia (CDH) with the highest interrater agreement among North American Fetal Therapy Network (NAFTNet) centers within and outside the fetoscopic tracheal occlusion (FETO) consortium and in comparison with a European “expert” reviewer (ER).MethodsNineteen members from nine FETO consortium centers and 29 reviewers from 17 non‐FETO centers reviewed ultrasound clips of the chest from 13 fetuses with isolated left CDH and were asked to select a static plane for lung area measurement using anteroposterior (AP), longest, and trace methods. Interrater agreement in lung area measurements was determined using intraclass correlation coefficient (ICC). Bland‐Altman analysis was used to evaluate mean difference (bias) between NAFTNet reviewers and ER.ResultsAmong FETO centers, agreement was highest using trace (ICC 0.94; 95% CI, 0.83‐0.98), followed by longest (ICC 0.89; 95% CI, 0.75‐0.97) and lowest for A‐P (ICC 0.83; 95% CI, 0.67‐0.94). Similar trends were noted in non‐FETO centers. When compared with ER, bias was lowest for trace: 14 ± 38 mm2 and 19 ± 36 mm2 for FETO and non‐FETO centers, respectively.ConclusionThe trace method demonstrated the highest interrater agreement and lowest bias for lung area estimation in left CDH across NAFTNet.