ObjectivesAchalasia is an esophageal motility disorder that impairs quality of life and is often missed (20–50%) on endoscopy. A newly developed computer‐aided detection (CAD) software has shown high accuracy for achalasia diagnosis in preclinical settings. However, its benefit in a clinical setting remains unclear.MethodsBetween February and August 2023, 83 endoscopists from 27 centers assessed 50 randomized endoscopic videos (25 achalasia, 25 nonachalasia) without and with CAD. Endoscopists assessed videos without CAD, then with CAD after 2 months. The primary end‐point was improvement in sensitivity for nonexperienced endoscopists (no endoscopic experience of achalasia). Sensitivity, specificity, and accuracy with and without CAD were compared using the McNemar test.ResultsSensitivity for diagnosing achalasia increased significantly with CAD, rising from 74.2% (95% confidence interval [CI] 72.2–76.0%) to 91.2% (95% CI 89.9–92.4%) for all readers, showing a difference of 17.1% (95% CI 15.1–19.0%). Specifically, sensitivity improved from 66.9% (95% CI 63.6–70.0%) to 91.9% (95% CI 89.9–93.6%) among nonexperienced endoscopists, resulting in a difference of 25.0% (95% CI 21.7–28.4%), and from 79.5% (95% CI 77.1–81.8%) to 90.8% (95% CI 89.0–92.3%) among experienced endoscopists (endoscopic experience of at least one achalasia case), with a difference of 11.3% (95% CI 8.9–13.6%). Accuracy and specificity improved significantly with CAD assistance, regardless of reader's experience.ConclusionCAD improves achalasia detection by 17%, confirming preclinical results. The benefit was higher for nonexperienced endoscopists. CAD assistance may lead to prompt and effective treatment, minimizing the risk of false‐negative diagnosis in clinical practice.Trial registrationThis study was registered in the University Hospital Medical Information Network Clinical Trial Registry (https://www.umin.ac.jp/ctr/) number: UMIN000053047.
International Validation of a Novel PEACE Scale to Improve the Quality of Upper Gastrointestinal Mucosal Inspection During Endoscopy
INTRODUCTION: The performance of a high quality esophagogastroduodenoscopy (EGD) is dependent on the mucosal cleanliness. Recently, the Polprep: Effective Assessment of Cleanliness in EGD (PEACE) scale was created to assess the degree of mucosal cleanliness during EGD. The aim of this study was to validate this scoring system in a cohort of international endoscopists. METHODS: In total, 39 EGD videos, with different degrees of mucosal cleanliness were retrieved from a previously conducted prospective trial. All experts rated the cleanliness of the mucosa on each video using the PEACE scale. To evaluate agreement of all scores (0–3), intraclass correlation coefficient 2.1 was used. The agreement on adequate (scores 2 and 3) and inadequate (scores 0 and 1) cleanliness was assessed using kappa values. RESULTS: Videos evaluating esophagus, stomach, and duodenum cleanliness were reviewed by 16 endoscopists. The PEACE scores demonstrated good agreement (intraclass correlation coefficient 0.82, 95% CI 0.75–0.89), especially for esophagus (0.84; 95% CI 0.71–0.95) and stomach (0.81; 95% CI 0.69–0.91), while agreement was moderate for the duodenum (0.69; 95% CI 0.51–0.87). The agreement was similar between Eastern (0.86; 95% CI 0.79–0.92) and Western experts (0.80; 95% CI 0.72–0.88). Similarly, agreement regarding adequate cleanliness was comparable between Eastern (0.70; 95% CI 0.55–0.85) and Western (0.74; 95% CI 0.64–0.84) endoscopists being overall 0.75 (95% CI 0.65–0.85). DISCUSSION: The PEACE scoring system is a simple and reliable scale to assess the cleanliness during EGD. The score is now validated among international experts with high concordance, justifying its use in clinical practice.
Can optical evaluation distinguish between T1a and T1b esophageal adenocarcinoma: an international expert interobserver agreement study
Background Piecemeal endoscopic mucosal resection (EMR) is an acceptable technique for T1a esophageal adenocarcinoma, but en bloc R0 excision is advocated for T1b disease as it may offer a potential cure and mitigate recurrence. Thus, distinguishing between T1a and T1b disease is imperative under current treatment paradigms. We investigated whether expert Barrett’s endoscopists could make this distinction based on optical evaluation. Methods Endoscopic images of histologically confirmed high grade dysplasia (HGD), T1a, and T1b disease (20 sets for each) were compiled from consecutive patients at a single institution. Each set contained four images including an overview, a close-up in high definition white light, a near-focus magnification image, and a narrow-band image. Experts predicted the histology for each set. Results 19 experts from 8 countries (Australia, USA, Italy, Netherlands, Germany, Canada, Belgium, and Portugal) participated. The majority had been practicing for > 20 years, with a median (interquartile range) annual case volume of 50 (18–75) for Barrett’s EMR and 25 (10–45) for Barrett’s endoscopic submucosal dissection. Esophageal adenocarcinoma (T1a/b) could be distinguished from HGD with a pooled sensitivity of 89.1 % (95 %CI 84.7–93.4). T1b adenocarcinoma could be predicted with a pooled sensitivity of 43.8 % (95 %CI 29.9–57.7). Fleiss’ kappa was 0.421 (95 %CI 0.399–0.442; P < 0.001), indicating fair-to-moderate agreement. Conclusions Expert Barrett’s endoscopists could reliably differentiate T1a/T1b esophageal adenocarcinoma from HGD. Despite fair-to-moderate agreement for T staging, T1b disease could not be reliably distinguished from T1a disease. This may impact clinical decision making and selection of endoscopic techniques.
International validation of a PEACE scale assessing cleanliness during esophagogastroduodenoscopy to improve the quality of inspection during endoscopy
Background The first commercialized single-use duodenoscope was cleared by the US Food and Drug Administration in December 2019. Data regarding endoscopic retrograde cholangiopancreatography (ERCP) using a single-use duodenoscope are needed on a broader range of cases conducted by endoscopists with varying levels of experience in a wide range of geographic areas. Methods 61 endoscopists at 22 academic centers in 11 countries performed ERCP procedures in adult patients aged ≥ 18. Outcomes included ERCP completion for the intended indication, rate of crossover to a reusable endoscope, device performance ratings, and serious adverse events (SAEs). Results Among 551 patients, 236 (42.8 %) were aged > 65, 281 (51.0 %) were men, and 256 (46.5 %) had their procedure as an inpatient. ERCPs included 196 (35.6 %) with American Society for Gastrointestinal Endoscopy complexity of grades 3–4. A total of 529 ERCPs (96.0 %) were completed: 503 (91.3 %) using only the single-use duodenoscope, and 26 (4.7 %) with crossover to a reusable endoscope. There were 22 ERCPs (4.0 %) that were not completed, of which 11 (2.0 %) included a crossover and 11 (2.0 %) were aborted cases (no crossover). Median ERCP completion time was 24.0 minutes. Median overall satisfaction with the single-use duodenoscope was 8.0 (scale of 1 to 10 [best]). SAEs were reported in 43 patients (7.8 %), including 17 (3.1 %) who developed post-ERCP pancreatitis. Conclusions In academic medical centers over a wide geographic distribution, endoscopists with varying levels of experience using the first marketed single-use duodenoscope had good ERCP procedural success and reported high performance ratings for this device.