Video-based assessment tool for workflow analysis in minimally invasive colorectal surgery: expert consensus-based development and multicentre validation of ColoWorkflow
Abstract Background Minimally invasive colorectal surgery is characterized by significant procedural variability, a difficult learning curve, and complications that affect patient outcomes. Video-based assessment offers an opportunity to generate data-driven insights to reduce variability, optimize training, and improve surgical performance. This mixed-methods study aimed to develop and validate a video-based assessment tool for workflow analysis across minimally invasive colorectal procedures. Methods An international steering committee panel of seven members coordinated a three-round modified Delphi process. Experts in colorectal surgery and video-based assessment were invited to reach consensus (≥ 70% agreement) on the phases and steps that describe workflows across colorectal surgery procedural videos. The resulting framework informed the development of ColoWorkflow. Four independent raters then applied ColoWorkflow to a multicentre video data set of laparoscopic and robotic colorectal procedures. Applicability and inter-rater reliability were evaluated. Results Of 66 invited experts, 41 (62%) from 11 countries completed round 1, 40 (98%) completed round 2, 20 attended the final online consensus meeting, and all (40 of 40) approved the final workflow descriptors. Consensus was achieved on nine procedure-agnostic phases (port placement and abdomen exploration; vascular dissection and ligation, mesocolon/mesorectum dissection, additional lymphadenectomy; colon and/or rectum mobilization; colorectal transection; anastomosis; completion of operation; preplanned additional procedures; unplanned procedures; extracorporeal procedures) and 34 procedure-specific steps that describe colorectal surgery workflows. ColoWorkflow was developed and applied to 54 colorectal surgery videos (left and right hemicolectomies, sigmoid and rectosigmoid resections, and total proctocolectomies) from five centres in four countries. The tool demonstrated broad applicability, as all phase and step labels, except one, were represented in at least one video. Inter-rater reliability was moderate, with a mean Cohen’s κ value of 0.72 for phases and 0.67 for steps. Most discrepancies arose at phase transitions and step boundary definitions. Conclusion Based on this preliminary work, ColoWorkflow is a promising tool for workflow analysis across minimally invasive colorectal procedures. Its adoption may help standardize training, accelerate competency acquisition, and advance data-informed surgical quality improvement.
Standardizing the Definition of Each Colon Cancer Segment: Delphi Consensus on Clinical Decision-Making for Oncologic Outcomes
BACKGROUND: Data registries lack a definitive classification system that distinguishes different locations of colon cancer from one another. OBJECTIVE: To establish an international consensus on the definition of primary colon cancer segment locations. DESIGN: Between December 2022 and June 2023, Delphi survey study was conducted to seek opinions from relevant international experts and eventually develop a consensus definition of each colon cancer segment. SETTING: Three-round online-based Delphi survey study. INTERVENTIONS: Online survey included 17 questions. In the first two rounds, participating experts were asked to rank each statement on a scale of 1–9 (9 is the most relevant). Consensus statements and definitions were revised according to results, obtaining a consensus score of 7–9. During the third round and online meeting, definitions and statements reached a moderate or high consensus(above 4 in more than 70% of participants) were included. MAIN OUTCOME AND MEASURE: Primary goal of our project was focused on precisely localizing the specific segment affected by primary colon cancer, rather than to identify surgical treatment or type of resection needed for particular segment. RESULTS: The first round included 331 experts, 301 (91%) completed the second round, and 295 (98%) completed the final round. Experts strongly supported the use of a “10 cm rule” to describe colon cancer sites at the flexures and anatomical landmarks for other segments. Regarding the definition of rectosigmoid cancer, experts from America and Europe reached a high consensus that the term rectosigmoid as a colon cancer location must be abolished in contrast to experts from Asia. Description of cancers overlapping segments achieved a consensus of 64%. LIMITATIONS: Subjective decisions are based on individual expert clinical experience. CONCLUSIONS: This Delphi survey, the first internationally conducted consensus study, achieved a remarkable level of consensus among a panel of global experts. Ambiguity still exists regarding overlapping lesions. See Video Abstract .