Background. Assessment tools in surgical education help identify improvement areas for trainees. We developed and present validity evidence for a novel Transplant Operative Assessment Tool to optimize technical feedback for surgical trainees in transplantation. Methods. The Transplant Operative Assessment Tool assesses learners on anatomy, technical skills, judgment, and communication. Performance is rated across 5 competency levels. Content validity evidence included a construct map using existing literature and expert cognitive interviews. Ratings were used to develop an item response theory calibration, which was then used to evaluate the tool and provide validity evidence. Results. Eighty-two assessments for 28 trainees (16 residents, 12 fellows) were completed by 25 faculty surgeons across 4 programs. Fifty-six kidney transplants, 13 liver transplants, and 13 donor nephrectomies were assessed. The mean assessment completion time was 4.1 ± 4.3 min. Internal structure validity was evaluated by calculating item infit (range, 0.86–1.15), indicating a strong model fit and confirming a high quality of items. Internal consistency was also high (Cronbach’s alpha = 0.94). There was a positive correlation between ratings and training level ( P < 0.01), indicating strong discriminatory power. Warm ischemia time for transplant operations did not correlate with performance ( P = 0.16). Conclusions. These data provide validity evidence for a novel operative assessment tool. This instrument can measure performance, monitor progress, document competency, and has the potential to provide valuable feedback.
Asynchronous Technical Feedback: A Workshop for Training Surgical Instructors
ABSTRACTObjectives:The aim of the present study was to investigate the natural history of chronic pancreatitis (CP); patients in the North American Pancreatitis Study2 (NAPS2, adults) and INternational Study group of Pediatric Pancreatitis: In search for a cuRE (INSPPIRE, pediatric) were compared.Methods:Demographics, risk factors, disease duration, management and outcomes of 224 children and 1063 adults were compared using appropriate statistical tests for categorical and continuous variables.Results:Alcohol was a risk in 53% of adults and 1% of children (P < 0.0001); tobacco in 50% of adults and 7% of children (P < 0.0001). Obstructive factors were more common in children (29% vs 19% in adults, P = 0.001). Genetic risk factors were found more often in children. Exocrine pancreatic insufficiency was similar (children 26% vs adult 33%, P = 0.107). Diabetes was more common in adults than children (36% vs 4% respectively, P < 0.0001). Median emergency room visits, hospitalizations, and missed days of work/school were similar across the cohorts. As a secondary analysis, NAPS2 subjects with childhood onset (NAPS2‐CO) were compared with INSPPIRE subjects. These 2 cohorts were more similar than the total INSPPIRE and NAPS2 cohorts, including for genetic risk factors. The only risk factor significantly more common in the NAPS2‐CO cohort compared with the INSPPIRE cohort was alcohol (9% NAPS2‐CO vs 1% INSPPIRE cohorts, P = 0.011).Conclusions:Despite disparity in age of onset, children and adults with CP exhibit similarity in demographics, CP treatment, and pain. Differences between groups in radiographic findings and diabetes prevalence may be related to differences in risk factors associated with disease and length of time of CP.