Colletti, James

AbstractBackgroundIn 2013 the Accreditation Council for Graduate Medical Education (ACGME) introduced “Milestones” designed to nationally standardize the assessment of resident physicians. Previous studies compare resident self‐assessment on milestones to faculty assessment, with varying degrees of agreement, but integration of self‐assessment into the formative feedback process has not yet been directly studied. This study uses a conceptual framework of self‐determination theory, integrated with concepts from adult learning theory, to compare the perception of the feedback quality given in semiannual reviews before and after the incorporation of resident self‐assessment into the feedback process.MethodsThis was an interventional study conducted in a single emergency medicine residency program at a major academic hospital over 1 calendar year. Residents first engaged in a semiannual review without self‐assessment. At subsequent semiannual reviews, residents completed a Milestone‐based self‐assessment that was provided to the faculty member assigned to conduct their semiannual review. Residents and faculty completed surveys rating perception of feedback quality. Two‐sided Wilcoxon signed‐rank tests were used in comparison analysis.ResultsOne resident did not self‐assess prior to the semiannual review and was excluded leaving 25 paired surveys for analysis. Residents found feedback after the self‐assessment more actionable (p = 0.013), insightful (p = 0.010), and better overall (p = 0.025). Similarly, faculty felt the feedback they provided was more actionable (p < 0.001), more insightful (p < 0.001), and better communicated (p < 0.001); led to improved resident understanding of milestones (p < 0.001); and were overall more satisfied (p < 0.001). Free‐text comments explore pre‐ and postintervention perceptions of feedback.ConclusionsIntegration of self‐assessment into semiannual reviews improves perception of feedback given to residents as perceived by both residents and faculty. Although limited by sample size, the results are promising for a simple, evidence‐based intervention to improve feedback during an existing mandated feedback opportunity.

Abstract Background: Awareness of burnout has led residency programs to seek interventions to promote well-being, resiliency, camaraderie and social network development. Limited evidence exists on the efficacy of specific interventions. This study evaluated the efficacy of an emergency medicine residency program’s semi-annual retreat using serial administration of the Maslach burnout index and resident well-being survey.Methods: Surveys were administered to all emergency medicine residents (n=25) in July 2018 and before and after fall 2018 and winter 2019 retreats. Retreats included a meal, team building, and social networking opportunities (bowling, softball, snow tubing, and sledding). Comparisons of responses between baseline, pre-retreat, and post-retreat were evaluated using two-sample t, Wilcoxon rank sum, and Fisher exact tests. Results: Sixteen emergency medicine residents (64%) responded at baseline. Response rates on subsequent surveys ranged from 14 (56%) to 21 (84%). Nineteen percent of residents exhibited burnout at baseline. This peaked at 36% pre-winter retreat. Burnout decreased after each retreat (fall: 29% to 6%, winter: 36% to 13%). Mean Maslach burnout index subscores for emotional exhaustion (13 to 9) and depersonalization (7 to 5) decreased from baseline to post-fall retreat, but neither changed significantly over the entire study period (emotional exhaustion: 13 to 12, depersonalization: 7 to 6). Resident well-being survey pre- and post-retreat responses were similar on all items.Conclusion: Meaningful, but not statistically significant differences were detected on the Maslach burnout index and resident well-being survey in association with a retreat. Mean emotional exhaustion, depersonalization and burnout decreased after retreats. Larger studies would provide further insight into the significance of these trends.

Abstract Background Awareness of burnout has led residency programs to seek interventions to promote well-being, resiliency, camaraderie and social network development. Limited evidence exists on the efficacy of specific interventions. This study evaluated the efficacy of an emergency medicine residency program’s semi-annual retreat using serial administration of the Maslach burnout index and resident well-being survey. Methods Surveys were administered to all emergency medicine residents (n = 25) in July 2018 and before and after fall 2018 and winter 2019 retreats. Retreats included a meal, team building, and social networking opportunities (bowling, softball, snow tubing, and sledding). Comparisons of responses between baseline, pre-retreat, and post-retreat were evaluated using two-sample t, Wilcoxon rank sum, and Fisher exact tests. Results Sixteen emergency medicine residents (64%) responded at baseline. Response rates on subsequent surveys ranged from 14 (56%) to 21 (84%). Nineteen percent of residents exhibited burnout at baseline. This peaked at 36% pre-winter retreat. Burnout decreased after each retreat (fall: 29–6%, winter: 36–13%). Mean Maslach burnout index subscores for emotional exhaustion (13 to 9) and depersonalization (7 to 5) decreased from baseline to post-fall retreat, but neither changed significantly over the entire study period (emotional exhaustion: 13 to 12, depersonalization: 7 to 6). Resident well-being survey pre- and post-retreat responses were similar on all items. Conclusion Meaningful, but not statistically significant differences were detected on the Maslach burnout index and resident well-being survey in association with a retreat. Mean emotional exhaustion, depersonalization and burnout decreased after retreats. Larger studies would provide further insight into the significance of these trends.