Halvorsen, Andrew J.

Alignment between institutions and graduate medical education (GME) regarding quality and safety initiatives (QI) has not been measured. The objective was to determine US internal medicine residency program directors’ (IM PDs) perceived resourcing for QI and alignment between GME and their institutions. A national survey of IM PDs was conducted in the Fall of 2013. Multivariable linear regression was used to test association between a novel Integration Score (IS) measuring alignment between GME and the institution via PD perceptions. The response rate was 72.6% (265/365). According to PDs, residents were highly engaged in QI (82%), but adequate funding (14%) and support personnel (37% to 61%) were lower. Higher IS correlated to reports of funding for QI (76.3% vs 54.5%, P = .012), QI personnel (67.3% vs 41.1%, P < .001), research experts (70.5% vs 50.0%, P < .001), and computer experts (69.0% vs 45.8%, P < .001) for QI assistance. Apparent mismatch between GME and institutional resources exists, and the IS may be useful in measuring GME–institutional leadership alignment in QI.

Purpose To begin to quantify and understand the use of the flipped classroom (FC)—a progressive, effective, curricular model—in internal medicine (IM) education in relation to residency program and program director (PD) characteristics. Method The authors conducted a survey that included the Flipped Classroom Perception Instrument (FCPI) in 2015 regarding programs’ use and PDs’ perceptions of the FC model. Results Among the 368 IM residency programs, PDs at 227 (61.7%) responded to the survey and 206 (56.0%) completed the FCPI. Regarding how often programs used the FC model, 34 of the 206 PDs (16.5%) reported “never”; 44 (21.4%) reported “very rarely”; another 44 (21.4%) reported “somewhat rarely”; 59 (28.6%) reported “sometimes”; 16 (7.8%) reported “somewhat often”; and 9 (4.4%) reported “very often.” The mean FCPI score (standard deviation [SD]) for the in-class application factor (4.11 [0.68]) was higher (i.e., more favorable) than for the preclass activity factor (3.94 [0.65]) ( P < .001). FC perceptions (mean [SD]) were higher among younger PDs (≤ 50 years, 4.12 [0.62]; > 50 years, 3.94 [0.61]; P = .04) and women compared with men (4.28 [0.56] vs. 3.91 [0.62]; P < .001). PDs with better perceptions of FCs had higher odds of using FCs (odds ratio, 4.768; P < .001). Conclusions Most IM programs use the FC model at least to some extent, and PDs prefer the interactive in-class components over the independent preclass activities. PDs who are women and younger perceived the model more favorably.

Purpose To examine internal medicine (IM) residency program directors’ (PDs’) perspectives on the Core Entrustable Professional Activities for Entering Residency (Core EPAs)—introduced into undergraduate medical education to further competency-based assessment—and on communicating competency-based information during transitions. Method A spring 2015 Association of Program Directors in Internal Medicine survey asked PDs of U.S. IM residency programs for their perspectives on which Core EPAs new interns must or should possess on day 1, which are most essential, and which have the largest gap between expected and observed performance. Their views and preferences were also requested regarding communicating competency-based information at transitions from medical school to residency and residency to fellowship/employment. Results The response rate was 57% (204/361 programs). The majority of PDs felt new interns must/should possess 12 of the 13 Core EPAs. PDs’ rankings of Core EPAs by relative importance were more varied than their rankings by the largest gaps in performance. Although preferred timing varied, most PDs (82%) considered it important for medical schools to communicate Core EPA-based information to PDs; nearly three-quarters (71%) would prefer a checklist format. Many (60%) would be willing to provide competency-based evaluations to fellowship directors/employers. Most (> 80%) agreed that there should be a bidirectional communication mechanism for programs/employers to provide feedback on competency assessments. Conclusions The gaps identified in Core EPA performance may help guide medical schools’ curricular and assessment tool design. Sharing competency-based information at transitions along the medical education continuum could help ensure production of competent, practice-ready physicians.

Purpose The flipped classroom (FC), in which instructional content is delivered before class with class time devoted to knowledge application, has the potential to engage residents. A Mayo Clinic Internal Medicine Residency Program study was conducted to validate an FC perception instrument (FCPI); determine whether participation improved FC perceptions; and determine associations between resident characteristics, change in quality improvement (QI) knowledge, and FC perception scores. Method All 143 internal medicine residents at Mayo Clinic, Rochester participated from 2014 to 2015; some experienced a flipped QI curriculum and others completed the traditional nonflipped course. The FCPI was developed, and factor analysis revealed an intuitive two-factor structure: preclass activity and in-class application. Residents were surveyed before and after the monthlong curriculum to measure changes in perception, and the QI Knowledge Assessment Tool was employed to measure knowledge improvement. Results Postcourse FCPI scores significantly increased for three of the eight items. QI knowledge increased significantly among residents who experienced the FC compared with residents who completed the non-FC curriculum. Those without prior FC exposure demonstrated a significant increase in QI knowledge compared with those with previous FC experience. The FCPI had compelling validity evidence with improved scores after curriculum exposure and associations with greater engagement in online modules. Conclusions Residents who participated in the FC demonstrated improved QI knowledge compared with the control group. Residents valued the in-class application sessions more than the online component. These findings have important implications for graduate medical education as residency training programs increasingly use FC models.

BACKGROUNDPrior studies suggest that high workload among attending physicians may be associated with reduced teaching effectiveness and poor patient outcomes, but these relationships have not been investigated using objective measures of workload and safety.OBJECTIVETo examine associations between attending workload, teaching effectiveness, and patient safety, hypothesizing that higher workload would be associated with lower teaching effectiveness and negative patient outcomes.DESIGN, SETTING, AND PARTICIPANTSWe conducted a retrospective study of 69,386 teaching evaluation items submitted by 543 internal medicine residents for 107 attending physicians who supervised inpatient teaching services from July 2, 2005 to July 1, 2011.MEASUREMENTSAttending workload measures included hospital service census, patient length of stay, daily admissions, daily discharges, and concurrent outpatient duties. Teaching effectiveness was measured using residents' evaluations of attendings. Patient outcomes considered were applicable patient safety indicators (PSIs), intensive care unit transfers, cardiopulmonary resuscitation/rapid response team calls, and patient deaths. Mixed linear models and generalized linear regression models were used for statistical analysis.RESULTSWorkload measures of midnight census and daily discharges were associated with lower teaching evaluation scores (both β = −0.026, P < 0.0001). The number of daily admissions was associated with higher teaching scores (β = 0.021, P = 0.001) and increased PSIs (odds ratio = 1.81, P = 0.0001).CONCLUSIONSeveral measures of attending physician workload were associated with slightly lower teaching effectiveness, and patient safety may be compromised when teams are managing new admissions. Ongoing efforts by residency programs to optimize the learning environment should include strategies to manage the workload of supervising attendings. Journal of Hospital Medicine 2016;11:169–173. © 2016 Society of Hospital Medicine

Purpose To summarize characteristics and validity evidence of tools that assess teamwork in undergraduate medical education (UME), and provide recommendations for addressing the interprofessional collaboration competencies of the Association of American Medical Colleges (AAMC). Method The authors conducted a systematic review, searching MEDLINE, MEDLINE In-process, CINAHL, and PsycINFO from January 1, 1979, through April 1, 2014; they searched reference lists and national meeting abstracts. They included original research reports that described a quantitative tool used to assess teamwork in UME. They abstracted characteristics and validity evidence for the tools, plus study quality, according to established frameworks. Two authors independently abstracted 25% of articles and calculated agreement. Authors then applied predefined criteria to identify tools best suited to address the AAMC’s teamwork competencies. Results Of 13,549 citations, 70 articles describing 64 teamwork assessment tools were included. Of these 64 tools, 27 (42%) assessed teamwork in classroom, 31 (48%) in simulation, and only 7 (11%) in actual clinical settings. The majority (47; 73%) of tools assessed medical students’ teamwork in interprofessional teams. On the basis of content concordance, strength of validity evidence, generalizability of scores, and level of outcomes, four published tools were recommended to assess the AAMC’s teamwork competencies: the Collaborative Healthcare Interdisciplinary Relationship Planning Scale, Readiness for Interprofessional Learning Scale, Communication and Teamwork Skills assessment, and Teamwork Mini-Clinical Evaluation Exercise. Conclusions Substantial validity evidence supports the use of several UME teamwork assessments. Four tools have been appropriately designed and sufficiently studied to constitute appropriate assessments of the AAMC’s teamwork competencies.

ABSTRACT Background Point-of-care ultrasound is a rapidly evolving component of internal medicine (IM) residency training. The optimal approach for teaching this skill remains unclear. Objective We sought to determine whether the addition of a longitudinal ultrasound curriculum to a stand-alone workshop for ultrasound training improved knowledge retention in IM residents. Methods We conducted an observational cohort study from July to December 2013. All postgraduate year (PGY)-1 IM residents attended an ultrasound workshop during orientation. Ability to identify static images of ascites, kidney, thyroid, pleural fluid, inferior vena cava, and internal jugular vein was assessed immediately after the workshop. An ultrasound curriculum, including morning report and ultrasound rounds, was initiated during the inpatient medicine rotation. PGY-1 residents were randomly assigned to participate in the longitudinal curriculum. Six months later, we conducted a follow-up survey with all PGY-1 residents. Results Forty-eight PGY-1 residents (67%) completed the postworkshop test and the 6-month follow-up test. Of these, 50% (24 of 48) had participated in the ultrasound curriculum. Residents not exposed to the curriculum showed a decline in the identification of ascites, pleural effusion, and internal jugular vein at 6 months (P &lt; .05), whereas those who participated in the curriculum maintained their performance (P &lt; .05). Conclusions Six months after exposure to a longitudinal ultrasound curriculum, residents were more likely to correctly identify ultrasound images of ascites, kidney, and pleural effusion. The addition of a longitudinal ultrasound curriculum may result in improved knowledge retention in IM residents.