Fancher, Tonya L

Purpose To examine validity evidence for a standardized patient scenario assessing medical students’ ability to promote value using patient-centered communication (in response to a patient requesting an unnecessary test) and to explore the potential effect of various implementation and curricular factors on student scores. Method Third-year medical students (N = 516) from 5 U.S. MD-granting medical schools completed the communication scenario between 2014 and 2017 as part of a larger objective structured clinical examination (OSCE). Centralized raters assessed performance using an 11-item checklist. The authors collected multiple sources of validity evidence. Results The mean checklist score was 0.85 (standard deviation 0.09). Interrater reliability for checklist scores was excellent (0.87, 95% confidence interval = 0.78–0.93). Generalizability and Phi-coefficients were, respectively, 0.65 and 0.57. Scores decreased as the number of OSCE stations increased ( r = −0.15, P = .001) and increased when they were used for summative purposes ( r = 0.26, P < .001). Scores were not associated with curricular time devoted to high-value care ( r = 0.02, P = .67) and decreased when more clerkships were completed before the assessment ( r = −0.12, P = .006). Conclusions This multisite study provides validity evidence supporting the use of scenario scores to assess the ability of medical students to promote value in clinical encounters using patient-centered communication. Findings illuminate the potential effect of OSCE structure and purpose on student performance and suggest clerkship learning experiences may not reinforce what students are taught in the formal curriculum regarding high-value care. Devoting more time to the topic appears insufficient to counteract this erosion.

Purpose To describe attitudes of first- and second-year U.S. medical students toward value-added medical education, assess their self-reported desire to participate in value-added activities, and identify potentially modifiable factors influencing their engagement. Method The authors conducted a cross-sectional survey of first- and second-year students at nine U.S. medical schools in 2017. Survey items measured students’ attitudes toward value-added medical education (n = 7), desire to participate in value-added activities (n = 20), and factors influencing potential engagement (n = 18). Results Of 2,670 students invited to participate, 1,372 (51%) responded. Seventy-six percent (1,043/1,368) moderately or strongly agreed they should make meaningful contributions to patient care. Students’ desire to participate was highest for patient care activities approximating those traditionally performed by physicians, followed by systems improvement activities and lowest for activities not typically performed by physicians. Factors increasing desire to participate included opportunities to interact with practicing physicians (1,182/1,244; 95%), patients (1,177/1,246; 95%), and residents or fellows (1,166/1,246; 94%). Factors decreasing desire to participate included making changes to the health care system (365/1,227; 30%), interacting with patients via phone or electronic communication (410/1,243; 33%), and lack of curricular time (634/1,233; 51%). Conclusions First- and second-year medical students agree they should add value to patient care, but their desire to participate in value-added activities varies depending on the nature of the tasks. Medical schools may be able to increase students’ desire to participate by enabling face-to-face interactions with patients, embedding students in health care teams, and providing dedicated curricular time.

Purpose To examine medical student attitudes toward cost-conscious care and whether regional health care intensity is associated with reported exposure to physician role-modeling behaviors related to cost-conscious care. Method Students at 10 U.S. medical schools were surveyed in 2015. Thirty-five items assessed attitudes toward, perceived barriers to and consequences of, and observed physician role-modeling behaviors related to cost-conscious care (using scales for cost-conscious and potentially wasteful behaviors; Cronbach alphas of 0.82 and 0.81, respectively). Regional health care intensity was measured using Dartmouth Atlas End-of-Life Chronic Illness Care data: ratio of physician visits per decedent compared with the U.S. average, ratio of specialty to primary care physician visits per decedent, and hospital care intensity index. Results Of 5,992 students invited, 3,395 (57%) responded. Ninety percent (2,640/2,932) agreed physicians have a responsibility to contain costs. However, 48% (1,1416/2,960) thought ordering a test is easier than explaining why it is unnecessary, and 58% (1,685/2,928) agreed ordering fewer tests will increase the risk of malpractice litigation. In adjusted linear regression analyses, students in higher-health-care-intensity regions reported observing significantly fewer cost-conscious role-modeling behaviors: For each one-unit increase in the three health care intensity measures, scores on the 21-point cost-conscious role-modeling scale decreased by 4.4 (SE 0.7), 3.2 (0.6), and 3.9 (0.6) points, respectively (all P < .001). Conclusions Medical students endorse barriers to cost-conscious care and encounter conflicting role-modeling behaviors, which are related to regional health care intensity. Enhancing role modeling in the learning environment may help prepare future physicians to address health care costs.

Purpose The authors performed a review of 30 Accelerating Change in Medical Education full grant submissions and an analysis of the health systems science (HSS)-related curricula at the 11 grant recipient schools to develop a potential comprehensive HSS curricular framework with domains and subcategories. Method In phase 1, to identify domains, grant submissions were analyzed and coded using constant comparative analysis. In phase 2, a detailed review of all existing and planned syllabi and curriculum documents at the grantee schools was performed, and content in the core curricular domains was coded into subcategories. The lead investigators reviewed and discussed drafts of the categorization scheme, collapsed and combined domains and subcategories, and resolved disagreements via group discussion. Results Analysis yielded three types of domains: core, cross-cutting, and linking. Core domains included health care structures and processes; health care policy, economics, and management; clinical informatics and health information technology; population and public health; value-based care; and health system improvement. Cross-cutting domains included leadership and change agency; teamwork and interprofessional education; evidence-based medicine and practice; professionalism and ethics; and scholarship. One linking domain was identified: systems thinking. Conclusions This broad framework aims to build on the traditional definition of systems-based practice and highlight the need for medical and other health professions schools to better align education programs with the anticipated needs of the systems in which students will practice. HSS will require a critical investigation into existing curricula to determine the most efficient methods for integration with the basic and clinical sciences.