Havyer, Rachel D.

Purpose To identify approaches to operationalizing the development of competence in Accreditation Council for Graduate Medical Education (ACGME) milestones. Method The authors reviewed all 25 “Milestone Project” documents available on the ACGME Web site on September 11, 2013, using an iterative process to identify approaches to operationalizing the development of competence in the milestones associated with each of 601 subcompetencies. Results Fifteen approaches were identified. Ten focused on attributes and activities of the learner, such as their ability to perform different, increasingly difficult tasks (304/601; 51%), perform a task better and faster (171/601; 45%), or perform a task more consistently (123/601; 20%). Two approaches focused on context, inferring competence from performing a task in increasingly difficult situations (236/601; 29%) or an expanding scope of engagement (169/601; 28%). Two used socially defined indicators of competence such as progression from “learning” to “teaching,” “leading,” or “role modeling” (271/601; 45%). One approach focused on the supervisor’s role, inferring competence from a decreasing need for supervision or assistance (151/601; 25%). Multiple approaches were often combined within a single set of milestones (mean 3.9, SD 1.6). Conclusions Initial ACGME milestones operationalize the development of competence in many ways. These findings offer insights into how physicians understand and assess the developmental progression of competence and an opportunity to consider how different approaches may affect the validity of milestone-based assessments. The results of this analysis can inform the work of educators developing or revising milestones, interpreting milestone data, or creating assessment tools to inform milestone-based performance measures.

187 Background: Patient-reported evaluations of interpersonal quality of care are essential elements of quality of cancer care assessment. At times, patients may be unable to report themselves on their care experience and systems may rely on proxy reports. The validity of this approach is dependent on the degree to which family caregiver assessments are concordant with patient assessments. Methods: A VA cohort of colorectal cancer (CRC) patients and their caregivers both completed a self-administered questionnaire on the quality of VA cancer care in 3 specific domains: surgery, chemotherapy overall and chemotherapy nursing care, all measured on a 5-point Likert scale. Because the kappa statistic penalizes skewed distributions which are commonly seen in patient satisfaction reports, agreement between patients and caregivers on perceptions of quality care were measured using Gwet’s AC2 statistic. Stratified analyses on caregiver burden, race, education, and age as well as patient’s stage of disease were used to assess variation in agreement. Results: 417 caregiver-patient dyads completed the survey (70% response rate), of whom 362 (86.8%) had surgery and 195 (46.8%) had chemotherapy. Overall agreement was high for the 3 quality of care domains: AC2 (95% CI): 0.870 (0.838, 0.903) for surgery, 0.835 (0.786, 0.884) for chemotherapy overall and 0.906 (0.868, 0.944) for chemotherapy nurses. Stratified analyses of agreement showed particular populations of higher or lower agreement; however the findings were inconsistent across the three domains and most were not statistically significant. Patients with lower stage (I-II) had higher agreement than higher stages (III-IV) (AC2: 0.967 and 0.879 respectively, P = 0.006) but only in the chemotherapy nurses domain. For the surgery domain, age was the only significant difference in agreement (0.816, 0.912, and 0.838 for < 50, 51-65, and > 65 respectively, P = 0.03). Conclusions: Family caregiver reports on the quality of CRC care were highly concordant with patient reports. Therefore, family caregivers may be able to provide reasonable proxy report on measures of quality of cancer care when patient reports are unavailable.

226 Background: Patients undergoing cancer treatment often need support from an informal caregiver to help manage symptoms. Self-efficacy (SE) in caregiving refers to confidence in being able to care for the patient’s needs. Low SE has been associated with increased caregiver burden and mental health symptoms, which in turn, can affect the quality of informal care provided. The objective of this study was to examine the relationship between caregiver training received from cancer care providers and SE in caregivers of patients with colorectal cancer (CRC). Methods: Caregivers of CRC patients diagnosed in 2009 were invited to complete a self-administered questionnaire. Caregivers were asked about specific patient problems (pain, bowel, fatigue, medications, and other). Caregiver perceptions of training adequacy and SE were assessed on a problem specific basis. The patient’s stage of disease was obtained from cancer registry data. Associations between training and SE were examined for each problem using multivariate logistic regression and adjusted for age, relationship to patient, race, care burden, level of education, stage of disease, perception of patient’s health, and general confidence as a caregiver. Results: 417 caregivers completed the survey (70% response rate), of whom 374 (90%) were female and 284 (68%) were the patient’s spouse/partner. The number of caregivers reporting inadequate training for CRC-related problems were pain 77 (38%), bowel 80 (38%), fatigue 121 (48%), medication 65 (26%), and other 101 (40%). The odds of having low SE were significantly higher among those with perceptions of inadequate training across the following CRC-related problems: pain, 10.10 (3.36, 30.39); bowel, 5.04 (1.98, 12.82); fatigue, 8.45 (3.22, 22.15); managing medications, 9.00 (3.30, 24.51); and other, 3.87 (1.68, 8.93). Conclusions: This study showed a significant association between caregiver training and SE in a cross-sectional study. Given that the perception of inadequate training among caregivers was common, further exploration of the longitudinal impact of training on caregiver SE should be done to identify interventions to help improve the experience of cancer caregivers.

Purpose To summarize characteristics and validity evidence of tools that assess teamwork in undergraduate medical education (UME), and provide recommendations for addressing the interprofessional collaboration competencies of the Association of American Medical Colleges (AAMC). Method The authors conducted a systematic review, searching MEDLINE, MEDLINE In-process, CINAHL, and PsycINFO from January 1, 1979, through April 1, 2014; they searched reference lists and national meeting abstracts. They included original research reports that described a quantitative tool used to assess teamwork in UME. They abstracted characteristics and validity evidence for the tools, plus study quality, according to established frameworks. Two authors independently abstracted 25% of articles and calculated agreement. Authors then applied predefined criteria to identify tools best suited to address the AAMC’s teamwork competencies. Results Of 13,549 citations, 70 articles describing 64 teamwork assessment tools were included. Of these 64 tools, 27 (42%) assessed teamwork in classroom, 31 (48%) in simulation, and only 7 (11%) in actual clinical settings. The majority (47; 73%) of tools assessed medical students’ teamwork in interprofessional teams. On the basis of content concordance, strength of validity evidence, generalizability of scores, and level of outcomes, four published tools were recommended to assess the AAMC’s teamwork competencies: the Collaborative Healthcare Interdisciplinary Relationship Planning Scale, Readiness for Interprofessional Learning Scale, Communication and Teamwork Skills assessment, and Teamwork Mini-Clinical Evaluation Exercise. Conclusions Substantial validity evidence supports the use of several UME teamwork assessments. Four tools have been appropriately designed and sufficiently studied to constitute appropriate assessments of the AAMC’s teamwork competencies.

In the modern age of advanced surgical techniques and pharmacologic management, bacterial spinal infections (SIs) can be managed (either eradicated or suppressed) in many hosts. However, the optimal management of SIs may be limited by patient comorbidities, which do not allow for surgical management, or limited by antimicrobial options due to side effects, toxicities, or emerging drug resistance. In these settings, frank and honest discussion regarding risks and benefits of treatment should be pursued, including that the SI may be a terminal illness. In this case series, we present 3 patients who had bacterial SIs whose treatments were limited by the above-mentioned factors. Furthermore, each case presented challenges regarding optimal medical management of somatic and neuropathic pain associated with the SI.

Introduction: To determine the relationship between fibrin D-dimer levels, symptom duration, and thrombus volume, consecutive patients with incident deep venous thrombosis (DVT) were evaluated. Methods: In a cross-sectional study design, patient symptom onset was determined by careful patient questioning. Venous thrombosis was confirmed by compression duplex ultrasonography. Thrombus volume was estimated based on patient’s femur length using a forensic anthropology method. Fibrin D-dimer was measured by latex immunoassay. Results: 72 consecutive patients with confirmed leg DVT agreed to participate. The median symptom duration at the time of diagnosis was 10 days. The median D-dimer concentration was 1050 ng/dL. The median thrombus volume was 12.92 cm 3 . D-Dimer levels correlated with estimated thrombus volume (P < .0006 CI 0.12-0.41; R 2 adjusted = .15) but not symptom duration, patient’s age, or gender. Conclusions: Despite varying symptom duration prior to diagnosis, fibrin D-dimer remains a sensitive measure of venous thrombosis and correlates with thrombus volume.