Validity evidence for Quality Improvement Knowledge Application Tool Revised (QIKAT-R) scores: consequences of rater number and type using neurology cases
Objectives To develop neurology scenarios for use with the Quality Improvement Knowledge Application Tool Revised (QIKAT-R), gather and evaluate validity evidence, and project the impact of scenario number, rater number and rater type on score reliability. Methods Six neurological case scenarios were developed. Residents were randomly assigned three scenarios before and after a quality improvement (QI) course in 2015 and 2016. For each scenario, residents crafted an aim statement, selected a measure and proposed a change to address a quality gap. Responses were scored by six faculty raters (two with and four without QI expertise) using the QIKAT-R. Validity evidence from content, response process, internal structure, relations to other variables and consequences was collected. A generalisability (G) study examined sources of score variability, and decision analyses estimated projected reliability for different numbers of raters and scenarios and raters with and without QI expertise. Results Raters scored 163 responses from 28 residents. The mean QIKAT-R score was 5.69 (SD 1.06). G-coefficient and Phi-coefficient were 0.65 and 0.60, respectively. Interrater reliability was fair for raters without QI expertise (intraclass correlation = 0.53, 95% CI 0.30 to 0.72) and acceptable for raters with QI expertise (intraclass correlation = 0.66, 95% CI 0.02 to 0.88). Postcourse scores were significantly higher than precourse scores (6.05, SD 1.48 vs 5.22, SD 1.5; p < 0.001). Sufficient reliability for formative assessment (G-coefficient > 0.60) could be achieved by three raters scoring six scenarios or two raters scoring eight scenarios, regardless of rater QI expertise. Conclusions Validity evidence was sufficient to support the use of the QIKAT-R with multiple scenarios and raters to assess resident QI knowledge application for formative or low-stakes summative purposes. The results provide practical information for educators to guide implementation decisions.
Five-Year Mortality After Transient Ischemic Attack
Background and Purpose— We aimed at providing estimates of mortality associated with cardiometabolic comorbidity and incident readmission from cardiometabolic as compared with noncardiometabolic conditions after a first transient ischemic attack. Methods— Between 2000 and 2015, patients hospitalized for a first transient ischemic attack were examined for cardiometabolic comorbidities (diabetes mellitus, coronary artery disease, heart failure, and atrial fibrillation), 5-year incident hospitalization, and time to death. Results— Of 251 patients with transient ischemic attack, 134 (53%) had at least 1 and 55 (22%) had at least 2 cardiometabolic conditions. By 5 years, 491 readmissions (134 [27%] cardiometabolic and 357 [73%] noncardiometabolic) and 75 deaths (27 [36%] cardiometabolic and 47 [64%] noncardiometabolic) were observed. Mortality was increased with any concurrent cardiometabolic comorbidity (hazard ratio, 1.89; 95% confidence interval, 1.17–3.03; P =0.0089) with multiplicative mortality risk from a combination of coronary artery disease and heart failure. Each hospitalization was associated with a 1.5-fold risk of death (95% confidence interval, 1.37–1.64; P <0.0001). Risk of cardiometabolic and noncardiometabolic mortality was correlated with the corresponding category-specific readmission. Conclusions— Among patients hospitalized for first transient ischemic attack, 5-year mortality is associated with concurrent cardiometabolic comorbidity and rates of subsequent hospitalization.
Effect of early hospital readmission and comorbid conditions on subsequent long‐term mortality after transient ischemic attack
AbstractBackgroundThe implications of early readmission on long‐term mortality after transient ischemic attack (TIA) are not known. We aimed at examining the effect of 180‐day readmission on subsequent long‐term mortality after index hospitalization for TIA.MethodsA retrospective study of patients hospitalized for first‐ever TIA at Mayo Clinic from 2000 through 2017. Patients readmitted within 180 days postdischarge were compared with those not readmitted in long‐term risk of death.ResultsOf 251 TIA patients aged 73 ± 15 years with 1509 person‐years of follow‐up, 65 (26%) were readmitted within 180 days of discharge and 125 died during a median follow‐up of 5.7 years. The mortality was 10 vs. 7 deaths per 100 person‐years in patients who were readmitted compared to those who were not readmitted with hazard ratio (HR) 1.73 (95% confidence interval [CI] 1.13–2.66). Other competing predictors of mortality were age ≥65 years (HR 5.70, 95% CI 2.72–11.96), cancer (HR 1.65, 95% CI 1.03–3.38), chronic obstructive pulmonary disease (HR 1.90, 95% CI 1.07–3.38), heart failure (HR 3.03, 95% CI 1.82–5.06), dementia (HR 5.87, 95% CI 3.27–10.52), creatinine ≥1.4 mg/dl (HR 1.89, 95% CI 1.17–3.06), and hemoglobin level <10 g/dl (HR 2.80, 95% CI 1.20–6.66).ConclusionsHospital readmission within 180 days of discharge from index TIA was associated with increased risk of death several years after initial readmission. Older age and several comorbidities identified during index hospitalization also confer increased risk for long‐term mortality.