This study compared anesthesiology residency graduates’ written certification examination performance before and after the American Board of Anesthesiology (ABA) introduced the staged examination system. After equating test scores using common test items, the first 2 cohorts (2013, 2014) in the staged system scored 7.1 points and 8.3 points higher than the 2011 baseline cohort in the former examination system. The 2013 and 2014 cohorts’ pass rates (94.2% and 95.9%) were also higher than the 2011 and 2012 cohorts (91.9% and 92.6%) if a common standard had been applied. The staged examination system may be associated with improved knowledge of anesthesiology graduates.
Effect of the BASIC Examination on Knowledge Acquisition during Anesthesiology Residency
Abstract Background The American Board of Anesthesiology recently introduced the BASIC Examination, a component of its new staged examinations for primary certification, typically offered to residents at the end of their first year of clinical anesthesiology training. This analysis tested the hypothesis that the introduction of the BASIC Examination was associated with an acceleration of knowledge acquisition during the residency training period, as measured by increments in annual In-Training Examination scores. Methods In-Training Examination performance was compared longitudinally among four resident cohorts (n = 6,488) before and after the introduction of the staged system using mixed-effects models that accounted for possible covariates. Results Compared with previous cohorts in the traditional examination system, the first resident cohort in the staged system had a greater improvement in In-Training Examination scores between the first and second years of clinical anesthesiology training (by an estimated 2.0 points in scaled score on a scale of 1 to 50 [95% CI, 1.7 to 2.3]). By their second year, they had achieved a score similar to that of third-year clinical anesthesiology residents in previous cohorts. The second cohort to enter the staged system had a greater improvement of the scores between the clinical base year and the first clinical anesthesiology year, compared with the previous cohorts. Conclusions These results support the hypothesis that the introduction of the BASIC Examination is associated with accelerated knowledge acquisition in residency training and provides evidence for the value of the new staged system in promoting desired educational outcomes of anesthesiology training.
Effectiveness of Written and Oral Specialty Certification Examinations to Predict Actions against the Medical Licenses of Anesthesiologists
Abstract Background The American Board of Anesthesiology administers written and oral examinations for its primary certification. This retrospective cohort study tested the hypothesis that the risk of a disciplinary action against a physician’s medical license is lower in those who pass both examinations than those who pass only the written examination. Methods Physicians who entered anesthesiology training from 1971 to 2011 were followed up to 2014. License actions were ascertained via the Disciplinary Action Notification Service of the Federation of State Medical Boards. Results The incidence rate of license actions was relatively stable over the study period, with approximately 2 to 3 new cases per 1,000 person-years. In multivariable models, the risk of license actions was higher in men (hazard ratio = 1.88 [95% CI, 1.66 to 2.13]) and lower in international medical graduates (hazard ratio = 0.73 [95% CI, 0.66 to 0.81]). Compared with those passing both examinations on the first attempt, those passing neither examination (hazard ratio = 3.60 [95% CI, 3.14 to 4.13]) and those passing only the written examination (hazard ratio = 3.51 [95% CI, 2.87 to 4.29]) had an increased risk of receiving an action from a state medical board. The risk was no different between the latter two groups ( P = 0.81), showing that passing the oral but not the written primary certification examination is associated with a decreased risk of subsequent license actions. For those with residency performance information available, having at least one unsatisfactory training record independently increased the risk of license actions. Conclusions These findings support the concept that an oral examination assesses domains important to physician performance that are not fully captured in a written examination.
Association between Participation in an Intensive Longitudinal Assessment Program and Performance on a Cognitive Examination in the Maintenance of Certification in Anesthesiology Program®
Abstract Background As part of the Maintenance of Certification in Anesthesiology Program® (MOCA®), the American Board of Anesthesiology (Raleigh, North Carolina) developed the MOCA Minute program, a web-based intensive longitudinal assessment involving weekly questions with immediate feedback and links to learning resources. This observational study tested the hypothesis that individuals who participate in the MOCA Minute program perform better on the MOCA Cognitive Examination (CE) compared with those who do not participate. Methods Two separate cohorts of individuals eligible for July 2014 and January 2015 CEs were invited to participate in this pilot. The CE scores for each cohort were compared between those who did and did not participate, controlling for the factors known to affect performance. For the first cohort, examination performances for topics covered and not covered by the MOCA Minute were analyzed separately. Results Six hundred sixteen diplomates in July 2014 and 684 diplomates in January 2015 took the CE for the first time. In multiple regression analysis, those actively participating scored 9.9 points (95% CI, 0.8 to 18.9) and 9.3 points (95% CI, 2.3 to 16.3) higher when compared with those not enrolled, respectively. Compared to the group that did not enroll in MOCA Minute, those who enrolled but did not actively participate demonstrated no improvement in scores. MOCA Minute participation was associated with improvement in both questions covering topics included the MOCA Minute and questions not covering these topics. Conclusions This analysis provides evidence that voluntary active participation in a program featuring frequent knowledge assessments accompanied by targeted learning resources is associated with improved performance on a high-stakes CE.
Progression of Subclinical Coronary Atherosclerosis
Background— Obesity is associated with coronary artery calcification (CAC), a marker of the presence and extent of subclinical coronary atherosclerosis. Obesity adds incremental information in identifying those at higher risk of coronary heart disease to traditional risk factor assessment. The present study examined associations between obesity measures and progression of CAC in those at higher (≥10%) and lower (<10%) 10-year coronary heart disease risk according to the Framingham risk equation. Methods and Results— In this study, 443 asymptomatic white individuals >30 years of age (243 men) had baseline and follow-up CAC measurements an average of 8.9 years apart. Multivariable linear regression models were fit to determine associations of obesity measures at baseline with progression of CAC defined as log e of the difference between follow-up and baseline CAC area plus 1 divided by time (in years) between examinations, adjusting for baseline CAC quantity, age, sex, baseline hypertension status, and baseline cholesterol level. Among 329 participants (74.3%) in the lower-risk group, waist circumference ( P =0.024), waist-to-hip ratio ( P <0.001), body mass index ( P =0.036), and being overweight compared with being underweight or of normal weight ( P =0.008) were each significantly positively associated with progression of CAC. Among those at higher coronary heart disease risk, no baseline obesity measures were associated with CAC progression. Conclusions— Various measures of obesity were associated with increased progression of CAC in those at lower risk of coronary heart disease. Future studies examining the effectiveness of weight reduction strategies in reducing CAC progression among those with an otherwise favorable risk factor profile may be warranted.