Gordon, Joel

Abstract Background The Grading Recommendations, Assessment, Development, and Evaluations (GRADE) framework is widely applied in clinical guidelines to facilitate transparent evidence evaluation. While developing Infectious Diseases Society of America (IDSA) guidelines on the management of patients with coronavirus disease 2019 (COVID-19), panel members suggested developing and implementing a visual aid to enable quicker identification of key information by providers at bedside seeking guidance. Methods We conducted a mixed-methods study evaluating the usability of a newly designed infographic/icon using a survey and focus groups. The survey incorporated a simulated COVID-19 IDSA guideline with and without the icon, followed by comprehension questions. Focus group discussions provided qualitative feedback on the GRADE methodology and icon usability. Results The survey was returned by 289 health care providers. There was no statistical difference in the correct response rates between icon-aided and non-icon-aided guideline questions (McNemar's chi-square test, P > .1 for both questions). Interactions with the icon notably increased the time taken and number of clicks required to respond to the first question (Wilcoxon signed-rank test, P < .01). In contrast, response time did not differ between versions for the second question (P = .38). Most subjects (85%) indicated that the icon improved the readability of the guidelines. A focus group follow-up suggested alternative designs for the icon. Conclusions This study highlights the promise of iconography in clinical guidelines, although the specific icons tested did not measurably improve usability metrics. Future research should focus on icon design and testing within a formal usability framework, considering the impact of GRADE language on user experience.

Abstract Objective After a new electronic health record (EHR) was implemented at Mayo Clinic, a training program called reBoot Camp was created to enhance ongoing education in response to needs identified by physician leaders. Materials and Methods A reBoot camp focused on EHR topics pertinent to ambulatory care was offered from April 2018 through June 2020. There were 37 2-day sessions and 43 1-day sessions, with 673 unique participants. To evaluate outcomes of the reBoot camp, we used survey data to study baseline, immediate, and long-term perceptions of program satisfaction and self-assessed skills with the EHR. The study was conducted among practitioners at a large ambulatory practice network based in several states. Data were collected from April 2018 through January 2021. We analyzed automatically collected metadata and scores that evaluated the amount of personalization and proficiency of use. Results Confidence in skills increased by 13.5 points for general EHR use and was significant in 5 subdomains of use (13–18 point improvement). This degree of user confidence was maintained at the 6-month reassessment. The outcomes of configuration and proficiency scores also improved significantly. Discussion Ongoing education regarding EHR tools is necessary to support continued use of technology. This study was novel because of the amount and breadth of data collected, diversity of user participation, and validation that improvements were maintained over time. Conclusions Participating in a reBoot camp significantly improved user confidence in each domain of the EHR and demonstrated use of best-practice tools. Users maintained gains at the 6-month evaluation phase.

Abstract COVID-19 vaccines are effective, but breakthrough infections have been increasingly reported. We conducted a test-negative case-control study to assess the durability of protection after full vaccination with BNT162b2 against polymerase chain reaction (PCR)-confirmed symptomatic SARS-CoV-2 infection, in a national medical practice from January 2021 through January 2022. We fit conditional logistic regression (CLR) models stratified on residential county and calendar time of testing to assess the association between time elapsed since vaccination and the odds of symptomatic infection or non-COVID-19 hospitalization (negative control), adjusted for several covariates. There were 5,985 symptomatic individuals with a positive test after full vaccination with BNT162b2 (cases) and 32,728 negative tests contributed by 27,753 symptomatic individuals after full vaccination (controls). The adjusted odds of symptomatic infection were higher 250 days after full vaccination versus at the date of full vaccination (Odds Ratio [OR]: 3.62, 95% CI: 2.52 to 5.20). The odds of infection were still lower 285 days after the first BNT162b2 dose as compared to 4 days after the first dose (OR: 0.50, 95% CI: 0.37 to 0.67), when immune protection approximates the unvaccinated status. Low rates of COVID-19 associated hospitalization or death in this cohort precluded analyses of these severe outcomes. The odds of non-COVID-19 associated hospitalization (negative control) decreased with time since vaccination, suggesting a possible underestimation of waning protection by this approach due to confounding factors. In summary, BNT162b2 strongly protected against symptomatic SARS-CoV-2 infection for at least 8 months after full vaccination, but the degree of protection waned significantly over this period.

Abstract COVID-19 vaccines are effective, but breakthrough infections have been increasingly reported. We conducted a test-negative case-control study to assess the durability of protection against symptomatic infection after vaccination with mRNA-1273. We fit conditional logistic regression (CLR) models stratified on residential county and calendar date of SARS-CoV-2 PCR testing to assess the association between the time elapsed since vaccination and the odds of symptomatic infection, adjusted for several covariates. There were 2,364 symptomatic individuals who had a positive SARS-CoV-2 PCR test after full vaccination with mRNA-1273 (“cases”) and 12,949 symptomatic individuals who contributed 15,087 negative tests after full vaccination (“controls”). The odds of symptomatic infection were significantly higher 250 days after full vaccination compared to the date of full vaccination (Odds Ratio [OR]: 2.47, 95% confidence interval [CI]: 1.19–5.13). The odds of non-COVID-19 associated hospitalization and non-COVID-19 pneumonia (negative control outcomes) remained relatively stable over the same time interval (Day 250 ORNon-COVID Hospitalization: 0.68, 95% CI: 0.47–1.0; Day 250 ORNon-COVID Pneumonia: 1.11, 95% CI: 0.24–5.2). The odds of symptomatic infection remained significantly lower almost 300 days after the first mRNA-1273 dose as compared to 4 days after the first dose, when immune protection approximates the unvaccinated state (OR: 0.26, 95% CI: 0.17–0.39). Low rates of COVID-19 associated hospitalization or death in this cohort precluded analyses of these severe outcomes. In summary, mRNA-1273 robustly protected against symptomatic SARS-CoV-2 infection at least 8 months after full vaccination, but the degree of protection waned over this time period.

Abstract As of 2021 November 29, booster vaccination against SARS-CoV-2 infection has been recommended for all individuals aged 18 years and older in the United States. A key reason for this recommendation is the expectation that a booster vaccine dose can alleviate observed waning of vaccine effectiveness (VE). Although initial reports of booster effectiveness have been positive, the level of protection from booster vaccination is unclear. We conducted two studies to assess the impact of booster vaccination, with BNT162b2 or mRNA-1273, on the incidence of SARS-CoV-2 infection between August and December 2021. We first compared SARS-CoV-2 infection incidence in cohorts of 3-dose vaccine recipients to incidence in matched cohorts of 2-dose vaccine recipients (cohort size = 24,539 for BNT162b2 and 14,004 for mRNA-1273). Additionally, we applied a test-negative study design to compare the level of protection against symptomatic infection in 3-dose recipients to that observed in recent 2-dose primary vaccine series recipients. The 3-dose recipients experienced a significantly lower incidence rate of SARS-CoV-2 infection than the matched 2-dose cohorts (BNT162b2 Incidence Rate Ratio: 0.11, 95% CI: 0.09 to 0.13 and mRNA-1273 IRR: 0.11, 95% CI: 0.08 to 0.15). Results from the test-negative study showed the third vaccine dose mitigated waning of VE, with the risk of symptomatic infection in 3-dose recipients being comparable to that observed 7 to 73 days after the primary vaccine series. These results show that 3-dose vaccine regimens with BNT162b2 or mRNA-1273 are effective at reducing SARS-CoV-2 infection and support the widespread administration of booster vaccine doses.