Key findings from multisite implementation of electronic health record tools for clinical pretest probability of pulmonary embolism in the emergency department
Background: The use of validated risk stratification tools for the workup of suspected pulmonary embolism (PE) is a recommendation of the American Society of Hematology and the American College of Emergency Physicians. Methods: We designed and implemented electronic clinical pretest probability (PTP) tools for use in emergency departments (ED). Overall, 38 EDs (tertiary and regional EDs) in the United States were involved across three health systems. PTP use was analyzed between September 12, 2022 and January 11, 2023 in 270,247 ED visits. PTP use was examined in terms of the percentage of visits for which patients underwent computed tomography pulmonary angiography (CTPA). Each site chose the 3-tier Wells’ score for implementation and Site 2 designed a combined Wells’, pulmonary embolism rule-out criteria (PERC), and YEARS score. Results: At Site 3, forced use resulted in documented PTP scores in 49–53% of ordered CTPAs. At Sites 1 and 2, where PTP scores were optional, documented PTP scores occurred in 2–3% and 1–3% of CTPA orders, respectively. At Site 1, the use of PTP increased slightly over the study period, with signs that PE yield on imaging was also increasing (3.4–5.9%). At Site 2, PE yield on imaging was 9–10%, and it remained similar, with similar use of PTP tools over the study period. PE yield (6–8%) on imaging also remained similar throughout the study at Site 3. Conclusions: Guideline-endorsed PTP scores for PE at three independent health systems in the United States did not increase PE yield on imaging. Novel implementation strategies involving interdisciplinary teams are urgently needed.
Lack of Standardized Coding Limits Accuracy of Electronic Clinical Quality Measure for Pulmonary Embolism Diagnosis
Guidelines for diagnosing pulmonary embolism (PE) start with a risk assessment using a pretest probability (PTP) tool, followed by D-dimer testing or computed tomography pulmonary angiography (CTPA) depending on risk. The project aimed to develop an electronic clinical quality measure (eCQM) to encourage broader use of a validated PTP scoring tool in emergency departments (EDs) to more accurately diagnose PE and to reduce unnecessary CTPAs. To identify a value set to accurately identify CTPA and abnormal D-dimer tests using standard classification systems and clinical vocabularies (ie, Current Procedural Terminology [CPT], Logical Observation Identifiers Names and Codes [LOINC], systematized nomenclature of medicine clinical terms [SNOMED CT]) across 3 academic United States health care systems. A comprehensive value set to identify CTPAs was selected, which contained 31 codes. Additionally, each health care system had unique, site-specific codes to more granularly identify CTPAs. Three health care systems representing 38 EDs from across the country submitted data from all ED encounters between September 12, 2022, and January 11, 2023. Imaging types were reviewed from each of the CPT codes and LOINC. The project evaluated whether a D-dimer was obtained using CPT and LOINC and whether the D-dimer result was elevated using SNOMED CT. The number of ED encounters, PTP use, and diagnosis of PE using different codes were determined. Sensitivity, specificity, positive predictive value (PPV), and negative predictive value for selected codes were calculated. Over a 4-month study period, 270,214 encounters were included from 38 EDs. 11,794 ED encounters with CTPAs during the study period, using the site-specific codes were identified. The comprehensive value set had a PPV of 63.4%. Restricting the CTPA value set to CPT code 71275 or LOINC 88322-3 improved the PPV to 82% with 100% sensitivity and 99% specificity. The restricted value set captured the highest proportion of relevant site-specific codes. D-dimer values were identified using LOINC codes 48065-7 and 91556-1 at Site 1 and 48067-3 at Site 2. SNOMED CT codes were not used at any site to identify elevated D-dimer results. Different D-dimer tests with different normal ranges were used at each site, and only one site provided an abnormal flag for D-dimer results. Heterogeneity in the use of nationally standardized codes for labs and imaging tests limits the ability to measure and compare quality across health care organizations for CTPA and D-dimer results. Restricting the identification of CTPA to CPT Code 71275 or LOINC 88322-3 resulted in high sensitivity and specificity, but false positives remain. Additionally, coding for an abnormal D-dimer test result is not standardized across institutions. Therefore, the currently available value sets cannot be used to develop eCQMs whose aim is to evaluate whether CTPA is ordered appropriately based on the PTP risk level and laboratory testing.
Results from Multisite Implementation of Electronic Health Record Tools for Clinical Pre-Test Probability of Pulmonary Embolism in the Emergency Department
Introduction: Use of validated risk stratification tools for work up of suspected pulmonary embolism (PE) is an endorsed recommendation of the American Society of Hematology and the American College of Emergency Physicians. Due to variations in clinical practice, electronic health record (EHR) systems, and medical provider trainings, the use, documentation, and implementation of these tools vary widely. Current processes do not allow for electronic capture and quality reporting at most institutions. Methods: We sought to design and implement clinical pre-test probability (PTP) tools at three large healthcare institutions for use in emergency departments (ED). At each site, a hematologist partnered with ED physician leadership and local information technology experts to design and implement PTP tools in clinical workflows. Overall, 38 EDs (high volume tertiary EDs and smaller regional EDs) located in the United States along the East Coast and Midwest regions were involved. A major goal of implementation was integration into clinical workflow and automatic documentation. After design and implementation, awareness and education of the new EHR tool was distributed electronically to ED providers. After implementation, use of PTP tools was analyzed between September 12, 2022 and January 11, 2023. PTP use was examined as percent of visits for which patients underwent CT pulmonary angiography (CTPA). Results: Each institution chose the 3 tier Wells' Score for implementation while one site designed an integrated Wells'/PERC or YEARS score calculator. Two sites implemented the tool as an optional flowsheet and one site implemented the tool as mandatory parameters within the orders for PE imaging studies. The mandatory tool could be bypassed with prespecified selections or if a D-dimer existed within 48 hours . Complete details of the site-specific implementation are shown in Table 1. Over the 4-month evaluation timeframe, there was a total of 270,214 ED encounters. Uptake and utilization of the PTP tools are shown in Table 2. Use of PTP was highest at the site with forced PTP documentation which ranged from 49-53% of ordered CTPAs, compared to Site 2 where use was 2-3%, and Site 1 where use ranged from 1-3%. At Site 1, use of PTP increased slightly over the study period with signs that PE yield on imaging was increasing as well (3.4% to 5.9%). At Site 2, PE yield on imaging was overall high (9-10%), and remained similar with similar use of PTP tools over the study period. Use of PTP and PE yield (6-8%) on imaging also remained similar throughout the study at Site 3. Conclusion: Forced use of PTP within the orders for CTPA led to the highest use of PTP (Site 3) but this did not result in meaningfully higher PE yield on CTPA compared to the other sites. PE yield at each site was at or above the 5% yield for PE on CTPA which has been previously reported. Given that PTP uptake was relatively stable over the measurement period at Site 2 and 3, this indicates the process had mostly stabilized and that other strategies are needed to improve uptake of PTP, reduce utilization of CTPA, and further increase yield on CTPA. Increasing PTP use and rising PE yield at Site 1 demonstrated ongoing potential for improvements past this study timeframe.
Lack of Standardized Coding Limits Accuracy of Electronic Clinical Quality Measure for Pulmonary Embolism Diagnosis
Introduction: ASH Guidelines for diagnosis of pulmonary embolism (PE) start with risk assessment using a pretest probability tool (PTP) followed by D-dimer testing or CT pulmonary angiography (CTPA) depending on risk. We aimed to develop an electronic clinical quality measure (eCQM) to encourage broader use of a validated PTP scoring tool in emergency departments (EDs). The Centers for Medicare & Medicaid Services require reporting of eCQMs which consist of value sets or lists of standardized codes linked to patient data within the electronic health record. We sought to identify a standardized way to identify CTPA and abnormal D-dimer tests using administrative codes (i.e. CPT, LOINC, SNOMEDCT codes) across three institutions. Methods: Value sets identifying CTPA and D-dimers were reviewed from existing eCQMs. Three institutions representing 38 EDs from across the country submitted data from all ED encounters between September 12, 2022 and January 11, 2023. Imaging types were reviewed from each of the CPT codes and LOINC (Logical Observation Identifiers Names and Codes). We determined the number of ED encounters, pre-test probability tool use, and diagnosis of PE using different codes. We calculated sensitivity, specificity, positive and negative predictive value (PPV and NPV, respectively). Results: Over the 4-month study period, 270,214 encounters were identified across 38 EDs. Each institution identified CTPA with site-specific codes (Table 1). The Full CTPA Value Set identified 55% more encounters than the site-specific codes (Full set 15,054/9679 site-specific codes). LOINC code 88322-3 was only used at one site. CPT code 71275 had the best sensitivity and specificity, but still had false positives (PPV 82%) (Table 2). D-dimer values were identified as LOINC code 48065-7 and 91556-1 at Site 1 and 48067-3 at Site 2. SNOMEDCT codes were not used at any site despite being the way other eCQMs identify elevated D-dimer results. Different D-dimer tests with different normal ranges were used at each site. All sites did not have an electronically extractable positive indicator for D-dimer. Conclusion: Due to persistent false positives using CPT Code 71275 for identification of CTPA, using this code would lead to inclusion of patients for whom PTP was not required or recommended. Additionally, coding for an abnormal D-dimer test result are not standardized across institutions. Therefore, administrative codes cannot be used to develop eCQMs whose aim is to evaluate whether CTPA is ordered appropriately based on the PTP risk level and laboratory testing.
Survey of Pulmonary Embolism Risk Stratification Methods in the Emergency Department and Barriers to Electronic Health Record Documentation
Introduction Pulmonary Embolism (PE) is a major cause of morbidity and mortality worldwide. Diagnosis is essential as untreated PE has a 30% mortality rate. Currently, computer tomography pulmonary angiogram (CTPA) is the standard of care to diagnose PE. However, this modality is expensive, exposes patients to radiation and increases risk of contrast induced nephropathy. Furthermore, only 5% of CTPAs performed are positive for PE signifying that many unnecessary tests are being performed. To address this gap, Pre-Test Probability (PTP) tools have been developed to safely exclude patients with low risk of PE and limit iatrogenic harm from over testing. Despite the tools being developed over 20 years ago, they are not widely available in electronic health record (EHR) systems and even when they are built in, uptake remains low. Methods Three large integrated health systems using Epic EHR systems across five states (MA, WI. MN, AZ, FL) built electronic PTP assessments into their EHR systems to safely exclude patients with low risk of PE and limit over testing. Two sites made the PTP optional, and one site made it a forced function (providers were forced to complete PTP prior to ordering CTPA unless a D-dimer result was present in the prior 48 hours). To assess the usability of these EHR tools, the team conducted a survey with ED clinicians across the three test sites. The survey was created to identify which PE risk stratification methods were employed by ED clinicians (EHR embedded PTP tool, apps on their phone, web applications like MDcalc, calculations from memory, or if they relied on clinical gestalt), and to identify barriers to using the EHR embedded PTP. Results Site 1 had 47 respondents, Site 2 had 94 respondents, and Site 3 had 16 respondents. Two key findings emerged from the survey (Figure 1). First, clinicians used a variety of risk stratification approaches and few of them documented their risk assessments in structured fields in the medical record. Second, clinical gestalt was the most used PE risk stratification approach, and this was true across all three test sites. In addition, the health system with a PTP prompt before clinicians could proceed with CTPA orders (Site 3) did not have a higher percentage of clinicians who reported using the EHR embedded tool than sites that did not prompt clinicians to fill in the PTP. Clinicians cited a variety of different barriers to using the EHR embedded PTP tool (Table 1). Conclusion While many clinicians indicated intermittent use of PTP criteria to aid in the diagnosis of PE, risk factors and scores from phone apps, web tools, and calculations from memory are unlikely to be documented in the patient's medical record, which means that they are not accessible to all members of the ED care team and cannot be used for electronic clinical quality measure. The biggest hurdles to increasing the use of structured PTP assessments in the ED setting to safely exclude PE and limit iatrogenic harm from over testing are (1) obtaining buy-in from ED clinicians that the PTP tools provide value over clinical gestalt, at least for a subset of patients who could most benefit, and (2) identifying best practices for incorporating PTP tools into EHR systems that make the tools easier to access and use 3) developing and implementing effective education and awareness programs around the PTP tools. This survey adds to the body of literature on PTP assessments in the ED setting and can help inform further research that is needed to continue to improve the diagnosis of PE. Funding: This project is funded in part by the Gordon and Betty Moore Foundation through Grant GBMF10778 to the American Society of Hematology.
Systemic Anticancer Therapy and Thromboembolic Outcomes in Hospitalized Patients With Cancer and COVID-19
ImportanceSystematic data on the association between anticancer therapies and thromboembolic events (TEEs) in patients with COVID-19 are lacking.ObjectiveTo assess the association between anticancer therapy exposure within 3 months prior to COVID-19 and TEEs following COVID-19 diagnosis in patients with cancer.Design, Setting, and ParticipantsThis registry-based retrospective cohort study included patients who were hospitalized and had active cancer and laboratory-confirmed SARS-CoV-2 infection. Data were accrued from March 2020 to December 2021 and analyzed from December 2021 to October 2022.ExposureTreatments of interest (TOIs) (endocrine therapy, vascular endothelial growth factor inhibitors/tyrosine kinase inhibitors [VEGFis/TKIs], immunomodulators [IMiDs], immune checkpoint inhibitors [ICIs], chemotherapy) vs reference (no systemic therapy) in 3 months prior to COVID-19.Main Outcomes and MeasuresMain outcomes were (1) venous thromboembolism (VTE) and (2) arterial thromboembolism (ATE). Secondary outcome was severity of COVID-19 (rates of intensive care unit admission, mechanical ventilation, 30-day all-cause mortality following TEEs in TOI vs reference group) at 30-day follow-up.ResultsOf 4988 hospitalized patients with cancer (median [IQR] age, 69 [59-78] years; 2608 [52%] male), 1869 had received 1 or more TOIs. Incidence of VTE was higher in all TOI groups: endocrine therapy, 7%; VEGFis/TKIs, 10%; IMiDs, 8%; ICIs, 12%; and chemotherapy, 10%, compared with patients not receiving systemic therapies (6%). In multivariable log-binomial regression analyses, relative risk of VTE (adjusted risk ratio [aRR], 1.33; 95% CI, 1.04-1.69) but not ATE (aRR, 0.81; 95% CI, 0.56-1.16) was significantly higher in those exposed to all TOIs pooled together vs those with no exposure. Among individual drugs, ICIs were significantly associated with VTE (aRR, 1.45; 95% CI, 1.01-2.07). Also noted were significant associations between VTE and active and progressing cancer (aRR, 1.43; 95% CI, 1.01-2.03), history of VTE (aRR, 3.10; 95% CI, 2.38-4.04), and high-risk site of cancer (aRR, 1.42; 95% CI, 1.14-1.75). Black patients had a higher risk of TEEs (aRR, 1.24; 95% CI, 1.03-1.50) than White patients. Patients with TEEs had high intensive care unit admission (46%) and mechanical ventilation (31%) rates. Relative risk of death in patients with TEEs was higher in those exposed to TOIs vs not (aRR, 1.12; 95% CI, 0.91-1.38) and was significantly associated with poor performance status (aRR, 1.77; 95% CI, 1.30-2.40) and active/progressing cancer (aRR, 1.55; 95% CI, 1.13-2.13).Conclusions and RelevanceIn this cohort study, relative risk of developing VTE was high among patients receiving TOIs and varied by the type of therapy, underlying risk factors, and demographics, such as race and ethnicity. These findings highlight the need for close monitoring and perhaps personalized thromboprophylaxis to prevent morbidity and mortality associated with COVID-19–related thromboembolism in patients with cancer.
Interplay of Immunosuppression and Immunotherapy Among Patients With Cancer and COVID-19
ImportanceCytokine storm due to COVID-19 can cause high morbidity and mortality and may be more common in patients with cancer treated with immunotherapy (IO) due to immune system activation.ObjectiveTo determine the association of baseline immunosuppression and/or IO-based therapies with COVID-19 severity and cytokine storm in patients with cancer.Design, Setting, and ParticipantsThis registry-based retrospective cohort study included 12 046 patients reported to the COVID-19 and Cancer Consortium (CCC19) registry from March 2020 to May 2022. The CCC19 registry is a centralized international multi-institutional registry of patients with COVID-19 with a current or past diagnosis of cancer. Records analyzed included patients with active or previous cancer who had a laboratory-confirmed infection with SARS-CoV-2 by polymerase chain reaction and/or serologic findings.ExposuresImmunosuppression due to therapy; systemic anticancer therapy (IO or non-IO).Main Outcomes and MeasuresThe primary outcome was a 5-level ordinal scale of COVID-19 severity: no complications; hospitalized without requiring oxygen; hospitalized and required oxygen; intensive care unit admission and/or mechanical ventilation; death. The secondary outcome was the occurrence of cytokine storm.ResultsThe median age of the entire cohort was 65 years (interquartile range [IQR], 54-74) years and 6359 patients were female (52.8%) and 6598 (54.8%) were non-Hispanic White. A total of 599 (5.0%) patients received IO, whereas 4327 (35.9%) received non-IO systemic anticancer therapies, and 7120 (59.1%) did not receive any antineoplastic regimen within 3 months prior to COVID-19 diagnosis. Although no difference in COVID-19 severity and cytokine storm was found in the IO group compared with the untreated group in the total cohort (adjusted odds ratio [aOR], 0.80; 95% CI, 0.56-1.13, and aOR, 0.89; 95% CI, 0.41-1.93, respectively), patients with baseline immunosuppression treated with IO (vs untreated) had worse COVID-19 severity and cytokine storm (aOR, 3.33; 95% CI, 1.38-8.01, and aOR, 4.41; 95% CI, 1.71-11.38, respectively). Patients with immunosuppression receiving non-IO therapies (vs untreated) also had worse COVID-19 severity (aOR, 1.79; 95% CI, 1.36-2.35) and cytokine storm (aOR, 2.32; 95% CI, 1.42-3.79).Conclusions and RelevanceThis cohort study found that in patients with cancer and COVID-19, administration of systemic anticancer therapies, especially IO, in the context of baseline immunosuppression was associated with severe clinical outcomes and the development of cytokine storm.Trial RegistrationClinicalTrials.gov Identifier: NCT04354701
NCCN Guidelines® Insights: Hematopoietic Growth Factors, Version 1.2022
The NCCN Guidelines for Hematopoietic Growth Factors provide recommendations for the appropriate use of growth factors in the clinical management of febrile neutropenia (FN), chemotherapy-induced thrombocytopenia (CIT), and chemotherapy-induced anemia (CIA). Management and prevention of these sequelae are an integral part of supportive care for many patients undergoing cancer treatment. The purpose of these guidelines is to operationalize the evaluation, prevention, and treatment of FN, CIT, and CIA in adult patients with nonmyeloid malignancies and to enable the patient and clinician to assess management options for FN, CIT, and CIA in the context of an individual patient’s condition. These NCCN Guidelines Insights provide a summary of the important recent updates to the NCCN Guidelines for Hematopoietic Growth Factors, with particular emphasis on the incorporation of a newly developed section on CIT.
Assessment of Regional Variability in COVID-19 Outcomes Among Patients With Cancer in the United States
Abstract Background : Patients (pts) with COVID-19 are reported to have increased risk of venous thromboembolism yet bleeding has been an under recognized complication. Rates of bleeding remain unexamined in all patients especially in pts with cancer and COVID-19. Aim: To estimate the incidence of bleeding complication in patients with cancer and COVID 19 Methods: The CCC19 international registry (NCT04354701) aims to investigate complications of COVID-19 in pts with cancer. Our aim was to investigate the frequency of bleeding in hospitalized adult pts with cancer andCOVID-19, enrolled between March 16, 2020 and Feb 8, 2021. The incidence of bleeding complications was captured as defined by CCC19 and included both major and non major bleeding . Associated baseline clinic-pathologic prognostic factors and outcomes such as need for mechanical ventilation, intensive care unit (ICU) admission and mortality rates were assessed Results :3849 pts met analysis inclusion criteria. Bleeding was reported in 276 (7%) pts with median age of 70years; incidence was 6.6 % in females and 7.6 % in males, 6.5% in non-Hispanic white pts, 8.2 % in non-Hispanic Black pts, and 7.8 % in Hispanic pts. 74% had solid cancer and 29% had hematologic malignancies, 33% had received anti-cancer therapy in preceding 30 days, and 8% had surgery within 4weeks. In pts taking antiplatelet or anticoagulant medications at baseline, 7.2% developed bleeding. Need for mechanical ventilation, ICU admission, 30-day mortality, and total mortality were significantly higher in those with bleeding complications compared to those without, p<0.05 Conclusion : We describe the incidence of bleeding in a large cohort of pts with cancer and COVID-19. Bleeding events were observed in those with adverse outcomes including mechanical ventilation, ICU admission, and high mortality; the overall mortality of 43% in patients with bleeding complications is especially notable. This important complication may reflect underlying COVID-19 pathophysiology as well as iatrogenic causes. Figure 1 Figure 1. Disclosures Kumar: Diagnostica Stago: Honoraria. Zon: AMAGMA AND RLZ: Consultancy, Current holder of individual stocks in a privately-held company. Byeff: Pfizer, BMS, Takeda,Teva, Merck, United health: Consultancy, Current equity holder in publicly-traded company, Current holder of stock options in a privately-held company. Nagaraj: Novartis: Research Funding. Hwang: astrazaneca,Merck,bayer, Genentech: Consultancy, Research Funding. McKay: Myovant: Consultancy; Bayer: Membership on an entity's Board of Directors or advisory committees; AstraZeneca: Consultancy, Membership on an entity's Board of Directors or advisory committees; Exelixis: Consultancy, Membership on an entity's Board of Directors or advisory committees; Calithera: Membership on an entity's Board of Directors or advisory committees; Tempus: Research Funding; Merck: Consultancy, Membership on an entity's Board of Directors or advisory committees; Tempus: Membership on an entity's Board of Directors or advisory committees; Pfizer: Membership on an entity's Board of Directors or advisory committees, Research Funding; Janssen: Membership on an entity's Board of Directors or advisory committees; Bristol Myers Squibb: Consultancy, Membership on an entity's Board of Directors or advisory committees; Sanofi: Membership on an entity's Board of Directors or advisory committees; Novartis: Membership on an entity's Board of Directors or advisory committees; Dendreon: Consultancy; Caris: Other: Serves as a molecular tumor board ; Vividion: Consultancy; Sorrento Therapeutics: Consultancy; Bayer: Research Funding. Warner: Westat, Hemonc.org: Consultancy, Current holder of stock options in a privately-held company. Connors: Pfizer: Honoraria; CSL Behring: Research Funding; Alnylam: Consultancy; Bristol-Myers Squibb: Honoraria; takeda: Honoraria; Abbott: Consultancy. Rosovsky: Janssen: Consultancy, Research Funding; BMS: Consultancy, Research Funding; Inari: Consultancy, Membership on an entity's Board of Directors or advisory committees; Dova: Consultancy, Membership on an entity's Board of Directors or advisory committees.