Performance of an artificial intelligence/machine learning model designed to identify hospitalized patients with cancer who could benefit from timely specialized palliative care delivery.
1559 Background: Timely access to specialty Palliative Care (SPC) services provides significant benefits to hospitalized patients with cancer, including improvements in quality of life. However, many patients with cancer who could benefit from SPC suffer from lack of timely referral or do not receive SPC services. A previously published trial of an artificial intelligence/machine learning (AI/ML) model to predict need for SPC at Mayo Clinic increased timely SPC consultation of hospitalized patients overall. We sought to review the performance of this algorithm in patients with cancer across an expanded hospitalized population. Methods: The study population consisted of all patients admitted into a Mayo Clinic hospital in Minnesota, Wisconsin, Arizona and Florida between January 2020 and September 2023. Due to the size of the cohort a case-control sample of three controls for every case was created. Patients were considered to be a patient with cancer if they had at least one billing diagnosis up to 1 year prior to their index hospitalization from any of the 5 HCC categories denoting cancer: Metastatic Cancer and Acute Leukemia (HCC 8); Lung and Other Severe Cancers (HCC 9); Lymphoma and Other Cancers (HCC 10); Colorectal, Bladder, and Other Cancers (HCC 11); and Breast, Prostate, and Other Cancers and Tumors (HCC 12). The training data set consisted of 107,076 patient encounters with a total of 8,355,090 time periods of constant risk. An AI/ML model using gradient boosting methods which contained 269 variables (both static and time-varying) of various classes with SPC consultation treated as a time-to-event outcome was trained. Results: Due to the longitudinal nature of the prediction, performance was assessed using the max score AUC (using the max score a patient received during a given encounter prior to an event or discharge) to produce the AUC. The model had an overall AUC of 0.932 (0.929, 0.935 – 95% CI). We saw a decrease in performance of the AI/ML model in the Oncology population with an overall performance of 0.818 (0.806, 0.83). Some of the most influential variables were previous SPC visit, age, metastatic disease, acute leukemia diagnosis, and pain scores. Conclusions: An AI/ML model can effectively predict the need for an inpatient PC consult in a population of hospitalized patients with cancer. [Table: see text]
Palliative Care and Pulmonary Arterial Hypertension
Background Pulmonary arterial hypertension (PAH) is a chronic and progressive disease associated with impaired health-related quality of life and survival. Palliative care (PC) is patient- and family-centered care provided by an interdisciplinary team with an overarching goal of alleviating suffering and improving quality of life for patients with advanced illness. PC in other chronic diseases is associated with improved quality of life, symptom management, illness understanding, and reduced caregiver burden, but there is limited data regarding PC in PAH. Despite limited evidence, there is strong rationale for involving PC specialists in the longitudinal management of PAH. Implications for Clinicians There are currently no guidelines to help clinicians determine the most appropriate timing for referral of PAH patients to PC specialty teams. Consequently, referrals are limited and often delayed. Adoption of a standardized approach to PC referrals based on clinical or patient triggers could facilitate earlier involvement of PC as an adjunct to ongoing PAH disease-directed care. Conclusions Incorporation of PC in the longitudinal management of PAH may be beneficial to address the multidimensional aspects of living with a chronic and life-limiting illness.
Improving Time to Palliative Care Review With Predictive Modeling: Study Protocol for a Stepped-wedge, Pragmatic Randomized Controlled Trial
Abstract Background: Palliative care is a medical specialty centered on improving the quality of life (QOL) of patients with complex or life-threatening illnesses. The need for Palliative care is increasing and with that the rigorous testing of triage tools that can be used quickly and reliably to identify patients that may benefit from palliative care. Methods: To that Aim we will conduct a two-armed stepped-wedge cluster randomized trial rolled out to two inpatient hospitals to evaluate whether a machine learning algorithm accurately identifies patients who may benefit from a comprehensive review by a palliative care specialist, and decreases time to receiving a palliative care consult in hospital. This is a single-center study which will be conducted from August 2019 to November 2020 at Saint Mary’s Hospital & Methodist Hospital, Mayo Clinic, Rochester, Minnesota. Clusters will be nursing units which will be chosen to be a mix of complex patients from Cardiology, Critical Care and Oncology and had previously established relationships with palliative medicine. The stepped wedge design will have 12 units allocated to a design matrix of 5 treatment wedges. Each wedge will last 75 days resulting in a study period of 12 months unless otherwise specified. Data will be analyzed with Bayesian hierarchical models with credible intervals denoting statistical significance.Discussion: This intervention offers a pragmatic approach to delivering specialty palliative care to hospital patients in need using machine learning, thereby leading to high value care and improved outcomes. It is not enough for AI to be utilized by simply publishing research showing predictive performance; Clinical trials demonstrating better outcomes are critically needed. Furthermore, the deployment of an AI algorithm is a complex process that requires multiple teams with varying skill sets. To evaluate a deployed AI, a pragmatic clinical trial can accommodate the difficulties of clinical practice whilst retaining scientific rigor.Trial registration NCT03976297 (ClinicalTrials.gov), registered on June 6, 2019 prior to trial start.