Purpose To develop a machine learning algorithm to predict total charges after ambulatory hip arthroscopy and create a risk‐adjusted payment model based on patient comorbidities. Methods A retrospective review of the New York State Ambulatory Surgery and Services database was performed to identify patients who underwent elective hip arthroscopy between 2015 and 2016. Features included in initial models consisted of patient characteristics, medical comorbidities, and procedure‐specific variables. Models were generated to predict total charges using 5 algorithms. Model performance was assessed by the root‐mean‐square error, root‐mean‐square logarithmic error, and coefficient of determination. Global variable importance and partial dependence curves were constructed to show the impact of each input feature on total charges. For performance benchmarking, the best candidate model was compared with a multivariate linear regression using the same input features. Results A total of 5,121 patients were included. The median cost after hip arthroscopy was $19,720 (interquartile range, $12,399‐$26,439). The gradient‐boosted ensemble model showed the best performance (root‐mean‐square error, $3,800 [95% confidence interval, $3,700‐$3,900]; logarithmic root‐mean‐square error, 0.249 [95% confidence interval, 0.24‐0.26]; R 2 = 0.73). Major cost drivers included total hours in facility less than 12 or more than 15, longer procedure time, performance of a labral repair, age younger than 30 years, Elixhauser Comorbidity Index (ECI) of 1 or greater, African American race, residence in extreme urban and rural areas, and higher household and neighborhood income. Conclusions The gradient‐boosted ensemble model effectively predicted total charges after hip arthroscopy. Few modifiable variables were identified other than anesthesia type; nonmodifiable drivers of total charges included duration of care less than 12 hours or more than 15 hours, operating room time more than 100 minutes, age younger than 30 years, performance of a labral repair, and ECI greater than 0. Stratification of patients based on the ECI highlighted the increased financial risk borne by physicians via flat reimbursement schedules given variable degrees of comorbidities. Level of Evidence Level III, retrospective cohort study.
Machine Learning Model Identifies Increased Operative Time and Greater BMI as Predictors for Overnight Admission After Outpatient Hip Arthroscopy
Arthroscopy, Sports Medicine, and Rehabilitation | November 12, 2021 | Volume: 3 | Issue: 6 | Pages: No page available
Purpose The purposes of this study were to identify patient characteristics and risk factors for overnight admission following outpatient hip arthroscopy and to develop a machine learning algorithm that can effectively identify patients requiring admission following elective hip arthroscopy. Methods A retrospective review of a prospectively collected national surgical outcomes database was performed to identify patients who underwent elective outpatient hip arthroscopy from 2006 to 2018. Patients admitted overnight postoperatively were identified as those with length of stay of 1 or more days. Models were generated using random forest (RF), extreme gradient boosting (XGBoost), adaptive boosting (AdaBoost), elastic net penalized logistic regression, and an additional model was produced as a weighted ensemble of the four final algorithms. Results Overall, 1,276 patients were included. The median age was 43 years, and 64.2% (819) were female. Of the included patients, 109 (8.5%) required an overnight stay following elective outpatient hip arthroscopy. The most important factors for inpatient admission were increasing operative time, general anesthesia, age extremes, male gender, greater body mass index (BMI), American Society of Anesthesiologists classification >1, and the following preoperative lab values outside of normal ranges: sodium, platelet count, hematocrit, and leukocyte count. The ensemble model achieved the best performance based on discrimination assessed via internal validation (area under the curve = .71), calibration, and decision curve analysis. The model was integrated into a Web‐based open‐access application able to provide both personalized predictions and explanations. Conclusion A machine learning algorithm developed based on preoperative features identified increasing operative time, age extremes, greater BMI, sodium, hematocrit, platelets, and leukocyte count as the most important variables associated with inpatient admission with fair validity.
Machine‐learning model successfully predicts patients at risk for prolonged postoperative opioid use following elective knee arthroscopy
AbstractPurposeRecovery following elective knee arthroscopy can be compromised by prolonged postoperative opioid utilization, yet an effective and validated risk calculator for this outcome remains elusive. The purpose of this study is to develop and validate a machine‐learning algorithm that can reliably and effectively predict prolonged opioid consumption in patients following elective knee arthroscopy.MethodsA retrospective review of an institutional outcome database was performed at a tertiary academic medical centre to identify adult patients who underwent knee arthroscopy between 2016 and 2018. Extended postoperative opioid consumption was defined as opioid consumption at least 150 days following surgery. Five machine‐learning algorithms were assessed for the ability to predict this outcome. Performances of the algorithms were assessed through discrimination, calibration, and decision curve analysis.ResultsOverall, of the 381 patients included, 60 (20.3%) demonstrated sustained postoperative opioid consumption. The factors determined for prediction of prolonged postoperative opioid prescriptions were reduced preoperative scores on the following patient‐reported outcomes: the IKDC, KOOS ADL, VR12 MCS, KOOS pain, and KOOS Sport and Activities. The ensemble model achieved the best performance based on discrimination (AUC = 0.74), calibration, and decision curve analysis. This model was integrated into a web‐based open‐access application able to provide both predictions and explanations.ConclusionFollowing appropriate external validation, the algorithm developed presently could augment timely identification of patients who are at risk of extended opioid use. Reduced scores on preoperative patient‐reported outcomes, symptom duration and perioperative oral morphine equivalents were identified as novel predictors of prolonged postoperative opioid use. The predictive model can be easily deployed in the clinical setting to identify at risk patients thus allowing providers to optimize modifiable risk factors and appropriately counsel patients preoperatively.Level of evidenceIII.
Machine learning can reliably identify patients at risk of overnight hospital admission following anterior cruciate ligament reconstruction
AbstractPurposeOvernight admission following anterior cruciate ligament reconstruction has implications on clinical outcomes as well as cost benefit, yet there are few validated risk calculators for reliable identification of appropriate candidates. The purpose of this study is to develop and validate a machine learning algorithm that can effectively identify patients requiring admission following elective anterior cruciate ligament (ACL) reconstruction. MethodsA retrospective review of a national surgical outcomes database was performed to identify patients who underwent elective ACL reconstruction from 2006 to 2018. Patients admitted overnight postoperatively were identified as those with length of stay of 1 or more days. Models were generated using random forest (RF), extreme gradient boosting (XGBoost), linear discriminant classifier (LDA), and adaptive boosting algorithms (AdaBoost), and an additional model was produced as a weighted ensemble of the four final algorithms.ResultsOverall, of the 4,709 patients included, 531 patients (11.3%) required at least one overnight stay following ACL reconstruction. The factors determined most important for identification of candidates for inpatient admission were operative time, anesthesia type, age, gender, and BMI. Smoking history, history of COPD, and history of coagulopathy were identified as less important variables. The following factors supported overnight admission: operative time > 200 min, age < 35.8 or > 53.5 years, male gender, BMI < 25 or > 31.2 kg/m2, positive smoking history, history of COPD and the presence of preoperative coagulopathy. The ensemble model achieved the best performance based on discrimination assessed via internal validation (AUC = 0.76), calibration, and decision curve analysis. The model was integrated into a web‐based open‐access application able to provide both predictions and explanations.ConclusionModifiable risk factors identified by the model such as increased BMI, operative time, anesthesia type, and comorbidities can help clinicians optimize preoperative status to prevent costs associated with unnecessary admissions. If externally validated in independent populations, this algorithm could use these inputs to guide preoperative screening and risk stratification to identify patients requiring overnight admission for observation following ACL reconstruction.Level of evidenceIV.
Perioperative Opioid Use Predicts Postoperative Opioid Use and Inferior Outcomes After Shoulder Arthroscopy
Purpose The purpose of this study is to define the impact of preoperative opioid use on postoperative opioid use, patient‐reported outcomes, and revision rates in a cohort of patients receiving arthroscopic shoulder surgery. Methods Patients who underwent shoulder arthroscopy were identified from an institutional database. Inclusion criteria were completion of preoperative and postoperative patient‐reported outcome measures (PROMs) at 1‐year follow‐up and completion of a questionnaire on use of opioids and number of pills per day. Outcomes assessed included postoperative PROM scores, postoperative opioid use, persistent pain, and achievement of the patient acceptable symptomatic state. A matched cohort analysis was performed to evaluate the impact of opioid use on achievement of postoperative outcomes, whereas a multivariate regression was performed to determine additional risk factors. Receiver operating characteristic curves were used to establish threshold values in oral morphine equivalents (OMEs) that predicted each outcome. Results A total of 184 (16.3%) patients were included in the opioid use (OU) group and 1,058 in the no opioid use (NOU) group. The OU and NOU groups showed statistically significant differences in both preoperative and postoperative scores across all PROMs ( P < .001). Multivariate logistic regression identified preoperative opioid use as a significant predictor of reduced achievement of the patient acceptable symptomatic state (odds ratio [OR], 0.69, 95% confidence interval [CI], 0.29‐0.83, P = .008), increased likelihood of endorsing persistent pain (OR, 1.73, 95% CI, 1.17‐2.56, P = .006), and increased opioid use at 1 year (OR, 21.3, 95% CI, 12.2‐37.2, P < .001). Consuming a high dosage during the perioperative period increased risk of revision surgery (OR, 8.59, 95% CI, 2.12‐34.78, P < .003). Results were confirmed by matched cohort analysis. Receiver operating characteristic analysis found that total OME >1430 mg/d in the perioperative period (area under the curve, 0.76) and perioperative daily OME >32.5 predicted postoperative opioid consumption (area under the curve, 0.79). Conclusions Patients with a history of preoperative opioid use can achieve significant improvements in patient‐reported outcomes after arthroscopic shoulder surgery. However, preoperative opioid use negatively impacts patients’ level of satisfaction and is a significant predictor of pain and continued opioid usage. Level of evidence Level III, retrospective cohort study