Citations

Poorly designed Electronic Health Records (EHRs) can lead to increased workloads, decreased efficiency, and medical errors. This cross-sectional study surveyed ICU providers’ perceptions of their EHR using the NASA-TLX and CSUQ surveys. We found that providers report increased temporal demand and effort when using the EHR, and that they are dissatisfied with the EHR’s interface quality.

Objectives/Goals: Digital recruitment can improve participant engagement in medical research, but its potential to introduce demographic and socioeconomic biases is unclear. This study investigates pathways participants took during a digital recruitment workflow in neurology, examining potential associations with socioeconomic and demographic factors. Methods/Study Population: As part of an ongoing study aiming to remotely capture speech from patients with neurologic disease, most participants seen in neurology on our campus are invited to complete a self-administered speech examination. We exported participant data from Epic (semi-automated identification and invitation), Qualtrics (eligibility screening), the participant tracking database (consent), and the recording platform (completion) for March to July 2024. Data visualization was performed using a Sankey diagram. Socioeconomic status was assessed using the housing-based socioeconomic status (HOUSES) index and area deprivation index (ADI) national rank. Kruskal–Wallis and Wilcoxon rank-sum tests were used to compare the median age, socioeconomic indices, and time taken to reach different steps of the study. Results/Anticipated Results: Of the 5846 invited participants, 57% were from urban areas, 23% from rural areas, and 20% from urban clusters. Most did not read/respond (2739) or declined (1749) the initial invitation via Epic. Of the 1358 interested participants, 415 completed the study. Participants from urban areas completed enrollment steps faster than those from rural areas and urban clusters, though the variance was large (42.6 ± 41.4 days vs. 50.6 ± 42.2 days and 50 ± 43.9 days, respectively; p = 0.030). Female participants took longer to complete enrollment than males (48.7 ± 44 days vs. 40.5 ± 38.8 days; p = 0.026). Participants who successfully finished the study had significantly lower ADI national ranks compared to other common pathways (40.6 ± 19; p = 0.0021). No associations were found with the HOUSES indices. Discussion/Significance of Impact: Our findings support differences in participant engagement, with urban participants and males more likely to complete enrollment steps. Those who finished the study were less disadvantaged suggesting potential bias in digital recruitment. These findings can inform strategies to improve digital recruitment in neurology research.

OBJECTIVES: This study aimed to establish a set of guiding principles for data sharing and harmonization in critical care, focusing on the use of real-world data (RWD) and real-world evidence (RWE) to improve patient outcomes and research efficacy. The principles were developed through a systematic literature review and a modified Delphi process, with the goal of enhancing data accessibility, standardization, and interoperability across critical care settings. DATA SOURCES: Data sources included a comprehensive search of peer-reviewed literature, specifically studies related to the use of RWD and RWE in healthcare, guidelines, best practices, and recommendations on data sharing and harmonization. A total of 8150 articles were initially identified through databases such as MEDLINE and Web of Science, with 257 studies meeting inclusion criteria. STUDY SELECTION: Inclusion criteria focused on publications discussing health-related informatics, recommendations for RWD/RWE usage, data sharing, and harmonization principles. Exclusion criteria ruled out non-human studies, case studies, conference abstracts, and articles published before 2013, as well as those not available in English. DATA EXTRACTION: From the 257 selected studies, 322 statements were extracted. After removing irrelevant definitions and off-topic content, 232 statements underwent content validation and thematic analysis. These statements were then consolidated into 24 candidate guiding principles after rigorous review and consensus-building among the expert panel. DATA SYNTHESIS: A three-phase modified Delphi process was employed, involving a conceptualization group, a review group, and a Delphi group. In phase 1, experts identified key themes and search terms for the systematic review. Phase 2 involved validating and refining the prospective guiding principles, while phase 3 employed a Delphi panel to rate principles on acceptability, importance, and feasibility. This process resulted in 24 guiding principles, with high consensus achieved in rounds 2 and 3 on their relevance and applicability. CONCLUSIONS: The systematic review and Delphi process resulted in 24 guiding principles to improve data sharing and harmonization in critical care. These principles address challenges across the data lifecycle, including generation, storage, access, and usage of RWD and RWE. This framework is designed to promote more effective and equitable data practices, with relevance for the development of artificial intelligence-based decision support tools and clinical research. The principles are intended to guide the responsible use of data science in critical care, with emphasis on ethics and equity, while acknowledging the variability of resources across settings.

OBJECTIVES: To develop the first core Critical Care Data Dictionary (C2D2) with common data elements (CDEs) to characterize critical illness and injuries. DESIGN: Group consensus process using modified Delphi approach. SETTING: Electronic surveys and in-person meetings. SUBJECTS: A multidisciplinary workgroup of clinicians and researchers with expertise in the care of the critically ill and injured. INTERVENTIONS: The Delphi process was divided into domain and CDE portions with each composed of two item generation rounds and one item reduction/refinement rounds. Two in-person meetings augmented this process to facilitate review and consideration of the domains and by panel members. The final set of domains and CDEs was then reviewed by the group to meet the competing criteria of utility and feasibility, resulting in the core dataset. MEASUREMENTS AND MAIN RESULTS: The 23-member Delphi panel was provided 1833 candidate variables for potential dataset inclusion. The final dataset includes 226 patient-level CDCs in nine domains, which include anthropometrics and demographics (8), chronic comorbid illnesses (18), advanced directives (1), ICU diagnoses (61), diagnostic tests (42), interventions (27), medications (38), objective assessments (26), and hospital course and outcomes (5). Upon final review, 91% of the panel endorsed the CDCs as meeting criteria for a minimum viable data dictionary. Data elements cross the lifespan of neonate through adult patients. CONCLUSIONS: The resulting C2D2 provides a foundation to facilitate rapid collection, analyses, and dissemination of information necessary for research, quality improvement, and clinical practice to optimize critical care outcomes. Further work is needed to validate the effectiveness of the dataset in a variety of critical care settings.

The early detection of the acute deterioration of escalating illness severity is crucial for effective patient management and can significantly impact patient outcomes. Ambient sensing technology, such as computer vision, may provide real-time information that could impact early recognition and response. This study aimed to develop a computer vision model to quantify the number and type (clinician vs. visitor) of people in an intensive care unit (ICU) room, study the trajectory of their movement, and preliminarily explore its relationship with delirium as a marker of illness severity. To quantify the number of people present, we implemented a counting-by-detection supervised strategy using images from ICU rooms. This was accomplished through developing three methods: single-frame, multi-frame, and tracking-to-count. We then explored how the type of person and distribution in the room corresponded to the presence of delirium. Our designed pipeline was tested with a different set of detection models. We report model performance statistics and preliminary insights into the relationship between the number and type of persons in the ICU room and delirium. We evaluated our method and compared it with other approaches, including density estimation, counting by detection, regression methods, and their adaptability to ICU environments.

Abstract Background Intensive care unit (ICU) clinicians encounter frequent challenges with managing vast amounts of fragmented data while caring for multiple critically ill patients simultaneously. This may lead to increased provider cognitive load that may jeopardize patient safety. Objectives This systematic review assesses the impact of centralized multipatient dashboards on ICU clinician performance, perceptions regarding the use of these tools, and patient outcomes. Methods A literature search was conducted on February 9, 2023, using the EBSCO CINAHL, Cochrane Central Register of Controlled Trials, Embase, IEEE Xplore, MEDLINE, Scopus, and Web of Science Core Collection databases. Eligible studies that included ICU clinicians as participants and tested the effect of dashboards designed for use by multiple users to manage multiple patients on user performance and/or satisfaction compared with the standard practice. We narratively synthesized eligible studies following the SWiM (Synthesis Without Meta-analysis) guidelines. Studies were grouped based on dashboard type and outcomes assessed. Results The search yielded a total of 2,407 studies. Five studies met inclusion criteria and were included. Among these, three studies evaluated interactive displays in the ICU, one study assessed two dashboards in the pediatric ICU (PICU), and one study examined centralized monitor in the PICU. Most studies reported several positive outcomes, including reductions in data gathering time before rounds, a decrease in misrepresentations during multidisciplinary rounds, improved daily documentation compliance, faster decision-making, and user satisfaction. One study did not report any significant association. Conclusion The multipatient dashboards were associated with improved ICU clinician performance and were positively perceived in most of the included studies. The risk of bias was high, and the certainty of evidence was very low, due to inconsistencies, imprecision, indirectness in the outcome measure, and methodological limitations. Designing and evaluating multipatient tools using robust research methodologies is an important focus for future research.

Computer vision (CV), a type of artificial intelligence (AI) that uses digital videos or a sequence of images to recognize content, has been used extensively across industries in recent years. However, in the healthcare industry, its applications are limited by factors like privacy, safety, and ethical concerns. Despite this, CV has the potential to improve patient monitoring, and system efficiencies, while reducing workload. In contrast to previous reviews, we focus on the end-user applications of CV. First, we briefly review and categorize CV applications in other industries (job enhancement, surveillance and monitoring, automation, and augmented reality). We then review the developments of CV in the hospital setting, outpatient, and community settings. The recent advances in monitoring delirium, pain and sedation, patient deterioration, mechanical ventilation, mobility, patient safety, surgical applications, quantification of workload in the hospital, and monitoring for patient events outside the hospital are highlighted. To identify opportunities for future applications, we also completed journey mapping at different system levels. Lastly, we discuss the privacy, safety, and ethical considerations associated with CV and outline processes in algorithm development and testing that limit CV expansion in healthcare. This comprehensive review highlights CV applications and ideas for its expanded use in healthcare.

Abstract Objective The aim of this study is to determine if supervised machine learning algorithms can accurately predict cancelled and self-intercepted computerized physician order entry in oral and maxillofacial surgery inpatients. Methods Data from Electronic Medical Record included patient demographics, comorbidities, procedures, vital signs, laboratory values, and medication orders were retrospectively collected. Predictor variables included patient demographics, comorbidities, procedures, vital signs, and laboratory values. Outcome of interest is if a medication order was voided or not. Data was cleaned and pro1cessed using Microsoft Excel and Python v3.12. Gradient Boosted Decision Trees, Random Forest, K-Nearest Neighbor, and Naïve Bayes were trained, validated, and tested for accuracy of the prediction of voided medication orders. Results 37,546 medication orders from 1,204 patient admissions over 5 years were used for this study included 3,892 (10.4%) medication orders that were voided. Gradient Boosted Decision Trees, Random Forest, K-Nearest Neighbor, and Naïve Bayes had an Area Under the Receiver Operating Curve of 0.802 802 with 95% CI [0.787, 0.825], 0.746 with 95% CI [0.722, 0.765], 0.685 with 95% CI [0.667, 0.699], and 0.505 with 95% CI [0.489, 0.539], respectively. Area Under the Precision Recall Curve was 0.684 with 95% CI [0.679, 0.702], 0.647 with 95% CI [0.638, 0.664], 0.429 with 95% CI [0.417, 0.434], and 0.551 with 95% CI [0.551, 0.552], respectively. Conclusion Gradient Boosted Decision Trees is the best model of the supervised machine learning algorithms with satisfactory performance in validation cohort for predicting voided Computerized Physician Order Entry in Oral and Maxillofacial Surgery inpatients.

ABSTRACT Purpose: The aim of the study is to evaluate whether serial assessment of shock severity can improve prognostication in intensive care unit (ICU) patients. Materials and Methods: This is a retrospective cohort of 21,461 ICU patient admissions from 2014 to 2018. We assigned the Society for Cardiovascular Angiography and Interventions (SCAI) Shock Stage in each 4-h block during the first 24 h of ICU admission; shock was defined as SCAI Shock stage C, D, or E. In-hospital mortality was evaluated using logistic regression. Results: The admission SCAI Shock stages were as follows: A, 39.0%; B, 27.0%; C, 28.9%; D, 2.6%; and E, 2.5%. The SCAI Shock stage subsequently increased in 30.6%, and late-onset shock developed in 30.4%. In-hospital mortality was higher in patients who had shock on admission (11.9%) or late-onset shock (7.3%) versus no shock (4.3%). Persistence of shock predicted higher mortality (adjusted OR = 1.09; 95% CI = 1.06–1.13, for each ICU block with shock). The mean SCAI Shock stage had higher discrimination for in-hospital mortality than the admission or maximum SCAI Shock stage. Dynamic modeling of the SCAI Shock classification improved discrimination for in-hospital mortality (C-statistic = 0.64–0.71). Conclusions: Serial application of the SCAI Shock classification provides improved mortality risk stratification compared with a single assessment on admission, facilitating dynamic prognostication.