Barry, Barbara

Abstract Pharmacogenomic (PGx) biomarkers integrated using machine learning can be embedded within the electronic health record (EHR) to provide clinicians with individualized predictions of drug treatment outcomes. Currently, however, drug alerts in the EHR are largely generic (not patient‐specific) and contribute to increased clinician stress and burnout. Improving the usability of PGx alerts is an urgent need. Therefore, this work aimed to identify principles for optimal PGx alert design through a health‐system‐wide, mixed‐methods study. Clinicians representing multiple practices and care settings ( N = 1062) in urban, rural, and underserved regions were invited to complete an electronic survey comparing the usability of three drug alerts for citalopram, as a case study. Alert 1 contained a generic warning of pharmacogenomic effects on citalopram metabolism. Alerts 2 and 3 provided patient‐specific predictions of citalopram efficacy with varying depth of information. Primary outcomes included the System's Usability Scale score (0–100 points) of each alert, the perceived impact of each alert on stress and decision‐making, and clinicians' suggestions for alert improvement. Secondary outcomes included the assessment of alert preference by clinician age, practice type, and geographic setting. Qualitative information was captured to provide context to quantitative information. The final cohort comprised 305 geographically and clinically diverse clinicians. A simplified, individualized alert (Alert 2) was perceived as beneficial for decision‐making and stress compared with a more detailed version (Alert 3) and the generic alert (Alert 1) regardless of age, practice type, or geographic setting. Findings emphasize the need for clinician‐guided design of PGx alerts in the era of digital medicine.

AbstractBackgroundTechnology has revolutionized not only direct patient care but also diagnostic care processes. This study evaluates the transition from glass‐slide microscopy to digital pathology (DP) at a multisite academic institution, using mixed methods to understand user perceptions of digitization and key productivity metrics of practice change.MethodsParticipants included dermatopathologists, pathology reporting specialists, and clinicians. Electronic surveys and individual or group interviews included questions related to technology comfort, trust in DP, and rationale for DP adoption. Case volumes and turnaround times were abstracted from the electronic health record from Qtr 4 2020 to Qtr 1 2023 (inclusive). Data were analyzed descriptively, while interviews were analyzed using methods of content analysis.ResultsThirty‐four staff completed surveys and 22 participated in an interview. Case volumes and diagnostic turnaround time did not differ across the institution during or after implementation timelines (p = 0.084; p = 0.133, respectively). 82.5% (28/34) of staff agreed that DP improved the sign‐out experience, with accessibility, ergonomics, and annotation features described as key factors. Clinicians reported positive perspectives of DP impact on patient safety and interdisciplinary collaboration.ConclusionsOur study demonstrates that DP has a high acceptance rate, does not adversely impact productivity, and may improve patient safety and care collaboration.

With abundant information and interconnectedness among people, identifying knowledgeable individuals in specific domains has become crucial for organizations. Artificial intelligence (AI) algorithms have been employed to evaluate the knowledge and locate experts in specific areas, alleviating the manual burden of expert profiling and identification. However, there is a limited body of research exploring the application of AI algorithms for expert finding in the medical and biomedical fields. This study aims to conduct a scoping review of existing literature on utilizing AI algorithms for expert identification in medical domains. We systematically searched five platforms using a customized search string, and 21 studies were identified through other sources. The search spanned studies up to 2023, and study eligibility and selection adhered to the PRISMA 2020 statement. A total of 571 studies were assessed from the search. Out of these, we included six studies conducted between 2014 and 2020 that met our review criteria. Four studies used a machine learning algorithm as their model, while two utilized natural language processing. One study combined both approaches. All six studies demonstrated significant success in expert retrieval compared to baseline algorithms, as measured by various scoring metrics. AI enhances expert finding accuracy and effectiveness. However, more work is needed in intelligent medical expert retrieval.

Introduction: Asymptomatic LV systolic dysfunction is often underdiagnosed, leading to missed opportunities for treatment. In a recently completed pragmatic RCT, an AI algorithm performed on the ECGs ordered as part of routine practice increased early diagnosis of low EF. The current study aimed to understand whether the effectiveness of the AI algorithm integrated into routine care differed by the socioeconomic status of the patient. Methods: The main findings of the RCT were previously published. Clinicians in the intervention group had access to AI results (i.e., a positive or negative screening result, with positive results indicating a high likelihood of low EF). When a positive result was found, clinicians in the intervention group received an alert that encouraged them to order TTE if considered clinically appropriate. Clinicians in the control group did not have access or received alerts. Area deprivation index (ADI) was used to measure area-level social determinants of health. This study included 16,992 patients (control 8,225; intervention: 8,767) who had ECG performed for any indications between 8/5/2019 and 3/31/2020, no prior HF, and a valid address to derive ADI. The primary endpoint was a new diagnosis of EF≤50% within 3 months. Results: The mean age was 60.5±17.6 y. AI increased the diagnosis of low EF in the overall cohort (OR 1.42 [1.13, 1.78], p=0.01). The magnitude of benefit was greater in patients with higher socioeconomic status, e.g., living in an area that is less deprived (OR 1.88 [1.16, 3.05]), with higher median income, lower poverty rate, higher education level, better housing conditions, and higher proportion of white-collar workers, although the interaction was not statistically significant (Figure). Conclusions: AI enables early diagnosis of low EF and the magnitude of benefit might be numerically greater in patients with higher socioeconomic status, possibly due to variations in access to or referral for subsequent testing.

Background: Health systems are increasingly recognizing the importance of collecting social determinants of health (SDoH) data. However, gaps remain in our understanding of facilitators or barriers to collection. To address these gaps, we evaluated a real-world implementation of a SDoH screening tool. Methods: We conducted a retrospective analysis of the implementation of the SDoH screening tool at Mayo Clinic in 2019. The outcomes are: (1) completion of screening and (2) the modality used (MyChart: filled out on patient portal; WelcomeTablet: filled out by patient on a PC-tablet; EpicCare: data obtained directly by provider and entered in chart). We conducted logistic regression for completion and multinomial logistic regression for modality. The factors of interest included race and ethnicity, use of an interpreter, and whether the visit was for primary care. Results: Overall, 58.7% (293,668/499,931) of screenings were completed. Patients using interpreters and racial/ethnic minorities were less likely to complete the screening. Primary care visits were associated with an increase in completion compared with specialty care visits. Patients who used an interpreter, racial and ethnic minorities, and primary care visits were all associated with greater WelcomeTablet and lower MyChart use. Conclusion: Patient and system-level factors were associated with completion and modality. The lower completion and greater WelcomeTablet use among patients who use interpreters and racial and ethnic minorities points to the need to improve screening in these groups and that the availability of the WelcomeTablet may have prevented greater differences. The higher completion in primary care visits may mean more outreach is needed for specialists.

Background While use of artificial intelligence (AI) in healthcare is increasing, little is known about how patients view healthcare AI. Characterizing patient attitudes and beliefs about healthcare AI and the factors that lead to these attitudes can help ensure patient values are in close alignment with the implementation of these new technologies. Methods We conducted 15 focus groups with adult patients who had a recent primary care visit at a large academic health center. Using modified grounded theory, focus-group data was analyzed for themes related to the formation of attitudes and beliefs about healthcare AI. Results When evaluating AI in healthcare, we found that patients draw on a variety of factors to contextualize these new technologies including previous experiences of illness, interactions with health systems and established health technologies, comfort with other information technology, and other personal experiences. We found that these experiences informed normative and cultural beliefs about the values and goals of healthcare technologies that patients applied when engaging with AI. The results of this study form the basis for a theoretical framework for understanding patient orientation to applications of AI in healthcare, highlighting a number of specific social, health, and technological experiences that will likely shape patient opinions about future healthcare AI applications. Conclusions Understanding the basis of patient attitudes and beliefs about healthcare AI is a crucial first step in effective patient engagement and education. The theoretical framework we present provides a foundation for future studies examining patient opinions about applications of AI in healthcare.

Research ObjectiveAn artificial intelligence (AI) algorithm based on ECG was integrated into clinical workflows to identify patients with a high likelihood of low ejection (EF), a condition that is underdiagnosed but treatable. The trial aimed to assess whether the AI‐powered clinical decision support enabled early diagnosis of low EF.Study DesignA pragmatic, cluster randomized controlled trial (RCT) was conducted in 45 primary care practices, including an academic medical center as well as community and rural clinics across Minnesota and Wisconsin. A total of 120 primary care teams, including 358 clinicians, were randomized to either intervention (access to AI results with positive results indicating a high likelihood of low EF; 181 clinicians) or control (usual care; 177 clinicians). The primary endpoint was a new diagnosis of EF≤50% within 90 days. A positive deviance qualitative study and a survey were used to assess implementation strategies.Population StudiedIn total, 22,641 adult patients (N = 11,573 intervention; N = 11,068 control) with ECG performed as part of routine care between 8/5/2019 and 3/31/2020 were included. Patients were excluded if they had known EF≤50% or a history of documented heart failure (HF) identified by clinical notes abstracted by natural language processing.Principal FindingsThe mean age of patients was 60.5 ± 17.6 years; 53.9% were women. Positive AI results were found in 6.0% of patients in both arms. Clinicians in the intervention group obtained more echocardiograms for patients with positive results (38.1% control vs. 49.6% intervention, p < 0.001), but in the overall cohort, the echocardiogram utilization was similar (18.2% vs. 19.2%, p = 0.17). The intervention increased the diagnosis of low EF in the overall cohort (1.6% vs. 2.1%, odds ratio [OR] 1.32 [1.01–1.61], p = 0.007) and among patients with positive results (14.5% vs. 19.5% OR 1.43 [1.08–1.91], p = 0.01). Results using different thresholds for low EF were consistent with the primary result. Among patients with positive results, the intervention increased echocardiography more significantly in women vs. men (p for interaction 0.02), in patients without prior echocardiogram vs. those with prior echocardiogram (p for interaction 0.04), and in patients whose ECGs were ordered in outpatient clinics (p for interaction 0.02).ConclusionsAn AI algorithm run on existing ECGs enabled the early diagnosis of low EF in a large cohort of patients managed in routine primary care practices. Because ECG is a low‐cost test frequently performed for a variety of purposes, the algorithm could improve early diagnosis and treatment of a condition that is often asymptomatic but has effective treatments, and thus, reduce the disease burden in broad populations.Implications for Policy or PracticeThe current study is one of the first RCTs that demonstrated the value of AI in routine practice. Low EF confers an increased risk of HF progression and mortality. Although there are effective therapies, low EF is undiagnosed, leading to missed opportunities for treatment. EF can be readily determined by echocardiography, but the imagining test is too resource‐intensive to screen unselected populations. The AI applied to the existing ECGs could identify high‐risk patients for further assessment.Primary Funding SourceMayo Clinic.