Citations

Objective Meaningful assessments of how large language models (LLMs) incorporate clinical guidelines require large-scale testing over many queries. Here, we evaluate the prevalence of clinical guideline omissions and hallucinations in a large sample of diagnostic LLM outputs. Methods We used simulated case vignettes and zero-shot prompting to generate diagnostic outputs and rationales from GPT-4.1 and DeepSeek-V3. English case vignettes were created for hypercholesterolaemia and type-2 diabetes mellitus. Each vignette contained identical medical information, while sociodemographic characteristics varied in terms of sex, ethnicity and location. We calculated the prevalence of existing and hallucinated clinical guidelines in LLM outputs across disease, LLM and sociodemographic characteristics. Results We analysed a total of 12 197 LLM outputs, which quantifies three hazard areas: omissions (up to 97% for DeepSeek-V3 and 46% for GPT-4.1), hallucinations (up to 9%) and inconsistencies (guideline citation rate ranging from 0% to 78.39% across sociodemographic vignettes). Omission and hallucination rates were generally similar across vignettes with different sex or ethnicity data, yet were particularly sensitive to patient location. Discussion This study highlights significant variability in clinical guideline prediction across two different diseases, three different sociodemographic variables and two LLMs, even when the LLMs were instructed by identical prompts, establishing clinical guideline prediction in LLM outputs as a stochastic event. Conclusion The stochastic nature of LLMs creates a unique challenge for evidence generation and clinical deployment. Being able to measure and capture this stochasticity within high-quality research designs will be a prerequisite to advancing the responsible deployment of LLMs in healthcare.

Introduction Video visits in primary care have decreased significantly since their surge early in the COVID-19 pandemic. Methods Clinicians including physicians, nurse practitioners, and physician assistants in the Mayo Clinic Department of Family Medicine were invited to dedicate one to two half-days per month exclusively to video visits. Schedules for these half-day sessions remained restricted to video appointments until the day prior. If at least 80% of slots were not filled by then, remaining openings were converted to in-person visits. If the half-day sessions were at least 80% full with video visits, clinicians had the option of performing these sessions remotely. Results Of 155 eligible clinicians, 34 (22%) participated voluntarily in this scheduling intervention. For the participating clinicians, the average video visit rate increased from 6.3% per month preintervention to 11.5% postintervention ( p < 0.001). On a departmental level, the trend line for the percent of outpatient visits via video visit was decreasing by −0.1% per month preintervention. The postintervention slope of the trend line was 0.3% per month ( p < 0.001). The majority (65%) of the time the half-day video visit schedules filled at least 80% and did not require conversion to allow in-person visits allowing clinicians to work remotely if they chose. Conclusion Allowing family medicine clinicians to perform 1–2 half-day schedules dedicated to only video visits increases the percentage of video visit performed per month both for individual clinicians and on a departmental level.

Objective Ambient listening with subsequent artificial intelligence enabled medical record documentation is changing how physicians interact with the electronic health record (EHR). We studied primary care physician use, documentation time, and changes in note metrics associated with ambient listening technology. Methods We calculated the percentage of physicians adopting the ambient listening tool, Abridge. Note input contributed by Abridge was determined by the percentage of total characters in generated notes. Using the Epic EHR Signal metrics, we analyzed the change in note documentation time and note length for Abridge users before and after they implemented Abridge in their note generation process. Results The percentage of physicians using Abridge increased from 15% to 50% in 8 weeks. Adoption was also reflected in the percentage of the note attributable to the use of ambient listening technology. Note content generated by Abridge tripled, from 5% to 15% over the same 8 weeks. After Abridge adoption, 332 primary care physicians had a mean time of 4.16 minutes [confidence interval (CI) 95%; 3.86, 4.46] time in notes per note in a paired comparison to 5.11 minutes [CI 95%; 4.75, 5.47] per note prior to Abridge. Mean time saved per note after Abridge was 0.95 minutes [CI 95%; 0.48, 1.42, p < 0.0001], an 18.6% reduction in time. Mean note length for Abridge adopters increased by 238 characters [CI 95%; 89, 387, p < 0.0001] from a pre-implementation mean of 4404 characters per note (+5.4%). Conclusion Ambient listening had rapid uptake and widespread use by physicians in primary care. It was also associated with a significant decrease in time in notes.

Introduction/Objectives: Little is known about the prevalence of patient-reported social risk factors and the use of the HOUSES Index, a simple, reliable method of assessing socioeconomic status (SES) based on publicly available housing data, in a predominantly rural, primary care population. Methods: We conducted a cross-sectional analysis of adult patients paneled to family medicine clinicians in a US Midwest health system as of December 31, 2022. Patients’ listed address determined HOUSES Index as quartile rank (Q1 lowest SES) and rural/urban status. Social risk data including housing, food, transportation, finances, and violence were collected from health record questionnaires. A mixed effect model was used to assess associations between social risk, HOUSES Index, and rurality. Results: Of the 352 355 patients included, rural patients were more likely than urban patients to report all social risk factors and had lower SES as measured by HOUSES quartiles. In the mixed effects analysis, HOUSES quartile was independently predictive of reporting an at-risk social risk factor (Q1 vs Q4 OR = 2.27, 95% CI = 2.19-2.37), but rurality was not (OR = 1.02, 95% CI = 0.97-1.07) after adjusting for HOUSES. Conclusions: The increased prevalence of social risk factors among rural residents is largely explained by individual SES measured by HOUSES Index.

We report the occurrence of a refractory infection caused by the “rapidly growing” nontuberculous mycobacterium, Mycobacterium fortuitum, after incisional hernia repair using synthetic mesh. The patient had previously undergone three herniorrhaphies incorporating polypropylene mesh. Multiple surgical debridements were required, along with complete removal of all the mesh, to eradicate the infection. Prolonged antimicrobial therapy with sulfamethoxazole, an agent active against the patient's isolate, was also used. Although this atypical mycobacterium has been reported to cause a variety of infections, including many types of periprosthetic infections, this case represents successful treatment of M. fortuitum infecting abdominal wall mesh.

AbstractObjectiveTo evaluate health care costs as a function of assigned primary care clinician type and care team characteristics.MethodsAdministrative data were collected for 68 family medicine clinicians (40 physicians and 28 nurse practitioners [NPs]/physician assistant [PAs]), on 11 care teams (variable MD, NP and PA on teams), caring for 77,141 patients. We performed a generalized linear mixed multivariable regression model of standardized per member per month (PMPM) median cost as the outcome, with four practice sites included as random effects.ResultsIn bivariate analysis, cost was higher in physicians than NP/PAs, in more complex patients, and associated with emergency department (ED) visit rate. On multivariate analysis, patient complexity, ED visit rate and higher patient experience ratings were independently associated with greater PMPM cost. More time in practice was associated with lower PMPM cost. In the adjusted multivariate model, physicians had 8.3% lower median PMPM costs than NP/PAs (p = 0.046).ConclusionsThe primary drivers of greater PMPM cost were patient complexity, ED visits and patient satisfaction.

Introduction Burn center patients present not only with burn injuries but also necrotizing infections, purpura fulminans, frostbite, toxic epidermal necrolysis, chronic wounds, and trauma. Burn surgeons are often faced with the need to amputate when limb salvage is no longer a viable option. The purpose of this study was to determine factors which predispose patients to extremity amputations. Methods: This retrospective registry review (2000-2019) compared patients who required upper extremity amputations with those who did not. Cases were pair-matched by age, sex, percent total body surface area (%TBSA), and type/location of injury to control for possible confounding variables. Results: There were 77 upper extremity amputee patients (APs) and 77 pair-matched non-amputees (NAPs) with the median age 45- and 43-years, %TBSA 21 and 10, respectively; second and third degree burn injuries were similar in the 2 groups. The AP group had longer hospitalizations (median 40 vs 15 days) P < .0001, with more intensive care unit days (median 28 vs 18 days). APs presented with significantly more cardiac, renal, and pulmonary comorbidities, acquired infections (61 [64%] vs 35 [36%]), escharotomies, and fasciotomies than the NAP, P < .0001. Mortality was similar (AP 14 [18.2%] vs NAP 9 [11.7%]), P = .26. Conclusions: Escharotomies, fasciotomies, sepsis, pneumonia, wound, and urinary tract infections contributed to prolonged hospitalizations and increased risk for upper extremity amputations in the AP group.

Effective medical teamwork can improve the effectiveness and experience of care for staff and patients, including safety. Healthcare organizations, and especially primary care clinics, have sought to improve medical teamwork through improved layout and design, moving staff into shared multidisciplinary team rooms. While co-locating staff has been shown to increase communication, successful designs balance four teamwork needs: face-to-face communications; situational awareness; heads-down work; perception of teamness. However, precautions for COVID-19 make it more difficult to conduct face-to-face communications. In this paper we describe a model for understanding how layout affects these four teamwork needs and describe how the perception of teamwork by staff changed after COVID-19 precautions were put in place. Observations, interviews and two standard surveys were conducted in two primary care clinics before COVID-19 and again in 2021 after a year of precautions. In general, staff felt more isolated and found it more difficult to conduct brief consults, though these perceptions varied by role. RNs, who spent more time on the phone, found it convenient to work part time-from home, while medical assistants found it more difficult to find providers in the distanced clinics. These cases suggest some important considerations for future clinic designs, including greater physical transparency that also allow for physical separation and more spaces for informal communication that are distanced from workstations.

Abstract Introduction Burn and traumatic limb injuries with exposed bone/tendon typically require surgical flaps or amputations for healing. Some burn patients are not candidates for these invasive techniques. Placental amniotic membrane has been used as a wound dressing for more than 100 years and may offer an alternative to flaps and/or amputations. Processed dehydrated human amnion/chorion membrane (dHACM), from human placental tissue, contains type 1 human collagen as well as non-viable cells and 285 identified regulatory proteins including growth factors, chemokines, cytokines, metalloproteinases, and other tissue growth and inflammatory mediators. dHACM has been successfully used as a dressing for wound ulcers, burns, donor sites, & surgical debridement. This study reports the use of dHCAM as a limb salvage tool in four patients with severe injuries. Methods This is a retrospective case series of patients suffering severe lower extremity injury with bone/tendon exposure that had applied dHACM/dHCM over or packed (depending on wound depth), then covered with 3% bismuth tribromophenate petrolatum dressing & glycerol/ hydroxyethylcellulose lubricant. Negative pressure wound therapy (NPWT) was initiated; wound re-evaluation occurred in seven days. dHACM/dHCM was reapplied if required (bone still exposed). Results There were 3 males and 1 female with three burns and one NSTI. The mean±sd (median) age was 58±23 (61) years; % total burn surface area 3±3 (2); length of hospital stay 48±30 (40) days; number of tangential excisions & debridements 6.5±1 (6.5); days from admission to product application 49±47 (34) and discharge 24±19 (19) days; negative pressure wound therapy (NPWT) 53±6 (56) days. All four patients continued treatment upon discharge with clinic visits and home NPWT. All recovered with good results and no complications. Treatment may be continued with NPWT therapy at home or in a skilled nursing facility. Patients healed after two to three dHACM/dHCM applications and did not require leg or foot amputations. Conclusions In select limb salvage cases, dHACM/HCM may be a promising alternative to extremity amputations, tissue transfer flaps or other techniques for secondary intention healing of wounds with bone/tendon exposure.

The objective was to determine if a greater proportion of physician full-time equivalent (FTE%) relative to nurse practitioners/physician assistants (NPs/PAs) on care teams was associated with improved individual clinician diabetes quality outcomes. The authors conducted a retrospective cross-sectional study of 420 family medicine clinicians in 110 care teams in a Midwest health system, using administrative data from January 1, 2017 to December 31, 2017. Poisson regression was used to examine the relationship between physician FTE% and the number of patients meeting 5 criteria included in a composite metric for diabetes management (D5). Covariates included panel size, clinician type, sex, years in practice, region, patient satisfaction, care team size, rural location, and panel complexity. Of the 420 clinicians, 167 (40%) were NP/PA staff and 253 (60%) were physicians. D5 criteria were achieved in 37.9% of NP/PA panels compared with 44.5% of physician panels ( P < .001). In adjusted analysis, rate of patients achieving D5 was unrelated to physician FTE% on the care team ( P = .78). Physicians had a 1.082 (95% confidence interval 1.007–1.164) times greater rate of patients with diabetes achieving D5 than NPs/PAs. Clinicians at rural locations had a .904 (.852-.959) times lower rate of achieving D5 than those at urban locations. Physicians had a greater rate of patients achieving D5 compared with NPs/PAs, but physician FTE% on the care team was unrelated to D5 outcomes. This suggests that clinician team composition matters less than team roles and the dynamics of collaborative care between members.