Citations

Objective To examine the potential errors of a general large language model (LLM) (ie, Claude 3.5 Sonnet) on data extraction from randomised controlled trials (RCTs). Design and setting An empirical study comparing Claude 3.5 Sonnet extractions against a human-performed verification dataset. The extraction tasks for Claude 3.5 Sonnet were based solely on original RCT portable document format (PDF) files. For PDFs that could not be directly extracted by Claude 3.5 Sonnet, optical character recognition was employed to convert them into text format before extraction. Participants A random sample of 664 trials was selected from a well-established trial bank and a final data pool was established based on rigorous manual cross-checking as a reference standard. Data sources PubMed, EMBASE, Scopus, Web of Science (all databases) and the Cochrane Central Register of Controlled Trials (CENTRAL) up to February 2023. Eligibility criteria for selecting studies RCTs on children involving medication and adverse events. Main outcome measures Claude 3.5 Sonnet was applied to extract the basic information (eg, trial design, population information and source of funding) and adverse outcomes (ie, name of adverse events, number of events). Claude 3.5 Sonnet outputs were compared against the final data pool and all errors were recorded. Results are presented as error rates and with 95% CI, estimated using a generalised linear mixed model. Results For the 664 trials, a total of 23 069 data cells were extracted via Claude 3.5 Sonnet, with 10 624 for basic information and 12 445 for adverse outcomes. The overall error rate for data extraction was 6.6% (95% CI 5.4% to 8.2%), with 5.7% (95% CI 5.2% to 6.1%) in basic information and 7.6% (95% CI 4.9% to 11.8%) in adverse outcomes. When stratified the 1542 total errors by error types, misallocation (assigning data to incorrect fields; 57.1%, 881/1542) and missed or omitted data (incomplete extraction of available data; 23.2%, 357/1542) accounted for the two most frequent errors, with misallocation occurring more in basic information (53.3%, 470/881), while missed or omitted data occurred more in adverse outcomes (96.1%, 343/357). Post hoc analysis examining the association between trial reporting quality (assessed using Consolidated Standards of Reporting Trials (CONSORT) 2025 and LLM data extraction error rates indicated that higher CONSORT adherence was associated with lower extraction error rates. Conclusions The data extraction error of Claude was relatively low, but it alerts LLM applications in evidence synthesis. Detailed checking for LLM outputs should be the primary consideration for evidence synthesisers.

Objectives This study aims to compare the reliability and accuracy of three large language models (LLMs) (Claude, Gemini and GPT) in assessing the risk of bias of nonrandomised studies using the ROBINS-I tool. Methods and analysis We conducted a secondary analysis of 171 nonrandomised studies previously assessed with Risk Of Bias In Non-randomized Studies of Interventions (ROBINS-I) tool by two independent human review teams. Only studies with concordant human domain-level ratings were included. Each study was independently assessed twice by Claude, Gemini and Generative Pre-trained Transformer (GPT) using agent-based structured implementations of the ROBINS-I tool. Reliability (agreement between two runs of the same LLM) was evaluated using percent agreement and Gwet’s AC1. Accuracy (agreement with human reviewers) was assessed only for studies with consistent LLM ratings, using the same metrics. Results Claude demonstrated high reliability across all domains (79.5–98.0% agreement, AC1=0.729–0.975). Gemini showed moderate-to-high reliability (agreement 76.7–100%, AC1=0.680–1.0). GPT exhibited lower reliability overall, though domain-level agreement ranged from 70.9–95.6% (AC1=0.596–0.944). In terms of accuracy, Claude showed overall poor agreement with human reviewers (14.4–68.5% agreement; low AC1 values). Gemini demonstrated moderate-to-high accuracy in several domains, including deviations from intended interventions (79.6%, AC1=0.848) and measurement of outcomes (73.9%, AC1=0.702), with the highest overall agreement (40.0%, AC1=0.672). GPT showed variable accuracy, with the highest in measurement of outcomes (62.8%, AC1=0.571) and classification of interventions (57.8%, AC1=0.498), but poor performance in selection (14.3%, AC1 = −0.041) and overall agreement (23.0%, AC1=0.267). Conclusions Claude was internally consistent but poorly aligned with human reviewers. Gemini achieved both high reliability and moderate-to-high accuracy, whereas GPT had lower reliability and mixed accuracy. Current off-the-shelf LLMs cannot reliably perform ROBINS-I risk of bias assessments.

ABSTRACT Background Cytomegalovirus (CMV) infection remains one of the most prevalent and consequential post solid organ transplant (SOT) infections. Treatment is often challenging, especially when dealing with refractory and resistant CMV infections. Methods We performed a retrospective multicenter cohort study of SOT recipients with clinically significant CMV infection (csCMVi) during 2010–2016. The primary outcome was early refractory CMV infection and secondary outcomes were drug resistance, CMV recurrence, and mortality. Analysis was done with Kaplan‐Meier, univariable logistic regression analysis, and multivariable Cox regression. Results We included 145 SOT recipients with csCMVi, majority were liver transplant (49%). Most common induction was an anti‐IL‐2 antibody (43.9%). The majority ( n = 82; 56.5%) were CMV D+/R‐ mismatch and presented asymptomatic infection (50.3%). After the initial 3 weeks of antiviral therapy, 13 (8.9%) patients had probable refractory csCMVi; most of them (10 [76.9%]) were CMV D+/R‐ mismatch. Longer time after transplant had lower risk (OR 0.68; CI 0.48–0.95, p = 0.029) while lower absolute lymphocyte count (ALC) had a higher risk of early refractory csCMVi (OR 1.54; CI 1.01–2.44, p = 0.048). Drug‐resistant csCMVi occurred in 7 patients (4.8%); a high initial CMV DNA level was associated with resistant csCMVi (OR 2.00; CI 1.08–3.93, p = 0.031). 25 patients (17.2%) experienced recurrent csCMVi within 6 months. 30 patients (20.7%) died; refractory, resistant or recurrent CMV infections were not associated with mortality. Conclusion Refractory csCMVi is associated with a low ALC and an earlier onset after transplant. Resistant csCMVi is associated with high initial CMV DNA levels. Recurrence of csCMVi is common and potentially associated with low ALC at the end of antiviral treatment.

The persistent shortage of allogenic donor organs has driven the exploration of xenotransplantation as a viable alternative for patients with end-stage liver disease. This review investigates the progress and challenges in liver xenotransplantation, focusing on the use of genetically engineered animals, particularly pigs, as potential organ donors. This narrative review discusses various sources of xenografts, highlighting their advantages and limitations, and provides a historical overview of liver xenotransplantation, encompassing both clinical and experimental experiences. Key obstacles, such as immunological rejection, coagulation dysfunction, and the risk of zoonotic infections, are analyzed, with emphasis on how these challenges have been addressed through genetic modifications and adjunctive therapies. Recent clinical trials are also reviewed, offering insights into the outcomes and lessons learned from these pioneering efforts. We also explored the regulatory, legal, and ethical considerations critical to advancing liver xenotransplantation into clinical practice, along with future perspectives on the field’s evolution. This comprehensive overview aims to provide a clear understanding of the current state of liver xenotransplantation and the strategies being developed to overcome existing barriers, paving the way for future clinical applications.

Background and Objectives: Roux-en-Y gastric bypass (RYGB) is one of the most commonly performed metabolic and bariatric surgeries worldwide. Marginal ulcers (MU) are a common complication following RYGB, yet their pathophysiology and the contributing risk factors to their development are not fully understood. Materials and Methods: This retrospective cohort study examined patients who underwent RYGB between January 2008 and December 2023, with 1 to 5 years of follow-up. Data collected included patient- and procedure-related risk factors, as well as postoperative MU events. Statistical analysis methods included the independent samples t-tests, multivariate regression, and Cox regression analyses. Results: Our final cohort included 2106 patients and was predominantly female (80.5%), with a mean age of 47.8 ± 12.1 years and body mass index (BMI) of 45.5 ± 7.5 kg/m2. MU occurred in 241 (11.4%) patients, with a mean time to occurrence of 4.5 ± 0.02 years. History of smoking (HR = 1.87, p < 0.001) and gastroesophageal reflux disease (HR = 2.36, p < 0.001) significantly increased hazard for MU, while proton pump inhibitor use (HR = 0.18, p < 0.001) was associated with reduced hazard. Aspirin exposure, regardless of dose and chronicity, did not impact MU. Conclusions: Our findings highlight the importance of preoperative assessment and counseling in patients planning to undergo RYGB. Patient-related factors should guide postoperative monitoring and prophylaxis of MU, as this remains a debated topic amongst experts.

Background: Acute transverse myelitis (ATM) is an inflammatory disorder of the spinal cord with heterogeneous etiologies, including autoimmune, infectious, paraneoplastic, and drug-induced causes. Tumor necrosis factor-alpha (TNF-α) inhibitors have been infrequently associated with inflammatory central nervous system events, including transverse myelitis. TNF-inhibitor-associated myelitis typically presents with short-segment lesions, a normal brain MRI, and partial responsiveness to corticosteroids. Longitudinally extensive transverse myelitis (LETM) and steroid-refractory cases are uncommon. Case Presentation: A 39-year-old woman with psoriatic arthritis treated with etanercept for two years presented with subacute progressive bilateral lower-extremity sensory loss and weakness. MRI revealed a T2 hyperintense spinal cord lesion extending from T11 to L1 with gadolinium enhancement, consistent with transverse myelitis, while brain MRI was normal. Cerebrospinal fluid analysis showed lymphocytic pleocytosis, elevated protein, oligoclonal bands, and increased kappa free light chains. Extensive infectious, metabolic, paraneoplastic, and autoimmune testing, including aquaporin-4 and MOG antibodies, was negative. Despite high-dose intravenous corticosteroids and the discontinuation of etanercept, the patient experienced clinical worsening with lesion expansion, meeting criteria for LETM, and developed urinary retention. She subsequently underwent plasma exchange, resulting in radiologic improvement and moderate clinical recovery. Conclusions: This case highlights an atypical presentation of TNF-inhibitor-associated myelitis characterized by a biphasic course, longitudinally extensive spinal cord involvement, steroid refractoriness, and responsiveness to plasma exchange. These features suggest either an unusually severe TNF-inhibitor-related inflammatory phenotype or a TNF-inhibitor-triggered antibody-mediated demyelinating process. Reports of TNF-inhibitor-associated myelitis evolving into longitudinally extensive, steroid-refractory disease remain limited, and this presentation may broaden the recognized clinical spectrum of TNF-α-related CNS inflammatory events. Close neurologic follow-up and heightened awareness of severe CNS complications associated with TNF-α inhibitors are warranted.

Abstract Tunnel convergence in multiligament knee surgery remains a technical challenge. Anterior cruciate ligament (ACL) femoral sockets/tunnels and lateral collateral ligament (LCL) femoral sockets/tunnels during anatomic posterolateral corner (PLC) reconstructions are particularly vulnerable to convergence. This is secondary to the limited amount of bony real estate available on the lateral distal femur. Previous studies have attempted to define a specific angle to direct the LCL tunnel away from the ACL tunnel. However, inconsistency with ACL femoral socket creation and variability in bony architecture can make this strategy unreliable. This surgical technique describes how to minimize the risk of ACL and LCL tunnel convergence during ACL and PLC reconstructions.

Objective To evaluate the feasibility and potential efficacy of percutaneous spinal stimulation (epidural stimulation, ES) combined with task-specific training to reduce spasticity and improve gait and balance in individuals with progressive multiple sclerosis (MS). Methods Two men with progressive MS (EDSS 6.5) underwent ES lead implantation targeting the lower spinal cord, followed by one month of rehabilitation involving 12 ES-assisted training sessions. Assessments included instrumented gait analysis, Modified Ashworth Scale (MAS), pendulum test, and static balance testing performed at baseline, and at end of the study with ES-Off and ES-On conditions. Results Participant 1, with spastic hemiparetic gait, demonstrated improved lower extremity joint kinematics and muscle activation during gait, reduced knee extensor spasticity, and enhanced functional movement patterns with ES-On. Participant 2, with significant paraparesis and minimal spasticity, showed limited gait changes but experienced marked improvements in static balance, particularly under eyes-closed conditions. No adverse events were reported. Conclusion This pilot study demonstrates the feasibility and tolerability of ES paired with task-specific training in progressive MS. Participant-specific responses were observed, including improvements in gait kinematics, neuromuscular activation, spasticity, or balance; however, spatiotemporal gait parameters did not improve. These preliminary findings highlight response heterogeneity and the need for individualized ES parameter tuning. Trial registry name and URL: https://clinicaltrials.gov/study/NCT06019611