Citations

Abstract Generative artificial intelligence (AI) holds immense potential for medical applications, but the lack of a comprehensive evaluation framework and methodological deficiencies in existing studies hinder its effective implementation. Standardized assessment guidelines are crucial for ensuring reliable and consistent evaluation of generative AI in healthcare. Our objective is to develop robust, standardized guidelines tailored for evaluating generative AI performance in medical contexts. Through a rigorous literature review utilizing the Web of Sciences, Cochrane Library, PubMed, and Google Scholar, we focused on research testing generative AI capabilities in medicine. Our multidisciplinary team of experts conducted discussion sessions to develop a comprehensive 32‐item checklist. This checklist encompasses critical evaluation aspects of generative AI in medical applications, addressing key dimensions such as question collection, querying methodologies, and assessment techniques. The checklist and its broader assessment framework provide a holistic evaluation of AI systems, delineating a clear pathway from question gathering to result assessment. It guides researchers through potential challenges and pitfalls, enhancing research quality and reporting and aiding the evolution of generative AI in medicine and life sciences. Our framework furnishes a standardized, systematic approach for testing generative AI's applicability in medicine. For a concise checklist, please refer to Table S or visit GenAIMed.org .

Abstract OBJECTIVEOsteoarthritis (OA) is the most common form of joint disease which usually affects load-bearing joints such as hip and knee joints. Most guidelines recommend the use non-steroidal anti-inflammatory drugs (NSAIDs), duloxetine and tramadol for the non-operative treatment of OA, the use of them is limited by the tolerability and safety concerns. Lutikizumab is a novel anti–IL-1α/β dual variable domain immunoglobulin that can simultaneously binds and inhibits IL-1α and IL-1β to relieve the pain and dysfunction symptoms. We conducted this network meta-analysis to comprehensively compare the clinical efficacy and safety of lutikizumab with other drugs recommended by guidelines.DESIGNSystematic review and Bayesian network meta-analysis.DATA SOURCESAll eligible studies in PubMed, CKNI, EMBASE and Web of Science databases, from January 2000 to January 2020.METHODSBayesian network and conventional meta-analyses were conducted. Pain relief, function improvement and risk of adverse effects (AEs) were assessed.RESULTS24 articles with 11858 patients were included. Lutikizumab showed no benifit compared with placebo for both pain relief (SMD 1.11, 95% CI [-2.29 to 4.52]) and function improvement (SMD 0.992, 95% CI [-0.433 to 4.25]). Lutikizumab and all other drugs are of favorable tolerance for patients in treatment of OA compared with placebo.CONCLUSIONSThe results show that lutikizumab, the new anti–Interleukin-1α/β dual variable domain immunoglobulin, did not improve pain or function in the comparison with placebo. Selective cox-2 inhibitors remain the most effective and safest treatment for osteoarthritis. More high-quality trials are still needed to reconfirm the findings of this study.

ABSTRACT IDX184 is a liver-targeted prodrug of 2′-methylguanosine (2′-MeG) monophosphate. This study investigated the safety, tolerability, antiviral activity, and pharmacokinetics of IDX184 as a single agent in treatment-naïve patients with genotype-1 chronic hepatitis C virus (HCV) infection. Forty-one patients with baseline HCV RNA ≥ 5 log 10 IU/ml, alanine aminotransferase (ALT) ≤ 2.5× the upper limit of normal, and compensated liver disease were dosed. Sequential cohorts of 10 patients, randomized 8:2 (active:placebo), received 25, 50, 75, and 100 mg of IDX184 once daily for 3 days, with a 14-day follow-up. There were no safety-related treatment discontinuations or serious adverse events. The adverse events and laboratory abnormalities observed for IDX184- and placebo-treated patients were similar. At the end of the 3-day treatment period, changes from baseline in HCV RNA levels (means ± standard deviations) were −0.5 ± 0.6, −0.7 ± 0.2, −0.6 ± 0.3, and −0.7 ± 0.5 log 10 for the 25-, 50-, 75-, and 100-mg doses, respectively, while viral load remained unchanged for the pooled placebo patients (−0.05 ± 0.3 log 10 ). Patients with genotype-1a and patients with genotype-1b responded similarly. Serum ALT levels decreased, especially at daily doses ≥ 75 mg. During the posttreatment period, plasma viremia and serum aminotransferase levels returned to near pretreatment levels. No resistance mutations associated with IDX184 were detected. Plasma exposure of IDX184 and its nucleoside metabolite 2′-MeG was dose related and low. Changes in plasma viral load correlated with plasma exposure of 2′-MeG. In conclusion, the results from this proof-of-concept study show that small doses of the liver-targeted prodrug IDX184 were able to deliver significant antiviral activity and support further clinical evaluation of the drug candidate.