Citations

Mayo Clinic

Clear

706 citation(s) found for "Wu, Kai".

Personalized Therapy Selection by Integration of Molecular Cancer Classification by the 92-Gene Assay and Tumor Profiling in Patients With Cancer of Unknown Primary
Kasi, Pashtoon Murtaza , Ma, Li , Hart, Lowell L., Wong, Jenna , Spigel, David R. , Schnabel, Catherine A. , Reeves, James A. , Hálfdánarson, Þorvarður R. , Treuner, Kai , Greco, Frank A. , Fuentes, Harry E , Kasi, Pashtoon Murtaza , Spigel, David R , Halfdanarson, Thorvardur R , Treuner, Kai , Greco, F Anthony , Fuentes, Harry E , Wong, Jenna

JCO Precision Oncology | September 4, 2024 | Volume: No volume available | Issue: 8 | Pages: No page available

10.1200/po.24.00191 | PMID 39231374 Get It

PURPOSE Cancer of unknown primary (CUP) is a syndrome comprising metastatic cancers without a clinically identified primary site. Although patients with CUP have an unfavorable prognosis, treatment with site-specific therapies guided by clinical features, standard pathology, and molecular assays can improve overall survival. The 92-gene assay (CancerTYPE ID) is a gene expression–based classifier that helps identify the tissue of origin for metastatic cancers with unknown or uncertain diagnoses. This study reports the frequency of selected molecular aberrations of oncogenes, including KRAS, IDH1/2, BRCA1/2, and BRAF, in patients with CUP in the MOSAIC database to highlight potential treatment options. METHODS MOSAIC is a database of patients with CUP submitted for CancerTYPE ID testing and NeoTYPE biomarker testing. Tumor biopsy samples were analyzed by CancerTYPE ID for tumor type identification and further tested for molecular aberrations of oncogenes, including KRAS, IDH1/2, BRCA1/2, and BRAF. RESULTS CancerTYPE ID identified a specific tumor type in 92.5% (2,929 of 3,168) of CUP cases in the MOSAIC database. The most commonly identified histological type was adenocarcinoma (75.4%), with pancreaticobiliary being the most common molecularly diagnosed cancer (24.9%). Aberrations in KRAS, IDH1/2, BRCA, and BRAF genes were identified in 18.8% (n = 597) of biopsies. A cancer-specific US Food and Drug Administration (FDA)–approved or investigational targeted therapy was potentially available for 24.6% (n = 147) of these patients. CONCLUSION This retrospective analysis supports incorporating CancerTYPE ID into the evaluation for patients with CUP to help determine the tissue of origin and identify actionable genetic alterations. This approach may allow more patients with CUP to benefit from site-specific FDA-approved targeted therapies or enrollment into clinical trials.
Predictors of patient satisfaction after surgery for grade 1 degenerative spondylolisthesis: a 5-year analysis of the Quality Outcomes Database
Dru, Alexander, Johnson, Sarah E. , Linzey, Joseph R. , Foley, Kevin T. , DiGiorgio, Anthony M. , Alan, Nima , Coric, Domagoj , Potts, Eric A. , Bisson, Erica F. , Knightly, John J. , Fu, Kai-Ming, Shaffrey, Mark E., Weaver, Jason, Bydon, Mohamad , Chou, Dean , Meyer, Scott A., Asher, Anthony L. , Shaffrey, Christopher I. , Slotkin, Jonathan R., Wang, Michael Y. , Haid, Regis W., Glassman, Steven D. , Virk, Michael S. , Mummaneni, Praveen V. , Park, Paul

Journal of Neurosurgery: Spine | August 31, 2024 | Volume: 41 | Issue: 5 | Pages: 658-665

10.3171/2024.5.spine24227 | PMID 39213671 Get It

OBJECTIVE Lumbar decompression and/or fusion surgery is a common operation for symptomatic lumbar spondylolisthesis refractory to conservative management. Multiyear follow-up of patient outcomes can be difficult to obtain but allows for identification of preoperative patient characteristics associated with durable pain relief, improved functional outcome, and higher patient satisfaction. METHODS A query of the Quality Outcomes Database (QOD) low-grade spondylolisthesis module for patients who underwent surgery for grade 1 lumbar spondylolisthesis (from July 2014 to June 2016 at the 12 highest-enrolling sites) was used to identify patient satisfaction, as measured with the North American Spine Society (NASS) questionnaire, which uses a scale of 1–4. Patients were considered satisfied if they had a score ≤ 2. Multivariable logistic regression was performed to identify baseline demographic and clinical predictors of long-term satisfaction 5 years after surgery. RESULTS Of 573 eligible patients from a cohort of 608, patient satisfaction data were available for 81.2%. Satisfaction (NASS score of 1 or 2) was reported by 389 patients (83.7%) at 5-year follow-up. Satisfied patients were predominantly White and ambulation independent and had lower baseline BMI, lower back pain levels, lower Oswestry Disability Index (ODI) scores, and greater EQ-5D index scores at baseline when compared to the unsatisfied group. No significant differences in reoperation rates between groups were reported at 5 years. On multivariate analysis, patients who were independently ambulating at baseline had greater odds of long-term satisfaction (OR 1.12, p = 0.04). Patients who had higher 5-year ODI scores (OR 0.99, p < 0.01) and were uninsured (OR 0.43, p = 0.01) were less likely to report long-term satisfaction. CONCLUSIONS Lumbar surgery for the treatment of grade 1 spondylolisthesis can provide lasting pain relief with high patient satisfaction. Baseline independent ambulation is associated with a higher long-term satisfaction rate after surgery. Higher ODI scores at 5-year follow-up and uninsured status are associated with lower postoperative long-term satisfaction.
Functional mapping of movement and speech using task-based electrophysiological changes in stereoelectroencephalography
Fine, Anthony L. , Kerezoudis, Panagiotis , Alden, Eva , Miller, Kai J. , Fine, Anthony , Jensen, Michael A. , Wong‐Kisiel, Lily C. , Hermes, Dora

Journal of Neurosurgery | August 30, 2024 | Volume: 142 | Issue: 2 | Pages: 311-323

10.3171/2024.5.jns24434 | PMID 39213665 Get It

OBJECTIVE Stereoelectroencephalography (SEEG) has become the predominant method for intracranial seizure localization. When imaging, semiology, and scalp EEG findings are not in full agreement or definitively localizing, implanted SEEG recordings are used to test candidate seizure onset zones (SOZs). Discovered SOZs may then be targeted for resection, laser ablation, or neurostimulation. If an SOZ is eloquent, resection and ablation are both contraindicated, so identifying functional representation is crucial for therapeutic decision-making. The authors present a novel functional brain mapping technique that utilizes task-based electrophysiological changes in SEEG during behavioral tasks and test this in pediatric and adult patients. METHODS SEEG was recorded in 20 patients with epilepsy who ranged in age from 6 to 39 years (12 female, 18 of 20 patients < 21 years of age) and underwent implanted monitoring to identify seizure onset. Each performed 1) visually cued simple repetitive movements of the hand, foot, or tongue while electromyography was recorded; and 2) simple picture-naming or verb-generation speech tasks while audio was recorded. Broadband changes in the power spectrum of the SEEG recording were compared between behavior and rest. RESULTS Electrophysiological functional mapping of movement and/or speech areas was completed in all 20 patients. Eloquent representation was identified in both cortex and white matter and generally corresponded to classically described functional anatomical organization as well as other clinical mapping results. Robust maps of brain activity were identified in healthy brain, regions of developmental or acquired structural abnormality, and SOZs. CONCLUSIONS Task-based electrophysiological mapping using broadband changes in the SEEG signal reliably identifies movement and speech representation in pediatric and adult epilepsy patients.
Cost-effectiveness of posterior lumbar interbody fusion and/or transforaminal lumbar interbody fusion for grade 1 lumbar spondylolisthesis: a 5-year Quality Outcomes Database study
Yee, Timothy J., Liles, Campbell, Johnson, Sarah E. , DiGiorgio, Anthony M. , Alan, Nima , Coric, Domagoj , Potts, Eric A. , Bisson, Erica F. , Knightly, John J. , Fu, Kai-Ming, Foley, Kevin T. , Shaffrey, Mark E., Bydon, Mohamad , Chou, Dean , Chan, Andrew K. , Meyer, Scott A., Shaffrey, Christopher I. , Slotkin, Jonathan R., Wang, Michael Y. , Haid, Regis W., Glassman, Steven D. , Virk, Michael S., Mummaneni, Praveen V., Ambati, Vardhaan , Asher, Anthony L., Virk, Michael S., Mummaneni, Praveen V. , Park, Paul

Journal of Neurosurgery: Spine | August 17, 2024 | Volume: 41 | Issue: 5 | Pages: 596-603

10.3171/2024.5.spine24112 | PMID 39151203 Get It

OBJECTIVE Posterior lumbar interbody fusion (PLIF) and/or transforaminal lumbar interbody fusion (TLIF), referred to as "PLIF/TLIF," is a commonly performed operation for lumbar spondylolisthesis. Its long-term cost-effectiveness has not been well described. The aim of this study was to determine the 5-year cost-effectiveness of PLIF/TLIF for grade 1 degenerative lumbar spondylolisthesis using prospective data collected from the multicenter Quality Outcomes Database (QOD). METHODS Patients enrolled in the prospective, multicenter QOD grade 1 lumbar spondylolisthesis module were included if they underwent single-stage PLIF/TLIF. EQ-5D scores at baseline, 3 months, 12 months, 24 months, 36 months, and 60 months were used to calculate gains in quality-adjusted life years (QALYs) associated with surgery relative to preoperative baseline. Healthcare-related costs associated with the index surgery and related reoperations were calculated using Medicare reimbursement–based cost estimates and validated using price transparency diagnosis-related group (DRG) charges and Medicare charge-to-cost ratios (CCRs). Cost per QALY gained over 60 months postoperatively was assessed. RESULTS Across 12 surgical centers, 385 patients were identified. The mean patient age was 60.2 (95% CI 59.1–61.3) years, and 38% of patients were male. The reoperation rate was 5.7%. DRG 460 cost estimates were stable between our Medicare reimbursement–based models and the CCR-based model, validating the focus on Medicare reimbursement. Across the entire cohort, the mean QALY gain at 60 months postoperatively was 1.07 (95% CI 0.97–1.18), and the mean cost of PLIF/TLIF was $31,634. PLIF/TLIF was associated with a mean 60-month cost per QALY gained of $29,511. Among patients who did not undergo reoperation (n = 363), the mean 60-month QALY gain was 1.10 (95% CI 0.99–1.20), and cost per QALY gained was $27,591. Among those who underwent reoperation (n = 22), the mean 60-month QALY gain was 0.68 (95% CI 0.21–1.15), and the cost per QALY gained was $80,580. CONCLUSIONS PLIF/TLIF for degenerative grade 1 lumbar spondylolisthesis was associated with a mean 60-month cost per QALY gained of $29,511 with Medicare fees. This is far below the well-established societal willingness-to-pay threshold of $100,000, suggesting long-term cost-effectiveness. PLIF/TLIF remains cost-effective for patients who undergo reoperation.
Predictors of patient satisfaction in the surgical treatment of cervical spondylotic myelopathy
Schüpper, Alexander J. , DiDomenico, Joseph D., Johnson, Sarah E. , Bisson, Erica F. , Bydon, Mohamad , Asher, Anthony L. , Coric, Domagoj , Potts, Eric A. , Foley, Kevin T. , Wang, Michael Y. , Fu, Kai-Ming, Virk, Michael S. , Shaffrey, Christopher I., Gottfried, Oren N., Park, Christine , Knightly, John J. , Meyer, Scott A., Upadhyaya, Cheerag D., Shaffrey, Mark E., Chan, Andrew K. , Tumialán, Luis M. , Chou, Dean , Haid, Regis W., Mummaneni, Praveen V., Uribe, Juan S. , Turner, Jay D. , Farber, Samuel Harrison , Fu, Kai-Ming, Shaffrey, Christopher I. , Park, Paul , Mummaneni, Praveen V. , Uribe, Juan S.

Journal of Neurosurgery: Spine | August 17, 2024 | Volume: 41 | Issue: 5 | Pages: 611-618

10.3171/2024.5.spine24326 | PMID 39151188 Get It

OBJECTIVE Patients with cervical spondylotic myelopathy (CSM) experience progressive neurological impairment. Surgical intervention is often pursued to halt neurological symptom progression and allow for recovery of function. In this paper, the authors explore predictors of patient satisfaction following surgical intervention for CSM. METHODS This is a retrospective review of prospectively collected data from the multicenter Quality Outcomes Database. Patients who underwent surgical intervention for CSM with a minimum follow-up of 2 years were included. Patient-reported satisfaction was defined as a North American Spine Society (NASS) satisfaction score of 1 or 2. Patient demographics, surgical parameters, and outcomes were assessed as related to patient satisfaction. Patient quality of life scores were measured at baseline and 24-month time points. Univariate regression analyses were performed using the chi-square test or Student t-test to assess patient satisfaction measures. Multivariate logistic regression analysis was conducted to assess for factors predictive of postoperative satisfaction at 24 months. RESULTS A total of 1140 patients at 14 institutions with CSM who underwent surgical intervention were included, and 944 completed a patient satisfaction survey at 24 months postoperatively. The baseline modified Japanese Orthopaedic Association (mJOA) score was 12.0 ± 2.8. A total of 793 (84.0%) patients reported satisfaction (NASS score 1 or 2) after 2 years. Male and female patients reported similar satisfaction rates (female sex: 47.0% not satisfied vs 48.5% satisfied, p = 0.73). Black race was associated with less satisfaction (26.5% not satisfied vs 13.2% satisfied, p < 0.01). Baseline psychiatric comorbidities, obesity, and length of stay did not correlate with 24-month satisfaction. Crossing the cervicothoracic junction did not affect satisfactory scores (p = 0.19), and minimally invasive approaches were not associated with increased patient satisfaction (p = 0.14). Lower baseline numeric rating scale neck pain scores (5.03 vs 5.61, p = 0.04) and higher baseline mJOA scores (12.28 vs 11.66, p = 0.01) were associated with higher satisfaction rates. CONCLUSIONS Surgical treatment of CSM results in a high rate of patient satisfaction (84.0%) at the 2-year follow-up. Patients with milder myelopathy report higher satisfaction rates, suggesting that intervention earlier in the disease process may result in greater long-term satisfaction.
Breast Cancer Index in Premenopausal Women With Early-Stage Hormone Receptor–Positive Breast Cancer
O’Regan, Ruth, Francis, Prudence A. , Kammler, Roswitha , Viale, Giuseppe, Dell’Orto, Patrizia , Láng, István, Bellet, Meritxell , Bonnefoi, Hervé , Villa, Federica , Bernardo, Antônio , Neven, Patrick , Müller, Bettina , Zaman, Khalil , Martino, Silvana, Jerzak, Katarzyna J. , Davidson, Nancy E. , Mackelenbergh, Marion van , Schnabel, Catherine A. , Treuner, Kai , Regan, Meredith M. , Ingle, James N. , Bonnefoi, Hervé R , Francis, Prudence A , Zhang, Yi , Fleming, Gini F. , Viale, G., Tondini, Carlo Alberto , Ciruelos, Eva , Karlsson, Per , Jochum, Wolfram , Geyer, Charles E. , Coleman, Robert E. , Loi, Sherene , Colleoni, Marco

JAMA Oncology | August 15, 2024 | Volume: 10 | Issue: 10 | Pages: 1379

10.1001/jamaoncol.2024.3044 | PMID 39145953 Get It

ImportanceAdjuvant ovarian function suppression (OFS) with oral endocrine therapy improves outcomes for premenopausal patients with hormone receptor–positive (HR+) breast cancer but adds adverse effects. A genomic biomarker for selecting patients most likely to benefit from OFS-based treatment is lacking.ObjectiveTo assess the predictive and prognostic performance of the Breast Cancer Index (BCI) for OFS benefit in premenopausal women with HR+ breast cancer.Design, Setting, and ParticipantsThis prospective-retrospective translational study used all available tumor tissue samples from female patients from the Suppression of Ovarian Function Trial (SOFT). These individuals were randomized to receive 5 years of adjuvant tamoxifen alone, tamoxifen plus OFS, or exemestane plus OFS. BCI testing was performed blinded to clinical data and outcome. The a priori hypothesis was that BCI HOXB13/IL17BR ratio (BCI[H/I])–high tumors would benefit more from OFS and high BCI portended poorer prognosis in this population. Settings spanned multiple centers internationally. Participants included premenopausal female patients with HR+ early breast cancer with specimens in the International Breast Cancer Study Group tumor repository available for RNA extraction. Data were collected from December 2003 to April 2021 and were analyzed from May 2022 to October 2022.Main Outcomes and MeasuresPrimary end points were breast cancer–free interval (BCFI) for the predictive analysis and distant recurrence-free interval (DRFI) for the prognostic analyses.ResultsTumor specimens were available for 1718 of the 3047 female patients in the SOFT intention-to-treat population. The 1687 patients (98.2%) who had specimens that yielded sufficient RNA for BCI testing represented the parent trial population. The median (IQR) follow-up time was 12 (10.5-13.4) years, and 512 patients (30.3%) were younger than 40 years. Tumors were BCI(H/I)-low for 972 patients (57.6%) and BCI(H/I)-high for 715 patients (42.4%). Patients with tumors classified as BCI(H/I)-low exhibited a 12-year absolute benefit in BCFI of 11.6% from exemestane plus OFS (hazard ratio [HR], 0.48 [95% CI, 0.33-0.71]) and an absolute benefit of 7.3% from tamoxifen plus OFS (HR, 0.69 [95% CI, 0.48-0.97]) relative to tamoxifen alone. In contrast, patients with BCI(H/I)-high tumors did not benefit from either exemestane plus OFS (absolute benefit, −0.4%; HR, 1.03 [95% CI, 0.70-1.53]; P for interaction = .006) or tamoxifen plus OFS (absolute benefit, −1.2%; HR, 1.05 [95% CI, 0.72-1.54]; P for interaction = .11) compared with tamoxifen alone. BCI continuous index was significantly prognostic in the N0 subgroup for DRFI (n = 1110; P = .004), with 12-year DRFI of 95.9%, 90.8%, and 86.3% in BCI low-risk, intermediate-risk, and high-risk N0 cancers, respectively.Conclusions and RelevanceIn this prospective-retrospective translational study of patients enrolled in SOFT, BCI was confirmed as prognostic in premenopausal women with HR+ breast cancer. The benefit from OFS-containing adjuvant endocrine therapy was greater for patients with BCI(H/I)-low tumors than BCI(H/I)-high tumors. BCI(H/I)-low status may identify premenopausal patients who are likely to benefit from this more intensive endocrine therapy.
Predictors of Delayed Clinical Benefit Following Surgical Treatment for Low-grade Spondylolisthesis
Djurasovic, Mladen, Bisson, Erica F. , Chan, Andrew K. , Bydon, Mohamad , Mummaneni, Praveen V., Foley, Kevin T. , Shaffrey, Christopher I. , Potts, Eric A. , Shaffrey, Mark E., Coric, Domagoj , Knightly, John J. , Wang, Michael Y. , Fu, Kai-Ming, Slotkin, Jonathan R., Virk, Michael S., Chou, Dean , Haid, Regis W., Glassman, Steven D. , Carreon, Leah Y. , Mummaneni, Praveen V. , Park, Paul , Fu, Kai-Ming, Asher, Anthony L., Virk, Michael S.

Spine | August 1, 2024 | Volume: 50 | Issue: 11 | Pages: E213-E218

10.1097/brs.0000000000005115 | PMID 39087454 Get It

Study Design. Retrospective review of prospectively collected data. Objective. The aim of this study was to investigate what factors predict delayed improvement after surgical treatment of low-grade spondylolisthesis. Summary of Background Data. Lumbar surgery leads to clinical improvement in the majority of patients with low-grade spondylolisthesis. Most patients improve rapidly after surgery, but some patients demonstrate a delayed clinical course. Methods. The Quality and Outcomes Database (QOD) was queried for grade 1 spondylolisthesis patients who underwent surgery who had patient-reported outcome measures (PROMs) collected at baseline, 3, 6, and 12 months, including back and leg pain Numeric Rating Scale (NRS), Oswestry Disability Index (ODI), and EuroQol-5D (EQ-5D). Patients were stratified as “early responders” reaching MCID at 3 months and maintaining improvement through 12 months and “delayed responders” not reaching MCID at 3 months but ultimately reaching MCID at 12 months. These two groups were compared with respect to factors which predicted delayed improvement. Results. Of 608 patients enrolled, 436 (72%) met inclusion criteria for this study. Overall, 317 patients (72.7%) reached MCID for ODI at 12 months following surgery. Of these patients, 249 (78.5%) exhibited a rapid clinical improvement trajectory and had achieved ODI MCID threshold by the 3-month postoperative follow-up. Sixty-eight patients (21.4%) showed a delayed trajectory, and had not achieved ODI MCID threshold at 3 months, but did ultimately reach MCID at 12-month follow-up. Factors associated with delayed improvement included impaired preoperative ambulatory status, better baseline back and leg pain scores, and worse 3-month leg pain scores ( P <0.01). Conclusions. The majority of patients undergoing surgery for low-grade spondylolisthesis reach ODI MCID threshold rapidly, within the first 3 months after surgery. Factors associated with a delayed clinical course include impaired preoperative ambulation status, relatively better preoperative back and leg pain, and persistent leg pain at 3 months.
Primary cilia mediate skeletogenic BMP and Hedgehog signaling in heterotopic ossification
He, Kai , Jiang, Heng , Li, Weijun , Toutounchi, Saman , Ma, Xiaoyu , Baehr, Wolfgang , Pignolo, Robert J. , Ling, Kun , Wang, Haitao , Hu, Jinghua , Ma, Xiaoyu , Zhou, Xuhui , Wang, Haitao , Hu, Jinghua , He, Kai , Huang, Yan , Wu, Jianfeng

Science Translational Medicine | July 24, 2024 | Volume: 16 | Issue: 757 | Pages: No page available

10.1126/scitranslmed.abn3486 | PMID 39047114 Get It

Heterotopic ossification (HO), defined as the formation of extraskeletal bone in muscle and soft tissues, is a diverse pathological process caused by either genetic mutations or inciting trauma. Fibrodysplasia ossificans progressiva (FOP) is a genetic form of HO caused by mutations in the bone morphogenetic protein (BMP) type I receptor gene activin A receptor type 1 ( ACVR1 ). These mutations make ACVR1 hypersensitive to BMP and responsive to activin A. Hedgehog (Hh) signaling also contributes to HO development. However, the exact pathophysiology of how skeletogenic cells contribute to endochondral ossification in FOP remains unknown. Here, we showed that the wild-type or FOP-mutant ACVR1 localized in the cilia of stem cells from human exfoliated deciduous teeth with key FOP signaling components, including activin A receptor type 2A/2B, SMAD family member 1/5, and FK506-binding protein 12kD. Cilia suppression by deletion of intraflagellar transport 88 or ADP ribosylation factor like GTPase 3 effectively inhibited pathological BMP and Hh signaling, subdued aberrant chondro-osteogenic differentiation in primary mouse or human FOP cells, and diminished in vivo extraskeletal ossification in Acvr1 Q207D , Sox2-Cre ; Acvr1 R206H/+ FOP mice and in burn tenotomy–treated wild-type mice. Our results provide a rationale for early and localized suppression of cilia in affected tissues after injury as a therapeutic strategy against either genetic or acquired HO.
Micromagnetic Neural Stimulation and Spintronic Neural Sensing
Tonini, Denis , Hopper, Matthew S. , Goyal, Abhinav , Sanger, Zachary , Faramarzi, Sadegh , Shiao, Maple, Helden, Dusty Van , Wu, Kai , Keirstead, Susan A. , Netoff, Théoden I. , Low, Walter C. , Osborn, John, Bennet, Kevin E. , Lee, Kendall H. , Shin, Hojin , Wang, Jian-Ping , Saha, Renata , Yuen, Jason , Oh, Yoonbae , Bloom, Robert P. , Benally, Onri Jay

2024 IEEE International Magnetic Conference - Short papers (INTERMAG Short papers) | July 5, 2024 | Volume: No volume available | Issue: No issue available | Pages: 1-2

10.1109/intermagshortpapers61879.2024.10576875 Get It

STAGER checklist: Standardized testing and assessment guidelines for evaluating generative artificial intelligence reliability
Chen, Jinghong , Zhu, Lingxuan , Zeng, Dongqiang , Qi, Chang , Tang, Bufu , Shi, Wenjie , Guo, Shipeng, Sun, Xu , Ngo, Trunghieu, Pu, Zhongji , He, Yongbin, Wu, Haiyang , Cheungpasitporn, Wisit, Huang, Haojie , Wang, Shixiang , Cabannes, Loïc, Ren, Gerald Sng Gui , Ali, Stephen R , Cheng, Quan, Miao, Kai , Mou, Weiming , Lin, Anqi , Zeng, Dongqiang, Liu, Zaoqu , Jiang, Aimin , Shi, Wenjie, Kahlert, Ulf D. , Zhou, Jian‐Guo , Lu, Xiaofan , Jia, Baolei , Jeon, Che Ok , Gu, Shuqin , Cheungpasitporn, Wisit , Mao, Weipu , Chen, Xin , Cabannes, Loïc, Whitaker, Iain Stuart , Cheng, Quan, Yuan, Shuofeng , Luo, Peng

iMetaOmics | July 2, 2024 | Volume: 1 | Issue: 1 | Pages: No page available

10.1002/imo2.7 | PMID 41675544 Get It

Abstract Generative artificial intelligence (AI) holds immense potential for medical applications, but the lack of a comprehensive evaluation framework and methodological deficiencies in existing studies hinder its effective implementation. Standardized assessment guidelines are crucial for ensuring reliable and consistent evaluation of generative AI in healthcare. Our objective is to develop robust, standardized guidelines tailored for evaluating generative AI performance in medical contexts. Through a rigorous literature review utilizing the Web of Sciences, Cochrane Library, PubMed, and Google Scholar, we focused on research testing generative AI capabilities in medicine. Our multidisciplinary team of experts conducted discussion sessions to develop a comprehensive 32‐item checklist. This checklist encompasses critical evaluation aspects of generative AI in medical applications, addressing key dimensions such as question collection, querying methodologies, and assessment techniques. The checklist and its broader assessment framework provide a holistic evaluation of AI systems, delineating a clear pathway from question gathering to result assessment. It guides researchers through potential challenges and pitfalls, enhancing research quality and reporting and aiding the evolution of generative AI in medicine and life sciences. Our framework furnishes a standardized, systematic approach for testing generative AI's applicability in medicine. For a concise checklist, please refer to Table S or visit GenAIMed.org .