Abstract Background Diagnosis and risk stratification in rare hematologic malignancies such as myeloproliferative neoplasms (MPNs) – polycythemia vera (PV), essential thrombocythemia (ET), and myelofibrosis (MF) – require expert review of longitudinal, heterogeneous clinical records. This process is cognitively demanding, inconsistently applied, and difficult to scale beyond tertiary centers. No automated phenotyping workflow currently exists for hematologic malignancies. Methods A HIPAA-compliant large language model (LLM) framework for phenotyping MPN was developed to integrate (i) rule-based retrieval of bone marrow biopsy reports, clinical notes, and structured laboratory results from the electronic health record (EHR); (ii) zero-shot extraction of diagnostic and prognostic variables from unstructured text using GPT-4 Turbo; (iii) a clinician-informed source-prioritization algorithm to reconcile conflicting multi-source data; (iv) WHO/ICC-criteria–based diagnostic classification; and (v) NCCN-based risk stratification using the conventional risk model for PV, IPSET-thrombosis for ET, and DIPSS, DIPSS-plus, and MIPSS70/MIPSS70+ v2 for MF. Patients were identified via MPN-related ICD-9/10 codes; cases met 2017 WHO criteria or had a hematologist-documented diagnosis, and controls did not. The cohort was split into a prompt-development set (n = 60) and a held-out test set (n = 450; 75 cases and 75 controls per disease). Ground truth was established by independent dual-clinician chart review with consensus adjudication. LLM performance was evaluated against the ground truth: variable-level extraction using accuracy, F1 score, and Cohen’s kappa; patient-level diagnostic classification using sensitivity, specificity, and Cohen’s kappa; and prognostic risk stratification (among confirmed cases) using accuracy, weighted F1 score, and quadratic-weighted Cohen’s kappa. Wilson 95% confidence intervals (CIs) were used for proportions and bootstrap 95% CIs with 500 resamples for F1 scores. Results The held-out test set included 450 patients (PV: 150; ET: 150; MF: 150) with pathology reports and structured laboratory results, and 172 patients (PV: 52; ET: 55; MF: 65) with clinical notes. From pathology reports, overall variable extraction accuracy and F1 score were 99% (95% CI, 98–100) and 1.00 (0.99–1.00) for PV, 100% (99–100) and 0.99 (0.96–1.00) for ET, and 100% (99–100) and 0.99 (0.97–1.00) for MF. From clinical notes, overall accuracy and F1 score were 96% (91–100) and 0.94 (0.85–1.00) for PV, 100% (100–100) and 1.00 (1.00–1.00) for ET, and 100% (99–100) and 0.98 (0.95–1.00) for MF. Diagnostic sensitivity was 100% (95% CI, 95.1–100.0) for PV, ET, and MF; specificity was 98.7% (92.8–99.8) for PV and 100% (95.1–100.0) for both ET and MF, with Cohen’s kappa of 0.99 for PV and 1.00 for ET and MF. Risk stratification accuracy was 100% with weighted F1 score of 1.00 and quadratic-weighted Cohen’s kappa of 1.00 across all three diseases. A pre-specified source-ablation analysis showed that pathology reports alone were sufficient for diagnosis (sensitivity 98.7% for PV, 100% for ET, 96.0% for MF; specificity 100% across all three subtypes) but inadequate for prognostication (accuracy 69.3% for PV, 93.3% for ET, 77.3% for MF). Adding clinical notes to pathology reports recovered full prognostic accuracy of 100% across all three diseases. Conclusions This first-in-class automated framework achieved expert-level performance for MPN diagnosis and risk stratification from real-world EHR data, establishing a foundation for scalable, standardized phenotyping in rare hematologic malignancies. Prospective, multi-site validation is warranted before clinical deployment.
Bone fractures with androgen pathway inhibitors (ARPi) in patients (pts) with prostate cancer (PCa): A systematic review and network meta-analysis.
Journal of Clinical Oncology | March 2, 2026 | Volume: 44 | Issue: 7_suppl | Pages: 144-144
144 Background: Androgen receptor pathway inhibitors (abiraterone acetate [AAP], apalutamide [APA], enzalutamide [E], darolutamide [DARO] have become the cornerstone for pts with PCa due to survival benefits. Comparative data on fracture risk among ARPi are limited. This study quantified the risk of bone fractures with ARPi plus androgen deprivation therapy (ADT) and compared fracture risk across different ARPi agents. Methods: MEDLINE and EMBASE were searched from inception through September 1 st 2025 to identify positive phase III trials assessing ARPi in addition to ADT in pts with PCa (m0CRPC, mCSPC, mCRPC). Trials were included if they reported bone fractures in either arm. Pairwise, random-effects meta-analysis was conducted using Paul-Mendel approach. Sensitivity analyses using Hartung-Knapp (HK) adjustment was performed to assess robustness of results. To assess the comparative risk of bone fractures among different ARPi agents, mixed treatment comparisons were made using frequentist network meta-analysis. P-scores were computed to assess relative treatment rankings. Treatment effect was expressed as odds ratio (OR) with 95% confidence intervals (CI). Results: This systematic review included 13 phase III trials with 15468 pts (8890 received ARPi+ADT, 6578 received ADT alone). A total of 596 (6.7%) bone fractures were observed with ARPi+ADT compared to 180 (2.74%) with ADT alone. Patients receiving ARPi+ADT were associated with an increased risk of bone fractures compared to those receiving ADT (OR: 2.40; 95% CI: 1.93-2.98). Sensitivity analyses with HK adjustment showed consistent results (2.40; 1.88-3.06). There was no statistically significant effect modification by PCa clinical setting (p: 0.27). Mixed treatment comparisons showed a statistically significant increased risk of bone fractures with AAP+ADT (2.35; 1.29-4.27), APA+ADT (2.04; 1.47-2.86), and E+ADT (3.13; 2.44-4.00) but not with DARO+ADT (1.30; 0.80-2.08) when compared to ADT alone. Among different ARPi agents, E+ADT was associated with an increased risk compared to APA+ADT (1.54; 1.01-2.33) and DARO+ADT (2.44; 1.41-4.17). Ranking analysis showed that E+ADT was ranked as potentially the least safe treatment (P score: 0.05) in terms of relative fracture risk followed by AAP+ADT (P score: 0.30), APA+ADT (P score: 0.43), DARO+ADT (P score: 0.76). Sensitivity analyses limiting to mCSPC trials only showed consistent results. Conclusions: The risk of bone fractures varies among different ARPi agents, with enzalutamide posing the highest relative risk and darolutamide the lowest. These differences may guide treatment selection, particularly in pts with mCSPC and bone metastases. Prospective studies adjusting for covariates are needed to evaluate bone-protective strategies to mitigate fracture risk particularly in mCSPC patients who are considering treatment with ARPi.
Efficacy of perioperative and neoadjuvant therapies including immunotherapy in resectable gastroesophageal adenocarcinoma (GEA): A network meta-analysis (NMA).
Journal of Clinical Oncology | January 12, 2026 | Volume: 44 | Issue: 2_suppl | Pages: 399-399
399 Background: The standard of care for resectable GEA adenocarcinomas is perioperative chemotherapy with the FLOT (fluorouracil, leucovorin, oxaliplatin, docetaxel) regimen. Recent studies investigating the addition of checkpoint inhibitors (CPIs) to perioperative chemotherapy have shown mixed results. An NMA can leverage both direct and indirect comparisons to evaluate the relative efficacies of available regimens in this setting. Methods: MEDLINE, EMBASE, Scopus, Web of Science and CENTRAL were searched until August 27th, 2025. Eligible studies included phase 3 randomized trials evaluating perioperative or neoadjuvant chemotherapy +/- CPIs ± radiation in resectable GEA. The primary outcomes were disease-free survival (DFS) and overall survival (OS). Hazard ratios and 95% confidence intervals (CIs) were estimated using a frequentist NMA framework. Results: Fifteen trials including 8072 patients were analyzed. For DFS, perioperative durvalumab + FLOT (dFLOT) ranked highest (P-score = 0.99), followed by FLOT (P-score = 0.84) (HR for dFLOT vs. FLOT was 0.71, 95% CI 0.58-0.86). dFLOT also ranked higher than perioperative pembrolizumab + cisplatin and fluorouracil/capecitabine (KN-585), though this comparison was not statistically significant (HR 0.65, 95% CI 0.40-1.04). Compared with CROSS, dFLOT showed superior DFS (HR of 0.48, 95% CI 0.36-0.63). For OS, dFLOT ranked the highest (P-score=0.95) and was superior to CROSS (HR 0.57, 95% CI 0.42-0.77). While dFLOT appeared favorable versus FLOT (HR 0.78, 95% CI 0.62-0.98), this finding was primarily driven by MATTERHORN, which did not meet its prespecified OS significance boundary (P = 0.03 vs threshold P < 0.0001), and the proportional hazards assumption was violated. Similarly, no significant OS difference was observed between dFLOT and the KN-585 arms (HR 0.75, 95% CI 0.45-1.23). Conclusions: In this NMA, perioperative FLOT remained the benchmark regimen for resectable GEA. dFLOT has shown promising early results, ranking the highest for DFS and showing favorable, but not statistically definitive OS trends in comparison to FLOT. Importantly, the network enabled indirect comparisons not tested in head-to-head trials, demonstrating that dFLOT ranked above pembrolizumab+CF/CX (KN-585) without reaching statistical significance, and also outperformed CROSS. However, these findings should be interpreted with caution, as they are primarily driven MATTERHORN data in which OS did not cross the prespecified threshold and proportional hazards assumptions were violated. Perioperative immunotherapy combinations appear promising, but final MATTERHORN results and further confirmatory studies are needed before dFLOT can be considered as a new standard of care.
Disparities in guideline-concordant treatment receipt for localized prostate cancer (PCa): A SEER-based analysis.
Journal of Clinical Oncology | May 28, 2025 | Volume: 43 | Issue: 16_suppl | Pages: No page available
e17155 Background: Localized PCa is classified into six NCCN risk categories, each with specific treatment recommendations. However, treatment concordance across these categories and its variation by race in clinical practice remain unexplored. Therefore, we aim to describe patterns of guideline-concordant treatment receipt for localized PCa across risk groups and race. Methods: Surveillance, Epidemiology, and End Results (SEER) database (2018–2020) was queried to identify patients with localized PCa from 17 registries. Data regarding clinical T stage, Gleason patterns, PSA level, biopsy cores and initial treatment received (radiation, radical prostatectomy, systemic therapy) was obtained. Each patient was then stratified into one of six NCCN-based risk categories using a rule-based algorithm. Using the stratified risk category of each patient, treatment recommendations were obtained from the NCCN guidelines. Concordance was assessed by comparing the received treatment and guideline-recommended treatment. A focused bi-variate logistic regression analysis was performed adjusting for risk groups, and race. Odds ratio (OR) with 95% confidence intervals (CI) were computed to quantify the magnitude of guideline-discordant treatment receipt. Results: This analysis included 69,584 patients with localized PCa (White: 53,875 [77.4%]; Black: 11,265 [16.2%]; Asian/Pacific Islander: 4,133 [5.9%]; American Indian/Alaska Native: 311 0.5%]). In terms of risk groups, patients in higher risk categories had increased odds of discordance compared to the lower risk groups (Table). In terms of race, Black men had significantly higher odds of receiving guideline-discordant therapy (OR:1.67, 95% CI:1.58–1.76), while no statistically significant difference was observed with American Indian/Alaska Native men (OR:1.21, 95% CI: 0.92–1.61) and Asian/Pacific Islander men (OR:1.05, 95% CI:0.97–1.14) compared to White men. Conclusions: Population level data, based on limited sample size in some groups, suggests that treatment concordance with NCCN guidelines varies by risk group and race in localized PCa. Black patients, and those with higher risk groups were more likely to receive guideline-discordant therapy. These findings highlight the need for strategies and prospective studies at individual patient level to evaluate and enhance guideline adherence to promote personalized care for these patients. Variable Discordant Treatment (%) OR (95% CI) White 22168 (41.1) REF Black 5653 (47.5) 1.67 (1.58-1.76) * Asian/Pacific Islander 1822 (44.1) 1.05 (0.97-1.14) American Indian/Alaska Native 191 (61.4) 1.22 (0.92- 1.61) Very Low Risk 770 (9) REF Low Risk 146 (2) 0.16 (0.13-0.19) * Favorable Risk 35 (0.4) 0.03 (0.02-0.04) * Unfavorable Risk 15125 (83.2) 36.30 (33.72-39.25) * High/Very High Risk 13441 (50) 7.32 (6.83-7.86) * * p <0.05.
Efficacy of perioperative and neoadjuvant therapies in gastric and gastroesophageal (GEJ) adenocarcinoma (AC): A network meta-analysis.
Journal of Clinical Oncology | May 28, 2025 | Volume: 43 | Issue: 16_suppl | Pages: No page available
e16157 Background: The optimal treatment for resectable gastric/GEJ AC is unclear due to limited direct comparisons among chemotherapy and chemoradiation regimens. Addressing this gap is critical to improve patient outcomes. We performed this network meta-analysis (NMA) to determine the relative efficacy of multimodality regimens for resectable gastric/GEJ AC. Methods: MEDLINE, EMBASE, Scopus, and CENTRAL were searched from inception till September 20, 2024, to identify phase III trials evaluating perioperative/neoadjuvant systemic therapy ± radiation in resectable gastric/GEJ AC. Primary outcomes were disease-free survival (DFS) and overall survival (OS). A frequentist NMA was conducted to compare hazard ratios (HR) and 95% CI for each outcome. Relative treatment rankings were assessed using P-scores. Results: Fifteen trials (8,072 patients) were analyzed. pFLOT (perioperative fluorouracil, leucovorin, oxaliplatin, and docetaxel) ranked highest for DFS in the overall population (P score 91%) (Table), significantly outperforming surgery alone (HR 0.48, 95% CI 0.38-0.60) and nCROSS (neoadjuvant paclitaxel, carboplatin and radiotherapy) (0.67, 0.56-0.81). For OS, nPLF+nCRT(EP) (neoadjuvant cisplatin, leucovorin and fluorouracil for induction, followed by etoposide, cisplatin, and radiotherapy) (P score 90%) and pFLOT (P score 87%) were the top regimens, with pFLOT significantly outperforming surgery alone (0.57, 0.45-0.72), and nCROSS (0.73, 0.60-0.89). Adding neoadjuvant chemoradiation to pFLOT provided no additional OS (1.14, 0.76-1.72) or DFS (1.22, 0.83-1.82) benefit. Similarly, adding pembrolizumab to perioperative chemotherapy (CF/CX) (cisplatin and fluorouracil/capecitabine) was not superior to pFLOT in terms of DFS (1.10, 0.71-1.69) or OS (1.09, 0.69-1.72). Conclusions: pFLOT demonstrated superior efficacy in resectable gastric/GEJ AC, surpassing surgery alone, nCROSS, and other perioperative regimens. The additive role of immunotherapy to pFLOT requires further investigation to refine patient selection and optimize outcomes. Regimen Overall Population GEJ cohort OS DFS OS DFS nPLF+nCRT(EP) 1 (90) 2 (84) 1 (85) NA pFLOT 2 (87) 1 (91) 2 (79) 2 (88) pPembrolizumab+CF/CX 3 (75) 3 (81) 5 (41) - nECX 4 (61) 5 (55) - - pCF 5 (59) 8 (51) 3 (72) - pECF/ECX 6 (47) 6 (55) 7 (40) 3 (57) nECX+aCRT(CX) 7 (45) 7 (52) 9 (31) - nCF 8 (42) 10 (28) 6 (40) - nCROSS 9 (41) 9 (35) 8 (34) 4 (43) pECF/ECX/FLOT+nCRT(F/X) 10 (38) 4 (57) 4 (72) 1 (90) nCRT(CF) 11 (9) 11 (6) - 5 (14) Surgery 12 (7) 12 (5) 10 (5) 6 (9) Data reported as rank (P-score). Abbreviations: n: neoadjuvant; p: perioperative; ECX: epirubicin + cisplatin + capecitabine; CF: cisplatin + fluorouracil; ECF: epirubicin + cisplatin + fluorouracil; aCRT(CX): adjuvant radiotherapy + cisplatin + capecitabine; CRT(F/X): fluorouracil/capecitabine + radiotherapy; CRT(CF): cisplatin + fluorouracil + radiotherapy.
Efficacy of perioperative and neoadjuvant therapies in gastric and gastroesophageal junction adenocarcinoma: a network meta-analysis
The Oncologist | May 23, 2025 | Volume: 30 | Issue: 8 | Pages: No page available
Abstract Background Optimal treatment for resectable gastric and gastroesophageal junction (GEJ) adenocarcinoma remains unclear due to limited head-to-head comparisons among chemotherapy and chemoradiation regimens. This network meta-analysis aimed to determine the relative efficacy of available multimodality treatment regimens in these patients. Methods MEDLINE, EMBASE, Scopus, Web of Science, and CENTRAL were searched till September 20, 2024. Phase 3 randomized trials evaluating perioperative/neoadjuvant systemic therapy ± radiation in resectable gastric/GEJ adenocarcinoma were included. Primary outcomes were disease-free survival (DFS) and overall survival (OS). Frequentist network meta-analysis was conducted to compare hazard ratios (HRs) and 95% confidence intervals (CIs). Results Fifteen trials (8072 patients) were analyzed. pFLOT (perioperative fluorouracil, leucovorin, oxaliplatin, and docetaxel) ranked highest for DFS in the overall population (P-score 91%), achieving significant improvements compared to surgery alone (HR 0.48, 95% CI, 0.38-0.60) and nCROSS (neoadjuvant paclitaxel, carboplatin, and radiotherapy) (0.67, 0.56-0.81). For OS, nPLF + nCRT(EP) (neoadjuvant cisplatin, leucovorin, and fluorouracil for induction, followed by etoposide, cisplatin, and radiotherapy) (P-score 90%) and pFLOT (P-score 87%) were the top regimens. pFLOT significantly outperformed surgery alone (0.57, 0.45-0.72) and nCROSS (0.73, 0.60-0.89). Based on the limited data available, adding neoadjuvant chemoradiation to pFLOT provided no additional OS (1.14, 0.76-1.72) or DFS (1.22, 0.83-1.82) benefit. Similarly, adding pembrolizumab to perioperative chemotherapy (cisplatin and fluorouracil/capecitabine) was not superior to pFLOT (DFS: 1.10, 0.71-1.69; OS: 1.09, 0.69-1.72). Conclusions pFLOT demonstrated superior efficacy in resectable gastric/GEJ adenocarcinoma, outperforming surgery alone, nCROSS, and alternative perioperative regimens. The additive role of immunotherapy requires further investigation to optimize patient selection and outcomes.
Heterogeneity in subgroup reporting across clinical trials assessing systemic therapies in metastatic castration resistant prostate cancer: A report from a living systematic review.
Journal of Clinical Oncology | February 18, 2025 | Volume: 43 | Issue: 5_suppl | Pages: 270-270
270 Background: Inconsistent reporting of subgroup data across clinical trials makes interpretation and application of the evidence from trials challenging. We conducted a living systematic review to summarize evidence for American Society of Clinical Oncology (ASCO) guidelines for management of metastatic castration resistant prostate cancer (mCRPC). Here, we provide an overview of reporting patterns of subgroup data across mCRPC trials. Methods: MEDLINE and EMBASE were systematically searched from each database's inception through September 20 th , 2024, to identify phase II/III/IV randomized clinical trials assessing the efficacy and safety of treatment options in mCRPC. For outcomes of overall survival (OS) and progression free survival (PFS), data from the subgroup analyses was collected and compared across trials to assess heterogeneity in the reporting of subgroups. Results: This analysis included 141 trials (phase II: 83; phase III: 56; phase IV: 2). OS was reported by 113 (80%) trials; 32 (28%) reported OS by any subgroups with 95 unique subgroup categories. PFS was reported by 110 (78%) trials; 23 (21%) reported PFS by any subgroups with 63 unique subgroup categories. Even among consistently reported subgroups, such as age, ECOG performance status, race, geographical area, and Gleason score, considerable heterogeneity in different subgroup levels/thresholds was observed across trials. Top ten most commonly reported subgroups are summarized (Table). Conclusions: Lack of consistent reporting for subgroup analysis in mCRPC trials preclude meaningful conclusions about clinically relevant subgroup and synthesizing evidence for clinical guidelines. A standardized framework for consistent reporting of subgroup data across trials can help inform clinical practice and clinical practice guidelines. OS PFS Number of trials 113 110 Reporting subgroup analysis – N (%) 32 (28) 23 (21) Commonly reported subgroups – (N) Age (26)ECOG-PS (26)LDH (21)PSA (18)Geographic area (15)Alkaline phosphatase (14)Visceral disease (14)Gleason score (9)Race (9)Brief pain inventory level (8) Age (21) ECOG-PS (19)PSA (18)LDH (14)Geographic area (13)Visceral disease (11)Gleason score (10)Alkaline phosphatase (9)Bone metastasis (9)Disease location (9) Age – (N) <65 (14); ≥65 (9); ≤68 (1); ≥69 (1); <70 (5); ≥70 (5); ≤74 (4); 65-75 (5); ≤ 71 (1); >71 (1); ≥75 (11); >Median (1); <Median (1) <65 (12); 65-74 (6); ≥65 (6); <70 (5); ≥70 (5); <75 (4); ≥75 (10); 76-80 (1); >80 (1) ECOG-PS – (N) 0 (15); 0-1 (11), 1 (11); 1-2 (5); 2 (12) 0 (15); 0-1 (5), 1 (12); 1-2 (2); 2 (6) Race – (N) White (9)Non-white (6)African American/black (2)Asian (2) White (8)Non-white (5)African American/black (2)Asian (4) Geographic Area – (N) Europe (8)North America (14)United States (1)Australia (1)Asia (2) Europe (11)North America (13)United States (1)Australia (1)Asia (2)North and South America (2) Gleason Score – (N) 2-6 (1); 7 (1); 8 (1); <8 (8); ≥ 8 (8); 9-10 (1) <8 (10); ≥ 8 (10)
Clinical efficacy of enfortumab vedotin-pembrolizumab (EV-P) in locally advanced (LA) or metastatic urothelial carcinoma (mUC): A real-world retrospective study.
Journal of Clinical Oncology | February 18, 2025 | Volume: 43 | Issue: 5_suppl | Pages: 745-745
745 Background: The combination of EV-P therapy has recently been approved as first-line (1L) therapy for patients with LA/mUC based on the results of the EV-302 trial. Herein, we report the updated results from a cohort of patients with LA/mUC who received EV-P in real world clinical setting. Methods: This retrospective study included patients with LA/mUC (07/2022-08/2024) at the Mayo Clinic who completed at least one cycle of EV-P. The best overall response (BOR) was evaluated using radiographic imaging and was adjudicated as complete response (CR), partial response (PR), stable disease (SD), mixed response (MR), or progressive disease (PD). The median progression-free survival (PFS), defined as the time from treatment initiation to disease progression or death, was estimated using the Kaplan-Meier method. Patients who had not experienced disease progression by their last follow-up were censored for the PFS analysis. Results: A total of 120 patients were included; 79 (65.8%) were males, 41 (34.1%) females, 109 (91%) White, and 119 (99%) were non-Hispanic/Latino. The median age was 72 years (IQR: 65-77). Of these, only 22 (18.3%) had locally advanced disease while the remaining had mUC; 62 (51.6%) had lower tract urothelial carcinoma (LUTC), 36 (30%) had upper tract urothelial carcinoma (UTUC). The median follow-up time was 7.1 months (IQR: 4.93-9.26). In terms of BOR, 56 patients (46.6%) experienced PR, 34 (28.3%) CR, 12 (10%) PD, 7 (5.8%) MR, and 8 (6.6%) experienced SD. 3 (2.5%) patients were not evaluable. The BOR across subgroups, LA and mUC, including LUTC and UTUC, is summarized in the table. Among the responders, the median number of treatment cycles to first response was 3 (IQR: 2.25–4). Within the follow-up, 28 patients (23.3%) experienced eventual radiographic disease progression; death was observed in 25 patients (20.8%). The median PFS was 12.7 months (95% CI: 9.8-NE), and OS was 25.1 months (16.3-NE). Conclusions: In real world setting, the combination of EV-P in LA/mUC demonstrated clinical efficacy compatible with the findings from the EV-302 trial. Our results showed comparable efficacy with EV-P in both UTUC and LUTC, highlighting it's broad therapeutic potential. However, clinical data at longer follow-up is required to fully evaluate overall survival and the durability of response. mUC LA Overall LUTC UTUC Total patients 98 62 36 22 BOR CR 23 (23.4%) 13 (20.9%) 10 (28.5%) 11 (50%) PR 49 (52.6%) 31 (50%) 18 (50%) 7 (31.8%) SD 6 (6.4%) 2 (3.2%) 4 (11.4%) 2 (9.0%) PD 10 (10.7%) 9 (15.5%) 1 (2.8%) 2 (9.0%) MR 7 (7.5%) 5 (8.6%) 2 (5.7%) 0 (0%)
Inferring ECOG performance status (PS) using large language models in patients with advanced prostate cancer.
Journal of Clinical Oncology | February 18, 2025 | Volume: 43 | Issue: 5_suppl | Pages: 136-136
136 Background: The ECOG performance status (PS) is a critical measure for evaluating functional capacity and determining clinical trial eligibility in patients with advanced prostate cancer. We aim to assess the capability of large language models (LLMs) to accurately infer ECOG PS from unstructured oncology notes. Methods: This retrospective study included patients with metastatic castration-resistant prostate cancer (mCRPC) receiving Lutetium-177–PSMA-617 ( 177 Lu) at the Mayo Clinic (2022-2023). Baseline ECOG PS scores were manually curated by a trained clinician from clinical notes recorded within four weeks prior to 177 Lu initiation. Structured zero-shot prompts were then used to prompt GPT-4 to infer ECOG PS scores from unstructured oncology notes. Total dataset was randomly sampled to prompt development (20%) and held-out test set (80%). Three experimental setups were employed to assess model performance: (i) utilizing unmasked clinical notes, (ii) clinical notes with only numerical ECOG PS scores masked while retaining narrative descriptive/assessment by oncologist of ECOG score, and (iii) clinical notes with both numerical scores and narrative ECOG descriptors masked. Final performance was assessed using evaluation metrics (precision, recall, F1 score) on the held-out test set. Results: A total of 240 patients (n: 50 prompt development; n: 190 test set) were included in the analysis. The median age was 70 (IQR: 66-76); a majority of patients were White (n: 229; 95%) and non-Hispanic (n: 233; 97%). The most prevalent ECOG PS score was 0 (n: 140; 58%), followed by 1 (n: 88; 37%), and 2 (n: 12; 5%). The performance was numerically higher when using unmasked notes (weighted average precision: 0.89; recall: 0.89; F1: 0.89), compared to using notes with masked scores only (weighted average precision: 0.76; recall: 0.79; F1: 0.75) and notes with both scores and narrative masked (weighted average precision: 0.57; recall: 0.53; F1: 0.48). Metrics by each ECOG PS score is outlined (Table). Conclusions: Large language models demonstrate significant potential in precisely extracting ECOG performance status from unstructured oncology notes, offering valuable support for treatment decision-making and clinical trial enrollment. However, model performance declines as reliance on implicit reporting within clinical notes increases. Future efforts focusing on prediction of ECOG using a series of notes over time will be the next step. ECOG Unmasked oncology notes ECOG Score masked only ECOG Score + ECOG narrative marked Precision Recall F1 Score Precision Recall F1 Score Precision Recall F1 Score 0 0.89 0.92 0.91 0.75 0.93 0.83 0.59 0.74 0.66 1 0.88 0.86 0.87 0.76 0.74 0.75 0.19 0.47 0.27 2 1.00 0.82 0.90 0.78 0.33 0.47 0.78 0.16 0.26
Survival in advanced prostate cancer (PCa) patients with visceral metastasis: A population-based SEER study.
Journal of Clinical Oncology | February 18, 2025 | Volume: 43 | Issue: 5_suppl | Pages: 134-134
134 Background: Prostate cancer patients with visceral metastases at diagnosis are often treated using one-size-fits-all approach. For example, CHAARTED criteria treats any visceral metastasis as high volume. Therefore, we aimed to assess overall survival (OS) by site of visceral involvement in patients with metastatic PCa. Methods: Surveillance, Epidemiology, and End Results (SEER) database (2010-2021) was queried to obtain case listing data on metastatic PCa patients from 17 registries. The patients were categorized into three groups based on visceral metastasis at diagnosis: lung metastasis, liver metastasis, and others. Kaplan-Meier survival analysis was performed to estimate median OS with 95% confidence interval (CI). Log-rank test was conducted to assess if survival was significantly different among the groups. Cox proportional hazard regression analysis was performed to assess the magnitude of difference among the groups. P-value <0.05 established statistical significance. Results: This analysis included 21,007 metastatic PCa patients (lung: n=319; liver: n=123; brain: 107; bone: 20538). Metastatic PCa population with lung metastasis exhibited a median OS of 60 months (95% CI: 48-72) compared to 24 months (95% CI: 12-36) in population with liver metastases and to 36 months (95% CI: 36-36) in population with other metastases. The difference in OS among the groups was statistically significant (p < 0.001). Compared to population with lung metastasis, those with liver (HR: 1.91; 95% CI: 1.41-2.57) but not those with other metastases (1.16; 0.97-1.39) had significantly worse OS adjusting for Gleason score, PSA and race (Table). Conclusions: In metastatic PCa, patients with lung-only metastasis have significantly better overall survival and should be considered differently in prognostication to liver metastases. Consideration of site of visceral metastasis is critical for treatment intensification decisions. Limitations of this analysis include lack of accounting for confounding relationships at individual patient level. Variable Hazard Ratio (95% CI) Metastases (Lung) REFERENCE Metastases (Liver) 1.91 (1.41-2.57) Metastases (Other) 1.16 (0.97-1.39) Gleason score≥8 REFERENCE Gleason score <8 0.68 (0.64 -0.72) PSA - ng/dL 1.01 (1.00 – 1.01) Race (White) REFERENCE Race (Black) 0.99 (0.94 – 1.05) Race (Asian or Pacific Islander) 0.70 (0.64 – 0.76)