Tripathi, Nikita

1617 Background: Large language models (LLMs) are increasingly evaluated for oncology decision support, yet guideline concordance and hallucinations remain variable across cancer types and tasks. Retrieval-augmented generation (RAG) may improve safety by constraining the evidence base used during generation. Prior oncology LLM studies report discordance with guideline-based care, but few describe a reproducible health-system “vetting mechanism” that couples guideline-only retrieval with clinician-scored safety rubrics across multiple oncology domains. Methods: We assembled 316 de-identified oncology cases in a tumor-board template: medical oncology (breast, GI, GU, leukemia; n=216), gynecologic oncology (n=50), and neuro-oncology/CNS metastatic cancer (n=50). Each case was run on three systems: baseline GPT-4 (O1), NCCN-guideline anchored RAG (O2; guideline-constrained retrieval), and a literature-anchored system (OpenEvidence; O3). Oncologists independently scored outputs using a modified Generative Performance Score (mGPS; −1 to +1) combining guideline concordance with hallucination penalties; readability/rationality was scored on a 1–5 Likert scale. Inter-rater reliability was assessed (κ =.63). This workflow was designed as a pre-deployment model credentialing step for health-system governance (source policy → case bank → clinician-scored acceptance criteria). Results: Across all 316 cases (case-averaged), O2 achieved the highest mean total mGPS (0.75) compared with O1 (0.43) and O3 (0.59). In the medical oncology cohort (n=216), O2 outperformed O1 and O3 (mean mGPS 0.72 vs 0.35 and 0.54), with higher guideline concordance (0.85 vs 0.68 and 0.75) and lower hallucination penalties (−0.09 vs −0.25 and −0.19); readability was also highest for O2 (4.17 vs 3.22 and 3.86). In gynecologic oncology (n=50), O2 again performed best (mGPS 0.827) relative to O3 (0.697) and O1 (0.647). In the CNS cohort (n=50), mean composite mGPS favored O2 (0.82) over O3 (0.68) and O1 (0.55), while readability remained stable across models (3.55–3.73). Severe hallucination/unsafe recommendation rate: O1 [26%], O2 [5%], O3 [17%] (pre-specified definition; e.g., major fabricated citation or guideline-discordant harmful recommendation). Conclusions: In a 316-case, multi-domain clinician-scored evaluation, limiting retrieval to oncology guideline sources improved safety-aligned performance relative to unconstrained generation or literature-only anchoring. A guideline-constrained RAG configuration paired with clinician-scored rubrics and tail-risk reporting can serve as a practical health-system vetting mechanism for governance, re-validation, and change control of LLM decision support, including in resource-limited settings where reliable guideline-consistent recommendations are essential.

Abstract While the use of NCCN guidelines is essential in lymphoma care, adherence among oncologists remains highly variable. Real-world concordance ranges from 65–80% overall, dropping to as low as 11–46% for certain lymphoma subtypes. Although 88% of clinicians report using NCCN guidelines for Hodgkin lymphoma, adherence to PET-adapted approaches is inconsistent. This gap highlights a critical need for tools that support guideline-concordant care.Large language models (LLMs) such as GPT–4 promise decision support, yet hallucinations and divergence from evidence-based care remain obstacles. We assessed whether retrieval-augmented generation (RAG) with National Comprehensive Cancer Network (NCCN) guidelines improves GPT–4 performance in lymphoma treatment recommendation tasks. To address this, we developed a RAG-enhanced GPT-4 agent (RAG-GPT) by indexing the 2025 NCCN Lymphoma Guidelines into a vector database. Fifty clinical vignettes spanning diverse lymphoma subtypes were compiled from published case reports; this sample provides 80 % power (α = 0.05) to detect a mean score difference of ≥ 0.18 on the modified Generative AI Performance Score (mG-PS). Guideline concordance was assessed based on NCCN guidelines and clinical judgment reflecting real-world oncological decision-making. Scores were normalized between -1.0 and 1.0 for consistent evaluation. Readability and rationale clarity were rated on a 5-point Likert scale. Baseline GPT-4 and RAG-GPT generated treatment plans via standardized prompts. An oncologist scored all outputs with mG-PS, which rates NCCN concordance (0.0–1.0) and penalizes hallucinations (-0.25 to –1.0). RAG-GPT achieved a higher mean mG-PS (0.32) than baseline GPT–4 (0.10) (t(98)=-2.11, p=0.038; mean score difference ΔmG-PS=0.22). Importantly, RAG-GPT eliminated severe hallucinations, reinforcing confidence in the safety of its treatment reccomendations. Fully concordant “gold-standard” plans were produced in 46 % of vignettes with RAG-GPT versus 22 % with baseline. Readability scores favored RAG-GPT modestly without statistical significance. Lymphoma's bimodal age distribution, heterogeneity, and lack of standardized treatment algorithms, coupled with regimen toxicity and the need to account for patient frailty and comorbidities, create complex clinical scenarios that constrain LLM applicability for nuanced decision-making. Non-Hodgkin lymphoma, particularly relapsed/refractory, transformed disease, or rare subtypes, lacks a defined standard of care, leading reviewers to rely on clinical judgment or published case series beyond NCCN guidelines. This underscores a key limitation of LLM-supported tools: their performance is highly dependent on the presence of clear algorithmic consensus within a given disease. Linking GPT-4 to NCCN guidelines via RAG significantly improved treatment accuracy and reduced hallucination severity in lymphoma, though performance remained lower than prior RAG studies in cancers like breast and CNS suggesting a greater impact on hallucination reduction than on retrieval of a consistent gold standard regimen. These findings support continued development and prospective validation of guideline-anchored LLMs for clinical use.

Abstract The combination of enfortumab vedotin and pembrolizumab (EVP) has recently revolutionized care for patients with previously untreated locally advanced and metastatic urothelial carcinoma. However, predictive biomarkers of response, the optimal duration of EVP for patients who respond well to therapy, and the role of circulating tumor DNA to monitor treatment response have not yet been fully elucidated. In this molecular tumor board, we summarize 6 patients from 4 different academic institutions with unresectable or oligometastatic urothelial carcinoma who achieved long-term remission on surveillance after a short duration of EVP treatment that resulted in complete response on follow-up imaging followed by consolidative radical cystectomy. We discuss potential predictive biomarkers for patients with exceptional response to EVP. These findings highlight the need to determine an optimal duration of EVP to maximize efficacy while minimizing adverse events. We aim to further define and explore the value of local therapy with consolidative cystectomy in the setting of unresectable, locally advanced, oligometastatic disease, or those with metastatic disease who achieve complete response of disease outside of the bladder. Identifying this subset of patients who may be candidates for this type of multidisciplinary management may result in durable treatment-free remission.

e21573 Background: In melanoma, biomarkers such as lactate dehydrogenase (LDH), circulating tumor DNA (ctDNA), and the neutrophil-lymphocyte ratio (NLR) have been linked to disease progression. This study aims to compare survival outcomes in melanoma patients based on high versus low levels of these biomarkers, assessing their impact on survival within their respective groups. By evaluating these biomarkers, we hope to identify potential prognostic indicators that could guide treatment decisions and improve personalized care in melanoma management. Methods: We conducted a retrospective survival analysis of 43 melanoma patients, excluding 16 due to incomplete data at Dignity Health Cancer Institute in Phoenix, Arizona. Kaplan-Meier survival analysis was used to compare survival between groups with high vs low levels of biomarkers. Patients were stratified by median values for LDH, NLR, and the presence of detectable ctDNA. Patients included in the analysis were treated systemically with pembrolizumab, encorafenib/binimetinib, nivolumab, or ipilimumab/nivolumab. Survival curves were generated, and statistical significance was assessed using log-rank tests. Data was sourced from our electronic medical record and Signatera™ assay to obtain the primary endpoints. Specimens were standardized in accordance with Natera’s™ specifications. All analyses were executed in GraphPad Prism software. Results: When stratifying by ctDNA, 18 patients had undetectable ctDNA, while 9 had detectable ctDNA with an average level of 1330 (SD = 2067). The median survival for the high ctDNA group was 220 days, whereas the low ctDNA group had significantly longer survival, with only two deaths observed (p = 0.006) within the time period. For LDH, using a cutoff of 204 (IQR = 90.5), patients with high LDH had a median survival of 220 days, while those with low LDH had a significantly longer survival (p = 0.004). When comparing NLR with a cutoff at 2.94 (IQR = 3.7), no significant difference in survival was found between high and low NLR groups (p = 0.72). Conclusions: Our findings show that patients with higher levels of ctDNA and LDH have significantly shorter survival compared to those with low levels of these biomarkers. While NLR did not show a significant survival difference, the study suggests that higher ctDNA and LDH could be important markers for identifying patients at greater risk of poor outcomes. These results underscore the potential value of monitoring these biomarkers to assess disease progression and survival in melanoma patients. Further studies with larger cohorts are needed to validate these findings and refine melanoma prognostic models.

ABSTRACTBackgroundThe treatment landscape for multiple myeloma continues to evolve. Recently, the addition of anti‐CD38 monoclonal antibodies (mAbs) to the triplet regimen, comprising a proteasome inhibitor, an immunomodulatory agent, and a steroid, for transplant‐eligible newly diagnosed multiple myeloma (TENDMM) has shown promising results.AimsTo evaluate the overall efficacy and safety of quadruplet therapy with an anti‐CD38 mAb compared to a triplet regimen.MethodsA systematic search of Medline, Scopus, and EMBASE databases from inception to July 2024 identified relevant randomized controlled trials (RCTs). Efficacy and safety outcomes were derived using random‐effects meta‐analysis. Summarized outcomes include hazard ratios (HR) for progression‐free survival (PFS) and overall survival (OS), odds ratios (OR) for response rates, measurable residual disease (MRD) negativity rate, and grade 3 or higher adverse events (G ≥ 3 AEs).ResultsFive RCTs involving 2963 patients were included. A statistically significant PFS was observed for quadruplet therapy when compared to the triplet regimen (HR 0.44; 95% Confidence Interval [CI] 0.35–0.56). PFS benefit was consistent for the standard risk (SR) group (HR 0.38; 95% CI 0.27–0.52) and high risk (HiR) group (HR 0.62; 95% CI 0.41–0.92). No statistically significant benefit was observed for OS (HR 0.55; 95% CI 0.28–1.08). A statistically significant benefit was observed for the overall response rate (OR 1.77; 95% CI 1.02–3.06) and MRD negativity rate (OR 2.67; 95% CI 1.79–3.99). No significant differences were observed for G ≥ 3 AE (OR 1.21; 95% CI 0.92–1.58), lymphopenia (OR 1.09; 95% CI 0.62–1.89), and anemia (OR 1.06; 95% CI 0.83–1.37). However, a significantly increased risk was observed for all‐grade thrombocytopenia (OR 1.64; 95% CI 1.37–1.97), neutropenia (OR 2.24; 95% CI 1.67–3.02) and infections (OR 1.88; 95% CI 1.07–3.31).ConclusionQuadruplet therapy demonstrated a favorable efficacy and safety profile, with consistent benefit across subgroups. The findings support its potential as the new standard of care for TENDMM.

745 Background: The combination of EV-P therapy has recently been approved as first-line (1L) therapy for patients with LA/mUC based on the results of the EV-302 trial. Herein, we report the updated results from a cohort of patients with LA/mUC who received EV-P in real world clinical setting. Methods: This retrospective study included patients with LA/mUC (07/2022-08/2024) at the Mayo Clinic who completed at least one cycle of EV-P. The best overall response (BOR) was evaluated using radiographic imaging and was adjudicated as complete response (CR), partial response (PR), stable disease (SD), mixed response (MR), or progressive disease (PD). The median progression-free survival (PFS), defined as the time from treatment initiation to disease progression or death, was estimated using the Kaplan-Meier method. Patients who had not experienced disease progression by their last follow-up were censored for the PFS analysis. Results: A total of 120 patients were included; 79 (65.8%) were males, 41 (34.1%) females, 109 (91%) White, and 119 (99%) were non-Hispanic/Latino. The median age was 72 years (IQR: 65-77). Of these, only 22 (18.3%) had locally advanced disease while the remaining had mUC; 62 (51.6%) had lower tract urothelial carcinoma (LUTC), 36 (30%) had upper tract urothelial carcinoma (UTUC). The median follow-up time was 7.1 months (IQR: 4.93-9.26). In terms of BOR, 56 patients (46.6%) experienced PR, 34 (28.3%) CR, 12 (10%) PD, 7 (5.8%) MR, and 8 (6.6%) experienced SD. 3 (2.5%) patients were not evaluable. The BOR across subgroups, LA and mUC, including LUTC and UTUC, is summarized in the table. Among the responders, the median number of treatment cycles to first response was 3 (IQR: 2.25–4). Within the follow-up, 28 patients (23.3%) experienced eventual radiographic disease progression; death was observed in 25 patients (20.8%). The median PFS was 12.7 months (95% CI: 9.8-NE), and OS was 25.1 months (16.3-NE). Conclusions: In real world setting, the combination of EV-P in LA/mUC demonstrated clinical efficacy compatible with the findings from the EV-302 trial. Our results showed comparable efficacy with EV-P in both UTUC and LUTC, highlighting it's broad therapeutic potential. However, clinical data at longer follow-up is required to fully evaluate overall survival and the durability of response. mUC LA Overall LUTC UTUC Total patients 98 62 36 22 BOR CR 23 (23.4%) 13 (20.9%) 10 (28.5%) 11 (50%) PR 49 (52.6%) 31 (50%) 18 (50%) 7 (31.8%) SD 6 (6.4%) 2 (3.2%) 4 (11.4%) 2 (9.0%) PD 10 (10.7%) 9 (15.5%) 1 (2.8%) 2 (9.0%) MR 7 (7.5%) 5 (8.6%) 2 (5.7%) 0 (0%)

e19534 Background: Immunomodulatory drugs, proteasome inhibitors plus dexamethasone are the standard triplet induction regimen for TENDMM. We analyzed the efficacy of adding either anti-CD38 monoclonal antibodies (mAbs) or anti-SLAMF7 antibody to the triplet therapy. Methods: Ovid MEDLINE, EMBASE and published abstracts were systematically searched from each database’s inception through 01-31-2024 to identify II/III trials assessing quadruplet therapy versus triplet therapy in TENDMM patients. Hazard ratios (HR) for progression-free survival (PFS) and overall survival (OS), odds ratios (OR) for overall response rates (ORR), measurable residual disease (MRD) negativity rate (with sensitivity of 10 -5) and grade 3 or higher treatment-related adverse events (G≥3 TRAE) were summarized using random effects meta-analysis via inverse variance approach. Additional subgroup analyses based on the cytogenetic risk were performed. P-value of interaction (Pint ) < 0.1 was pre-specified as statistically significant for the difference between the two groups. Results: 3806 studies were screened and seven trials were included with a total of 3546 patients. Four trials (2303 patients) assessed the addition of anti-CD-38 mAbs and three (1243 patients) assessed anti-SLAMF7 mAb, elotuzumab to the triplet regimen. Quadruplet therapy significantly improved PFS as compared to triplet (HR: 0.63; 95% CI: 0.43-0.92), and the PFS benefit was also observed in standard risk group (HR 0.5; 95% CI 0.2-0.9); however, results were insignificant for high-risk group (HR 0.8; 95% CI 0.62-1.93). No significant OS benefit was observed (HR: 0.79; 95% CI 0.49–1.26); however, data for three trials (CASSIOPEIA, DSMM XVII, PERSEUS) is immature, with longer-term follow-up ongoing. Quadruplet therapy showed significant results for very good partial response or better (OR: 1.7; 95% CI 1.2-2.36), stringent complete response (OR: 1.74; 95% CI 1.27-2.07) and complete response or better (OR: 1.91; 95% CI 1.19-3.06). MRD rate shows benefit with quadruplet therapy (OR: 2.59; 95% CI 2.22-3.01). Improved MRD rate was also observed for high-risk (OR 2.13; 95% CI 1.4-3.2) and standard-risk group (OR 2.58; 95% CI 1.68-3.94). Secondary analysis for efficacy of anti-CD38 mAbs showed benefit for PFS (HR: 0.44; 95% CI: 0.35-0.56), ORR (OR: 1.77;95% CI: 1.02-3.06), and MRD (OR: 2.98; 95% CI 1.8-4.8). G ≥3 TRAE did not significantly differ between the groups (OR: 1.05; 95% CI 0.97-1.12). However, quadruplet therapy showed significant risk of infection (OR: 1.2; 95% 1.05-1.35) and thrombocytopenia (OR: 1.41; 95% CI 1.24-1.59). Conclusions: Quadruplet therapy improved PFS, ORR, and MRD rates compared to triplet regimen and has demonstrated promising benefits to be considered the new standard of care for TENDMM patients.

e16579 Background: Recent results from EV 302 and CheckMate 901 have transformed the treatment landscape of untreated locally advanced/metastatic urothelial cancer (Ia/mUC). Here, we present the most up-to-date evidence of comparative efficacy and safety of first line (1L) treatment options in Ia/mUC with emphasis on Enfortumab vedotin (EV)-pembrolizumab (P) and gemcitabine (Gem)-cisplatin (Cis)-nivolumab (N). Methods: This living systematic review used the living interactive evidence (LIvE) synthesis framework. Full-text and abstract publications of phase II/III randomized clinical trials comparing 1L immunotherapy combined with chemotherapy (IO+C) or immunotherapy alone (IO) regimens with platinum-based chemotherapy (Plat) in Ia/mUC were included. Outcomes of interest included overall survival (OS), progression-free survival (PFS) and treatment-related grade 3 or greater adverse events (≥G3 TRAE). Mixed treatment comparisons were made using network meta-analysis. P-scores were computed to assess relative treatment rankings. Results: A total of 5 trials (8 references) with 4,749 patients and 9 unique treatments were included. EV-P and Gem-Cis-N were ranked first and second in terms of OS and PFS improvement. EV-P improved OS compared to Gem-Cis-N (HR: 0.60; 0.45-0.81), Gem-Plat-atezolizumab(A) (0.55; 0.42-0.72), durvalumab(D)- tremelimumab(T) (0.55; 0.42-0.72), Gem-Plat-P (0.55; 0.42-0.72), P (0.51; 0.39-0.68), D (0.47; 0.36-0.63), A (0.48; 0.36-0.63) and Gem-Plat (0.47; 0.38-0.58). EV-P also improved PFS compared to Gem-Cis-N (0.63; 0.48-0.82), Gem-Plat-A (0.55; 0.43-0.69), D-T (0.42; 0.33-0.53), Gem-Plat-P (0.58; 0.45-0.74), P (0.34; 0.26-0.44), D (0.35; 0.27-0.44) and Gem-Plat (0.45; 0.38- 0.54). For ≥G3 TRAE, A was ranked first with the lowest adverse events compared to others. EV-P (rank 5) had significantly fewer events compared to Gem-Plat, Gem-Plat-A, Gem-Cis-N and Gem-Plat-P. Gem-Cis-N was ranked last with significantly greater events compared to A, P, D, D-T, Gem-Plat, EV-P, and Gem-Plat-A (Table with ranks [p-scores]). Conclusions: Current evidence suggests that patients with untreated la/mUC experience improved survival and slower disease progression with EV-P when compared to other contemporary options. Gem-Cis-N may be a reasonable alternative in patients who are cisplatin-eligible. Cost and access to these treatments are crucial and should be considered to facilitate shared decision making. [Table: see text]

98 Background: The risk of secondary primary malignancies (SPM) among the survivors of GU cancer is not well-established. In this study, we attempt to describe the patterns of SPMs in patients diagnosed with GU cancers. Methods: The Surveillance, Epidemiology, and End Results (SEER) database (SEER*Stat 8.4.2) was searched to obtain data on the incidence of SPM in adult patients (age >18 years) diagnosed with GU cancers, including prostate, renal, and bladder cancer. Standardized incidence ratios (SIRs) with a 95% confidence interval (CI) were calculated. SIR was defined as the observed SPMS from each category divided by the expected number of SPMs in the age-matched US population for the same period. The data was further stratified by age (<50y, 50-70y, >70y), race (White, Black, Asian/Pacific Islander), ethnicity (Hispanic, non-Hispanic), chemotherapy, and radiotherapy exposure. Results: A total of 1,041,217 patients were included in this analysis. In patients diagnosed with GU cancer, the incidence of overall SPM was 11%. Particularly, patients with GU cancers were observed to have a high incidence of Endocrine system SPM (1.52; 1.45-1.59), and urinary system SPM (1.51; 1.49-1.53) These results were consistent by different sociodemographic groups. In patients diagnosed with prostate cancer, the incidence of thyroid SPM was increased (1.31; 1.23-1.39). Particularly, prostate cancer patients treated with radiation therapy had increased incidence rates of SPM in the peritoneum, omentum and mesentery (1.57; 0.79-2.81) and urinary bladder (1.36;1.32-1.40) was higher as compared to those with no exposure to radiation therapy (1.11;1.08-1.13 and 1.03;1-1.06 respectively). Bladder cancer patients had an overall increased incidence of SPM in the esophagus (1.21; 1.08-1.35), lung, bronchus, trachea, and other respiratory organs (1.97;1.92-2.01), prostate (3.50;3.4-3.6) and kidney (1.86;1.76-1.97). A higher incidence of renal pelvis, ureter and other urinary organ SPM (11.08;10.48-11.07) was also notable in this population. Similarly, kidney cancer patients had a higher incidence of the endocrine system (3.00;2.74-3.27), prostate (1.24;1.2-1.29) and bladder 1.78;1.68-1.79 SPMs. Conclusions: This population-based study shows an increased risk of SPM development in GU cancer survivors compared to the general population. Clinicians should keep a high index of suspicion for SPMs and initiate appropriate workups at early warning signs.

643 Background: The FDA approval of enfortumab (EV) and pembrolizumab (Pembro) combination therapy as a first-line treatment for cisplatin-ineligible patients with locally advanced/metastatic urothelial carcinoma (la/mUC) was based on the EV-103 trial. We aim to assess the clinical response rate of this combination therapy in our institution's patients with locally advanced and metastatic UC. Methods: This retrospective cohort study included 20 patients diagnosed with locally advanced/metastatic UC(la/mUC) who were treated with EV-Pembro combination for at least 2 cycles, from June 2022 to August 2023 at the Mayo Clinic. Patients who were treatment naïve or who progressed one or more lines of therapy were included in the study cohort. Main outcome of interest included imaging-based best overall response rate in terms of complete (CR) and partial (PR) response, stable disease (SD), and progressive disease (PD). Results: Out of 20 patients, the number of males and females were 16 (80%) and 4 (20%) respectively; the median age was 77 years (IQR: 51-92). 3 (15%) of patients had involvement of upper urinary tract disease along with bladder cancer. The common sites of visceral metastasis at the time of initial presentation include liver 2(10%), lung 6(30%) and lymph nodes12(60%). Common toxicities of this regimen included rash, pruritis, peripheral neuropathy, fatigue, transaminitis, dysgeusia, and diarrhea. The treatment was stopped in 10 (50%) patients due to completion of planned therapy (achieved CR or proceeded with resection of residual disease) (30%), 5 patients due to progression (50%), 1 patient due to therapy side effects (10%) and in 1 patient due to death (10%). The objective response was 45% (N =9); 5 (25%) had PR, and 4 (20%) had CR. A total of 2 (10%) had SD while 2 (10%) experienced PD. Histological correlation with clinical benefit is shown in the table. Conclusions: EV-Pembro combination therapy shows promising responses in patients who have progressed after previous lines of therapy, consistent with previously published data on EV 201 in small cohorts. However, ongoing expansion of this cohort and data from larger studies will help further elucidate survival benefits and their correlation with genetic testing. [Table: see text]