Singh, Parminder Pal

745 Background: The combination of EV-P therapy has recently been approved as first-line (1L) therapy for patients with LA/mUC based on the results of the EV-302 trial. Herein, we report the updated results from a cohort of patients with LA/mUC who received EV-P in real world clinical setting. Methods: This retrospective study included patients with LA/mUC (07/2022-08/2024) at the Mayo Clinic who completed at least one cycle of EV-P. The best overall response (BOR) was evaluated using radiographic imaging and was adjudicated as complete response (CR), partial response (PR), stable disease (SD), mixed response (MR), or progressive disease (PD). The median progression-free survival (PFS), defined as the time from treatment initiation to disease progression or death, was estimated using the Kaplan-Meier method. Patients who had not experienced disease progression by their last follow-up were censored for the PFS analysis. Results: A total of 120 patients were included; 79 (65.8%) were males, 41 (34.1%) females, 109 (91%) White, and 119 (99%) were non-Hispanic/Latino. The median age was 72 years (IQR: 65-77). Of these, only 22 (18.3%) had locally advanced disease while the remaining had mUC; 62 (51.6%) had lower tract urothelial carcinoma (LUTC), 36 (30%) had upper tract urothelial carcinoma (UTUC). The median follow-up time was 7.1 months (IQR: 4.93-9.26). In terms of BOR, 56 patients (46.6%) experienced PR, 34 (28.3%) CR, 12 (10%) PD, 7 (5.8%) MR, and 8 (6.6%) experienced SD. 3 (2.5%) patients were not evaluable. The BOR across subgroups, LA and mUC, including LUTC and UTUC, is summarized in the table. Among the responders, the median number of treatment cycles to first response was 3 (IQR: 2.25–4). Within the follow-up, 28 patients (23.3%) experienced eventual radiographic disease progression; death was observed in 25 patients (20.8%). The median PFS was 12.7 months (95% CI: 9.8-NE), and OS was 25.1 months (16.3-NE). Conclusions: In real world setting, the combination of EV-P in LA/mUC demonstrated clinical efficacy compatible with the findings from the EV-302 trial. Our results showed comparable efficacy with EV-P in both UTUC and LUTC, highlighting it's broad therapeutic potential. However, clinical data at longer follow-up is required to fully evaluate overall survival and the durability of response. mUC LA Overall LUTC UTUC Total patients 98 62 36 22 BOR CR 23 (23.4%) 13 (20.9%) 10 (28.5%) 11 (50%) PR 49 (52.6%) 31 (50%) 18 (50%) 7 (31.8%) SD 6 (6.4%) 2 (3.2%) 4 (11.4%) 2 (9.0%) PD 10 (10.7%) 9 (15.5%) 1 (2.8%) 2 (9.0%) MR 7 (7.5%) 5 (8.6%) 2 (5.7%) 0 (0%)

136 Background: The ECOG performance status (PS) is a critical measure for evaluating functional capacity and determining clinical trial eligibility in patients with advanced prostate cancer. We aim to assess the capability of large language models (LLMs) to accurately infer ECOG PS from unstructured oncology notes. Methods: This retrospective study included patients with metastatic castration-resistant prostate cancer (mCRPC) receiving Lutetium-177–PSMA-617 ( 177 Lu) at the Mayo Clinic (2022-2023). Baseline ECOG PS scores were manually curated by a trained clinician from clinical notes recorded within four weeks prior to 177 Lu initiation. Structured zero-shot prompts were then used to prompt GPT-4 to infer ECOG PS scores from unstructured oncology notes. Total dataset was randomly sampled to prompt development (20%) and held-out test set (80%). Three experimental setups were employed to assess model performance: (i) utilizing unmasked clinical notes, (ii) clinical notes with only numerical ECOG PS scores masked while retaining narrative descriptive/assessment by oncologist of ECOG score, and (iii) clinical notes with both numerical scores and narrative ECOG descriptors masked. Final performance was assessed using evaluation metrics (precision, recall, F1 score) on the held-out test set. Results: A total of 240 patients (n: 50 prompt development; n: 190 test set) were included in the analysis. The median age was 70 (IQR: 66-76); a majority of patients were White (n: 229; 95%) and non-Hispanic (n: 233; 97%). The most prevalent ECOG PS score was 0 (n: 140; 58%), followed by 1 (n: 88; 37%), and 2 (n: 12; 5%). The performance was numerically higher when using unmasked notes (weighted average precision: 0.89; recall: 0.89; F1: 0.89), compared to using notes with masked scores only (weighted average precision: 0.76; recall: 0.79; F1: 0.75) and notes with both scores and narrative masked (weighted average precision: 0.57; recall: 0.53; F1: 0.48). Metrics by each ECOG PS score is outlined (Table). Conclusions: Large language models demonstrate significant potential in precisely extracting ECOG performance status from unstructured oncology notes, offering valuable support for treatment decision-making and clinical trial enrollment. However, model performance declines as reliance on implicit reporting within clinical notes increases. Future efforts focusing on prediction of ECOG using a series of notes over time will be the next step. ECOG Unmasked oncology notes ECOG Score masked only ECOG Score + ECOG narrative marked Precision Recall F1 Score Precision Recall F1 Score Precision Recall F1 Score 0 0.89 0.92 0.91 0.75 0.93 0.83 0.59 0.74 0.66 1 0.88 0.86 0.87 0.76 0.74 0.75 0.19 0.47 0.27 2 1.00 0.82 0.90 0.78 0.33 0.47 0.78 0.16 0.26

134 Background: Prostate cancer patients with visceral metastases at diagnosis are often treated using one-size-fits-all approach. For example, CHAARTED criteria treats any visceral metastasis as high volume. Therefore, we aimed to assess overall survival (OS) by site of visceral involvement in patients with metastatic PCa. Methods: Surveillance, Epidemiology, and End Results (SEER) database (2010-2021) was queried to obtain case listing data on metastatic PCa patients from 17 registries. The patients were categorized into three groups based on visceral metastasis at diagnosis: lung metastasis, liver metastasis, and others. Kaplan-Meier survival analysis was performed to estimate median OS with 95% confidence interval (CI). Log-rank test was conducted to assess if survival was significantly different among the groups. Cox proportional hazard regression analysis was performed to assess the magnitude of difference among the groups. P-value <0.05 established statistical significance. Results: This analysis included 21,007 metastatic PCa patients (lung: n=319; liver: n=123; brain: 107; bone: 20538). Metastatic PCa population with lung metastasis exhibited a median OS of 60 months (95% CI: 48-72) compared to 24 months (95% CI: 12-36) in population with liver metastases and to 36 months (95% CI: 36-36) in population with other metastases. The difference in OS among the groups was statistically significant (p < 0.001). Compared to population with lung metastasis, those with liver (HR: 1.91; 95% CI: 1.41-2.57) but not those with other metastases (1.16; 0.97-1.39) had significantly worse OS adjusting for Gleason score, PSA and race (Table). Conclusions: In metastatic PCa, patients with lung-only metastasis have significantly better overall survival and should be considered differently in prognostication to liver metastases. Consideration of site of visceral metastasis is critical for treatment intensification decisions. Limitations of this analysis include lack of accounting for confounding relationships at individual patient level. Variable Hazard Ratio (95% CI) Metastases (Lung) REFERENCE Metastases (Liver) 1.91 (1.41-2.57) Metastases (Other) 1.16 (0.97-1.39) Gleason score≥8 REFERENCE Gleason score <8 0.68 (0.64 -0.72) PSA - ng/dL 1.01 (1.00 – 1.01) Race (White) REFERENCE Race (Black) 0.99 (0.94 – 1.05) Race (Asian or Pacific Islander) 0.70 (0.64 – 0.76)

132 Background: Distant metastasis at the time of prostate cancer (PCa) diagnosis is associated with increased morbidity and mortality. This study aimed to assess the impact of sociodemographic characteristics on distant metastasis at the time of PCa diagnosis. Methods: The Surveillance Epidemiology and End Results (SEER) database (2000-2021), including PCa patients from 17 registries, was queried. Patients with late-stage diagnosis (LSD) were defined as those who were initially diagnosed with stage IV disease, indicating distant metastasis. Sociodemographic predictors included race, ethnicity, age, marital status, residential status, and median household income. Multicollinearity was assessed using variance inflation factors (VIF). Univariable logistic regression was performed to identify significant predictors of LSD, which were further analyzed in multivariable logistic regression using a maximum likelihood estimation approach. Odds ratios with 95% confidence intervals (CI) were computed with a p-value of <0.05 indicating a statistically significant association. Results: Of the 1,089,736 PCa patients diagnosed, 64,983 (6%) had an LSD. The majority were white (80%), non-Hispanic/Latino (HL) (91%), aged ≥65 years (60%), married (75%), residents in metropolitan areas (88%), and had an annual house income of ≥$70,000 (70%). Multivariable logistic regression identified Black (OR: 1.24; 95%CI: 1.22-1.27), Asian or Pacific Islander (1.35; 1.30-1.40), and American Indian/Alaska Native (1.70; 1.53-1.89) to have higher odds of LSD compared to White patients (Table). In addition, HL ethnicity compared to non-HL (OR: 1.45; 95% CI: 1.42-1.49), age ≥65 compared to <65 (1.68; 1.65-1.71), unmarried status compared to married (1.88; 1.85-1.91), residency in non-metropolitan areas compared to metropolitan (1.10; 1.07-1.12), and household income <$70,000 compared to ≥$70,000 (1.03; 1.01-1.05) had a significant association with LSD. Conclusions: Older, non-White (Black, Asian/Pacific Islander, American Indian/Alaska Native), Hispanic/Latino, unmarried men, residents of non-metropolitan areas, or those with lower annual household incomes have higher odds of late-stage diagnosis. Interventions targeting early detection in these at-risk groups may improve prostate cancer outcomes in the US. Variable Odds Ratio (95% CI) p-value Race (Black vs White) 1.24 (1.22-1.27) <0.01 Race (Asian or Pacific Islander vs White) 1.35 (1.31-1.40) <0.01 Race (American Indian/Alaska Native vs White) 1.70 (1.53-1.89) <0.01 Ethnicity (Hispanic/Latino vs non-/Hispanic/Latino) 1.45 (1.42-1.49) <0.01 Age (≥65 vs <65) 1.68 (1.65-1.71) <0.01 Marital status (unmarried vs married) 1.88 (1.85-1.91) <0.01 Residence status (non-metropolitan vs metropolitan) 1.10 (1.07-1.12) <0.01 Household income (<$70,000 vs ≥$70,000) 1.03 (1.01-1.05) <0.01

341 Background: Specialist clinicians (oncologists, urologists, radiation oncologists) read through free text reports of prostate MRI and biopsy reports to risk stratify patients during initial consultation of localized PCa. This laborious and time-consuming process is repeated for each day during the clinic. Herein, we propose a hybrid stratification framework utilizing a combination of large language model (LLM) and rule-based programming to automate this process. Methods: This retrospective study included patients with localized PCa (2004-2024) presenting to care at Mayo Clinic with at least one positive prostate biopsy and MRI report available. The state-of-the-art LLM – GPT4 – was utilized using a structured zeroshot prompt to extract relevant phenotypic variables (clinical T stage, Gleason patterns, grade group, extent of specimen/cores involved, prostate size/volume) from unstructured MRI and biopsy reports. Using a rule-based algorithm, the extracted variables and PSA at PCa diagnosis were used to categorize each patient into one of the six NCCN risk categories (very low [VL], low [L], favorable intermediate [FInt], unfavorable intermediate [UFInt], high risk (HR), very high risk [VHR]). Prompts were iteratively developed using ~5% of the total dataset and validated on ~10% of the dataset. Final performance was assessed against a held-out expert annotated test dataset using evaluation metrics (accuracy, F1-score, precision, recall). Additionally, manual annotation was conducted by two independent novice reviewers to compare machine annotated and novice-human annotated risk categorization. Results: A total of 397 patients were included in the evaluation. The median age at diagnosis was 64.8 (IQR: 59.7-68.5); majority of the men were White (n: 366; 92%) and non-Hispanic (n: 371; 94%). The most prevalent risk category was UFint (n: 151; 38%) followed by FInt (n: 80; 20.2%), HR (n: 76; 19.1%), VHR (n: 64; 16.1%), L (21: 5.3%), and VL (n: 5; 1.3%). Novice reviewers achieved an accuracy of 79%, precision of 80%, recall of 82% and a F1-score of 0.81. The hybrid stratification framework using GPT4 achieved an accuracy of 89%, precision of 89%, recall of 88% and a F1-score of 0.88. Among 43 errors by GPT4 risk stratification, majority of the errors were due to miscategorization of clinical T-stage (n: 21; 49%) followed by erroneous number of positive cores (n: 13; 30%). However, additional evaluation showed that GPT4 achieved numerically higher performance (accuracy: 90%; precision: 91%; recall: 90%; F1: 0.90) compared to novice reviewers (accuracy: 77%; precision: 89%; recall: 77%; F1: 0.82) for ascertaining clinical T-stage. Conclusions: Large language models exhibited superior performance than novice clinicians for risk stratification in patients with localized PCa. As the next step, we intend to validate our framework for automated risk classification in a prospective manner.

184 Background: We update evidence on mHSPC when new evidence becomes available (PMID: 36862387). ARANOTE trial prompted us to assess the comparative efficacy of darolutamide (DARO) with other ARPi agents in mHSPC using the living network meta-analysis (LNMA). Methods: This LNMA is conducted using the living interactive evidence (LIvE) synthesis framework. Phase III trials assessing systemic treatments in mHSPC are included. Mixed treatment comparisons were made using a frequentist network meta-analysis. P-scores were computed to assess relative treatment rankings with higher values indicating potentially better efficacy. Results: This report of LNMA includes a total 11 trials (12628 patients; 12 unique treatment options) as of October 1 st , 2024. Overall results were consistent with prior updates. Analysis limited to the ARPi trials showed that inhigh volume, abiraterone acetate (AAP)+androgen deprivation therapy (ADT) (HR: 0.46; 95% CI: 0.40-0.53; rank 1), apalutamide (APA)+ADT (0.53; 0.41-0.68; rank 3), DARO+ADT (0.60; 0.44-0.81; rank 4) and enzalutamide (E)+ADT (0.48; 0.41-0.56; rank 2) significantly improved radiographic progression-free survival (rPFS) compared to ADT alone. No statistically significant differences were observed with DARO+ADT compared to AAP+ADT (1.30; 0.94-1.82), APA+ADT (1.14; 0.77-1.67) and E+ADT (1.24; 0.89-1.79). Inlow volume, AAP+ADT (0.48; 0.37-0.63; rank 4), APA+ADT (0.36; 0.22-0.58; rank 3), DARO+ADT (0.30; 0.15-0.60; rank 1) and E+ADT (0.32; 0.25-0.41; rank 2) significantly improved rPFS compared to ADT. E+ADT significantly improved rPFS compared to AAP+ADT (0.67; 0.47-0.96) in low volume. No statistically significant differences were observed with DARO+ADT compared to AAP+ADT (0.62; 0.30-1.30), APA+ADT (0.83; 0.36-1.92) and E+ADT (0.93; 0.45-1.94). In synchronous disease, AAP+ADT (0.58; 0.51-0.67; rank 4), APA+ADT (0.49; 0.39-0.62; rank 2), DARO+ADT (0.59; 0.44-0.79; rank 3) and E+ADT (0.42; 0.36-0.50; rank 1) significantly improved rPFS compared to ADT. E+ADT significantly improved rPFS compared to AAP+ADT (0.73; 0.59-0.89) in synchronous disease. In metachronous disease, DARO+ADT (0.34; 0.17-0.67; rank 1), APA+ADT (0.41; 0.22-0.77; rank 2) and E+ADT (0.44; 0.35-0.57; rank 3) significantly improved rPFS compared to ADT. No statistically significant differences were observed with DARO+ADT compared to APA+ADT (0.83; 0.33-2.08) and E+ADT (0.76; 0.37-1.57) in metachronous disease. The results were consistent for overall survival. Conclusions: Current evidence suggests no significant differences for darolutamide as compared to other ARPi agents. Enzalutamide may be preferred over AAP in low-volume or synchronous disease. Given similar efficacy, choice of ARPi requires careful consideration of patient-specific factors including cost, accessibility and toxicity.

866 Background: Emerging data suggests that Language Models (LLMs) provide an unprecedented opportunity to extract critical data from the unstructured pathology reports. However, the performance of state of art (SOTA) models on clinically meaningful tasks such as assessment of pathologic responses in patients receiving neoadjuvant chemotherapy (NAC) in muscle invasive bladder cancer(MIBC) is not well known. Methods: This retrospective cohort included patients with pathologically confirmed Muscle-Invasive Bladder Cancer from the year 2018 to 2024. Selected patients included those who underwent Neoadjuvant chemotherapy followed by definitive cystectomy at Mayo Clinic. Gold standard labels were manually curated by trained clinicians. The state of the art (SOTA) LLM – GPT4 – was utilized using a structured zero-shot prompt to extract relevant phenotypic variables such as tumor site, tumor histology and additional histological variants if any, presence of in-situ / invasive carcinoma, presence of lamina propria / muscularis propria / lympho-vascular / perineural invasion, and T-stage from unstructured pathology reports. Structured prompts were iteratively developed for each data variable and validated using ~5% of the total dataset. The extracted variables were manually compared and labelled as True positive / True negative / False positive / False negative. Final performance was assessed against a held-out expert annotated test dataset using evaluation metric (accuracy). Results: A total of 200 reports from 99 patients were extracted by the LLM. Of the 200 reports, 41 duplicate / other pathology reports (e.g. – autopsy, cholecystectomy, etc.) were removed during final assessment. Significant characteristics such as tumor site, histology, and additional histology variant had an accuracy of 89%, 87%, and 91% respectively. Notably, accuracy of detection of in-situ versus invasive carcinoma was 70% versus 91%. Specific variables such as lamina propria / muscularis propria invasion / T-stage / lympho-vascular invasion / perineural invasion were answered with the accuracy of 75%, 75%, 67%, 90%, and 94% respectively. Conclusions: LLMs have the potential to extract critical data from unstructured pathology reports and automate assessment of pathologic responses in MIBC patients receiving NAC. Iterative improvements in performance can be achieved by improving prompt design using expert clinical input. This process can be potentially scaled to automate cancer registries.

4591 Background: EV-302 and CheckMate 901 demonstrated significant survival benefit with enfortumab vedotin-pembrolizumab (EVPembro) and gemcitabine-cisplatin-nivolumab (GemCisNivo) as 1L therapy, respectively, in patients (pts) with la/mUC. However, whether these treatments are cost-effective or not remains unclear. Methods: A three-state Markov model (progression-free, progression and death) was developed. State utilities were derived from published literature. State transition probabilities were informed from point-probabilities and hazard ratios for OS and PFS obtained from the latest follow-up of eligible trials. Average sales price (2024 USD) for individual treatments (excluding ancillary charges) were obtained from the center of medicare and medicaid services (US payer’s perspective). Treatment strategies were modeled in accordance with the dose/schedule reported in the eligible trials. Pts who received GemCis or Gem-carboplatin (GemCarbo) and did not progress were modeled to receive Avelumab maintenance. Half-cycle corrected costs and utilities were accrued over a 10-year lifetime horizon and were discounted at 3%. Monte Carlo simulation was used to estimate quality adjusted life years (QALYs) and incremental cost-effectiveness ratios (ICERs). A willingness-to-pay threshold (WTP) of 100,000$ per QALY was used. Results: In cisplatin-eligible pts, GemCisNivo demonstrated a 0.8 QALY gain over GemCis at an ICER of 21,127 ($/QALY). GemCisNivo was also associated with an incremental net monetary benefit (INMB) of 63,099$ relative to GemCis. EVPembro demonstrated a 2.4 QALY gain over GemCis at an ICER of 915,283 and a 1.6 QALY gain over GemCisNivo at an ICER of 1,406,308. In cisplatin-ineligible pts, EVPembro demonstrated a 2.4 QALY gain over Gem-carboplatin (GemCarbo) at an ICER of 934,761. Price threshold analyses demonstrated that EVPembro is likely to be cost-effective at a cost of 12,344$ for cisplatin-eligible and 13,374$ per cycle for cisplatin-ineligible pts (original cost: 35,665.60$ per cycle). Sensitivity analysis using a total of 12 cycles for EVPembro showed cost-effectiveness at an ICER of 69,594 relative to GemCisNivo in cisplatin-eligible pts, and at an ICER of 53,099 relative to GemCarbo in cisplatin-ineligible pts. Conclusions: In terms of US payer’s perspective, GemCisNivo is most likely to be cost-effective in cisplatin-eligible pts at the WTP of 100,000 $/QALY. Limiting the number of cycles for EVPembro may render it as a cost-effective 1L treatment in la/mUC pts regardless of cisplatin-eligibility status.