Frendl, Daniel M.

5108 Background: We previously proposed a hybrid framework combining LLMs and rule based algorithm (RBA) for automating risk stratification in locPCa. Herein, we aim to validate the risk stratification agent (RSA) in a prospective cohort, develop & evaluate the treatment recommendation agent (TRA) based on NCCN guidelines, and develop an interactive interface to facilitate clinicians for accurate risk stratification and treatment recommendations at the point of care. Methods: This study included pts with locPCa (2004-2024) presenting at Mayo Clinic with at least 1 positive prostate biopsy and MRI report available. For RSA prospective validation, GPT4 extracted key phenotypic variables (PSA, T stage, prostate volume, number of cores, Gleason patterns, grade group) from unstructured MRI and biopsy reports using a zeroshot prompt. An RBA then classified pts into NCCN risk groups. The agent performance was compared with the treating clinician's documentation and evaluated against gold-standard labels manually annotated by two independent clinicians. For development of TRA, two experiments were performed using GPT4 with and without retrieval-augmented generation (RAG) to generate treatment plans. Generated treatment plans were evaluated using NCCN guideline-informed treatment decision tree based algorithm (DTA). Evaluation metrics, weighted – accuracy (acc) and F1, were computed. A clinician facing interface (lisr.org/risk) was developed to provide accurate risk stratification and treatment plans. Results: A total of 858 pts were included (500 for prospective validation, 358 for treatment recommendations). Prospective validation for RSA demonstrated a higher F1 score of 0.89 compared to the treating clinician (F1: 0.58). Treatment recommendation experiments showed that GPT4 with RAG achieved higher acc (64% full – all correct treatment options and 36% partial – at least 1 correct treatment option) compared to GPT4 alone (35% and 65%, respectively). Sensitivity analysis using DTA-informed GPT4 note generation achieved 94% full acc and 6% partial acc. GPT4 alone generated hallucinated treatment options in 71% of cases, while GPT4 with RAG reduced this to 32%. Conclusions: The multi-agent framework based on LLM and RBA achieves high accuracy in risk stratification and treatment recommendation for locPCa. A multi-agent framework with an interactive interface holds high promise to enable efficient, accurate decision-making, and improve locPCa management at the point of care Performance evaluation. RSA(acc; F1) % TRA(full acc; partial acc) % Clinician RSA* GPT4 RAG+GPT4 DTA+GPT4 Overall 60; 58 89; 89 29; 71 64; 36 94; 6 V. High 94; 33 96; 96 55; 45 69; 31 93; 7 High 46; 52 92; 89 - - - Int. Unf 80; 61 91; 90 5; 95 38; 62 93; 7 Int. Fav 57; 64 84; 87 0; 100 98; 2 100; 0 Low 57; 65 87; 80 100; 0 95; 5 90; 10 V. Low 8; 13 50; 67^ - - - *Statistical significance (p<0.01) except for ^V. Low.

Objective To define the natural history, patterns of recurrence and treatment modalities for local prostate cancer (PCa) recurrence following radical prostatectomy (RP) and radiation therapy (RT), and to investigate factors that could predict metastasis‐free survival (MFS) in this unique patient population. Methods We queried a prospectively maintained PCa registry to identify men developing in‐field recurrence (IFR) following RP and RT from 2008 to 2021 at a single institution. IFR was defined as biopsy‐proven recurrent PCa or the presence of persistent positron emission tomography‐avid lesions in the prior radiation field without evidence of metastasis. Cox regression was conducted to determine predictors of MFS. Kaplan–Meier methods were used to calculate MFS, cancer‐specific survival (CSS) and overall survival (OS) for patients in three primary therapy categories: cryoablation, androgen deprivation therapy (ADT) alone, and surveillance. Results Of 4575 patients from our registry, 108 (2.3%) with IFR were identified. The median (interquartile range [IQR]) time to IFR from salvage treatment was 78 (50–126) months. A total of 29 patients (26%) were managed with cryoablation, 23 (21%) with ADT, and 28 (25%) with surveillance. The median (IQR) follow‐up was 76 (48–100) months. There were no statistically significant differences in MFS ( P = 0.67) or OS ( P = 0.07) among the three primary treatment cohorts. Patients treated with ADT or cryoablation had longer CSS compared to patients managed with surveillance ( P = 0.047). Conclusions We found that IFR may present years after completion of primary treatment for PCa. While curative management strategies may be attempted, local and distant metastatic recurrence is common and often requires systemic therapy.

ImportanceThe BCG vaccine—used worldwide to prevent tuberculosis—confers multiple nonspecific beneficial effects, and intravesical BCG vaccine is currently the recommended treatment for non–muscle-invasive bladder cancer (NMIBC). Moreover, BCG vaccine has been hypothesized to reduce the risk of Alzheimer disease and related dementias (ADRD), but previous studies have been limited by sample size, study design, or analyses.ObjectiveTo evaluate whether intravesical BCG vaccine exposure is associated with a decreased incidence of ADRD in a cohort of patients with NMIBC while accounting for death as a competing event.Design, Setting, and ParticipantsThis cohort study was performed in patients aged 50 years or older initially diagnosed with NMIBC between May 28, 1987, and May 6, 2021, treated within the Mass General Brigham health care system. The study included a 15-year follow-up of individuals (BCG vaccine treated or controls) whose condition did not clinically progress to muscle-invasive cancer within 8 weeks and did not have an ADRD diagnosis within the first year after the NMIBC diagnosis. Data analysis was conducted from April 18, 2021, to March 28, 2023.Main Outcomes and MeasuresThe main outcome was time to ADRD onset identified using diagnosis codes and medications. Cause-specific hazard ratios (HRs) were estimated using Cox proportional hazards regression after adjusting for confounders (age, sex, and Charlson Comorbidity Index) using inverse probability scores weighting.ResultsIn this cohort study including 6467 individuals initially diagnosed with NMIBC between 1987 and 2021, 3388 patients underwent BCG vaccine treatment (mean [SD] age, 69.89 [9.28] years; 2605 [76.9%] men) and 3079 served as controls (mean [SD] age, 70.73 [10.00] years; 2176 [70.7%] men). Treatment with BCG vaccine was associated with a lower rate of ADRD (HR, 0.80; 95% CI, 0.69-0.99), with an even lower rate of ADRD in patients aged 70 years or older at the time of BCG vaccine treatment (HR, 0.74; 95% CI, 0.60-0.91). In competing risks analysis, BCG vaccine was associated with a lower risk of ADRD (5-year risk difference, −0.011; 95% CI, −0.019 to −0.003) and a decreased risk of death in patients without an earlier diagnosis of ADRD (5-year risk difference, −0.056; 95% CI, −0.075 to −0.037).Conclusions and RelevanceIn this study, BCG vaccine was associated with a significantly lower rate and risk of ADRD in a cohort of patients with bladder cancer when accounting for death as a competing event. However, the risk differences varied with time.