Psychometric Evaluation of the PRO-CTCAE Average Composite Score: Reliability, Responsiveness, Known-Groups Validity, and Sensitivity to Group Differences
Background/Objectives: The PRO-CTCAE Average Composite Score (ACS), calculated as the mean of PRO-CTCAE composite scores, summarizes overall symptom and side effect burden. This study evaluated the test–retest reliability, responsiveness to change, known-groups validity, and sensitivity to group differences in the ACS. Methods: Analyses used the original PRO-CTCAE validation dataset, including lung (n = 174), breast (n = 222), and head and neck (n = 139) cancer cohorts, and data from the COMET-2 randomized phase III trial comparing cabozantinib (n = 53) and mitoxantrone–prednisone (n = 54) in men with previously treated prostate cancer. Test–retest reliability was assessed using intraclass correlation coefficients (ICCs) from two-way mixed-effects models for agreement. Responsiveness was evaluated by relating ACS change scores (Visit 1 minus follow-up Visit 2) to patient-reported global ratings of change (GRC; worsened, unchanged, or improved) using standardized response means (SRMs) and Jonckheere–Terpstra trend tests. Known-groups validity was examined by comparing mean ACS values between ECOG performance status groups (0–1 vs. 2–4). Sensitivity to treatment group differences was assessed using model-based area-under-the-curve (AUC) comparisons of longitudinal ACS trajectories. Results: Test–retest reliability was acceptable, with ICCs among GRC-defined stable patients of 0.80 (95% CI: 0.70–0.87) in lung cancer, 0.84 (95% CI: 0.77–0.89) in breast cancer, and 0.77 (95% CI: 0.63–0.86) in head and neck cancer; ICCs based on assessments completed one day apart ranged from 0.88 to 0.90. The ACS demonstrated responsiveness, with SRMs of 0.30/0.15/−0.37 (lung), 0.29/0.14/−0.40 (breast), and −0.01/−0.20/−0.56 (head/neck) for improved/no-change/worsened groups, respectively, and significant monotonic trends across GRC categories (all p < 0.01). Known-groups validity was supported by conceptually expected differences in ACS values across distinct levels of self-reported patient-reported physical functioning and ECOG performance status categories. Mean ACS values were lower among patients with good versus limited physical functioning (0.71 vs. 1.23 in lung cancer, 0.52 vs. 1.19 in breast cancer, and 0.69 vs. 1.29 in head and neck cancer) and among patients with ECOG PS 0–1 versus 2–4 (0.93 vs. 1.31, 0.74 vs. 1.22, and 0.90 vs. 1.06, respectively). In COMET-2, higher symptom burden was detected in the cabozantinib arm compared with the mitoxantrone–prednisone arm (AUC difference = 1.5, 95% CI: 0.2–2.8, p = 0.02). Conclusions: The ACS demonstrated acceptable test–retest reliability, responsiveness, and known-groups validity across multiple cancer populations. These findings support its use as a complementary summary measure of overall symptomatic adverse event burden alongside individual symptom-level analyses.
Cancer CARE (Connected Access and Remote Expertise) Beyond Walls — Safety, Feasibility, and Patient Experience of Home-Based Chemotherapy
PURPOSE Hot flashes are a common side effect reported by men receiving androgen-deprivation therapy (ADT) for the treatment of prostate cancer. We sought to determine whether oxybutynin could improve hot flash symptoms in men with prostate cancer. PATIENTS AND METHODS Patients with prostate cancer receiving a stable regimen of ADT with at least 28 hot flashes per week were randomly assigned to receive either oxybutynin 2.5 mg twice daily, oxybutynin 5 mg twice daily, or matching placebo for 6 weeks. The primary end point was the change in patient-reported hot flash scores since baseline at 6 weeks. Additional outcomes included incidence of adverse events (AEs), changes since baseline in Hot Flash–Related Daily Interference Scale (HFRDIS) scores, and patient-reported symptoms. RESULTS Eighty-eight patients were enrolled, with the 81 participants eligible for final analysis reporting an average of 10.1 (standard deviation [SD], 5.55) hot flashes per day and an average daily hot flash score of 18.2 (SD, 13.5) included in final analysis. On average, patients on the placebo arm, 2.5 mg oxybutynin arm, and 5 mg oxybutynin arm had reductions in hot flashes/day of 2.15, 4.77 ( P = .02), and 6.89 ( P < .001), respectively. Daily hot flash scores for placebo, 2.5 mg oxybutynin, and 5 mg oxybutynin reduced by an average of 4.85, 9.94 ( P = .07), and 13.95 ( P = .002) points, respectively. No treatment-related grade 3+ AEs occurred. HFRDIS total scores improved by 14.2 and 20.7 points in the 2.5 mg ( P = .042) and 5 mg ( P < .01) oxybutynin arms, respectively, compared with a 3.1-point improvement with placebo. CONCLUSION Oxybutynin is superior to a placebo for the management of ADT-associated hot flashes in men with prostate cancer.
Psychometric Properties and Interpretability of PRO-CTCAE® Average Composite Scores as a Summary Metric of Symptomatic Adverse Event Burden
Background: The PRO-CTCAE provides patient-reported data on symptomatic AEs. A summary metric—the ACS—reflecting total AE burden can be calculated by averaging AE-level composite scores at a given timepoint for each participant. This study investigated the psychometric properties and interpretability of this PRO-CTCAE ACS in patients with breast, lung, or head/neck cancers. Methods: We conducted a secondary analysis of a PRO-CTCAE validation dataset comprising 940 adults undergoing chemotherapy or radiation therapy (clinicaltrials.gov: NCT02158637). We focused on empirically recommended symptom terms for three cancer sites. Analyses included Spearman’s correlations, coefficient alpha, and eigenvalues from the correlation matrices, confirmatory factor analysis (CFA), and principal component analysis (PCA). Latent profile analysis (LPA) was used to assess ACS interpretability in the lung cohort. Results: Mean composite score inter-correlations were moderate (0.30–0.35), and coefficient alphas were high (0.81–0.91). Eigenvalue ratios and CFA supported retention of a single factor/component, with suitable model fit indices. ACS correlated highly with factor scores and the first principal component from the PCA. Reduced sets of terms produced reliable scores that closely approximated the full set scores and aligned with external criteria. LPA in the lung subgroup identified four latent classes; ACS differentiated high vs. low symptom burden groups but did not distinguish the two groups expressing distinct symptom profiles. Conclusion: The ACS demonstrated structural validity through adequately fitting linear factor models and effectively summarized symptomatic AE burden. However, similar ACS values may mask clinically distinct symptomatic AE profiles, underscoring the value of both summary metrics and profile-based approaches.
Methods for implementing and reporting the Patient‐Reported Outcomes version of the Common Terminology Criteria for Adverse Events to measure patient‐reported adverse events in cancer clinical trials
Abstract The Patient‐Reported Outcomes version of the Common Terminology Criteria for Adverse Events (PRO‐CTCAE) was developed by the US National Cancer Institute to allow patients to directly report their side effects, enhancing the accuracy and patient‐centeredness of cancer clinical trial adverse event reporting. Clinician‐based reporting often misses the full range of patient symptoms, resulting in underreporting of side effects. The selection of adverse events for patient reporting must be defined in advance and consistently applied across all study arms. Investigators can use core symptom sets, including diarrhea, fatigue, and nausea, alongside tailored items specific to the treatments being studied. PRO‐CTCAE has demonstrated similar scores across electronic, paper‐based, and automated telephone administration methods. PRO‐CTCAE administration typically occurs before start of treatment and regularly throughout treatment, with the administration frequency tailored to the expected trajectory of side effects. Ensuring high survey completion rates is essential for PRO‐CTCAE success. Standard reporting can include tabular reporting of the proportion of patients with any (score ≥1) and high (score ≥3) levels of symptoms at the individual item level. A baseline‐adjustment approach should be applied to account for symptoms before start of treatment to isolate treatment‐emergent adverse events. The distribution of PRO‐CTCAE scores at each time point can be visualized using stacked bar charts. PRO‐CTCAE integration into cancer clinical trials is crucial for capturing a comprehensive range of treatment‐related symptomatic adverse events and improving the evaluation of therapy tolerability. Ongoing research continues to refine its implementation, supported by regulatory guidance.
Randomized Phase II Trial of Pazopanib Versus Placebo in Patients With Advanced Extrapancreatic Neuroendocrine Tumors (Alliance A021202)
PURPOSE Patients with advanced, well-differentiated extrapancreatic neuroendocrine tumors (epNETs) have limited systemic treatment options. Pazopanib, an oral multikinase inhibitor with activity against vascular endothelial growth factor receptor (VEGFR)-2 and -3, PDGFR-alpha and-beta, and c-Kit, was tested for efficacy in epNET. PATIENTS AND METHODS We conducted a multicenter, randomized, double-blind, phase II study of pazopanib (800 mg once daily) versus placebo in low- to intermediate-grade epNET with radiologic progressive disease (PD) within 12 months of study entry. Previous somatostatin analog (SSA) was required for midgut tumors, and concurrent SSA was allowed. The primary end point was progression-free survival (PFS) by blinded independent central review. Unblinding and crossover were allowed if PD was confirmed by central review. RESULTS One hundred seventy-one patients (97 pazopanib and 74 placebo) were randomly assigned between September 2013 and October 2015. The majority had a midgut primary site (75%) and previous SSA treatment (93%). About half (49%) of the patients had functional tumors. The median follow-up was 61 months (95% CI, 60 to 63). Median PFS was 11.8 versus 7.6 months in pazopanib versus placebo, respectively (hazard ratio, 0.54 [95% CI, 0.37 to 0.79]; P < .001); 49 placebo patients crossed over to pazopanib. There was no significant difference in overall survival between the treatment arms. Rates of grade 3 or greater adverse events (regardless of attribution) were higher in pazopanib versus placebo (84% v 47%; P < .001), as were grade 5 death events (8% v 0%, P = .017). CONCLUSION Pazopanib compared with placebo significantly improves PFS in patients with progressive epNET, confirming that the VEGF signaling pathway is a valid target for therapy in epNET. However, after integrating the associated risks relative to the benefits, further development of pazopanib in this clinical context is not planned.
Expected vs observed effect sizes for survival endpoints in phase 3 oncology trials
Abstract More than half of randomized phase 3 oncology trials fail to meet their primary endpoints, often despite favorable results from phase 1 and phase 2 trials. One potential reason for this high failure rate is effect size selection practices for powering these trials. In a systematic review of phase 3 oncology trials published in 10 top medical journals in 2023, we identified a pattern of effect size overestimation for survival endpoints, where the expected hazard ratios (average HR = 0.66) were stronger than those observed in the primary analyses (average HR = 0.72; 2-sided signed-rank test P = .0035). Across 111 trials, 82 of 143 (57.3%) observed hazard ratios for primary survival endpoints were weaker than expected; among 5 journals with 2023 impact factors between 9.9 and 56.7 (vs 58.7-98.4 for the top 5 journals), this ratio was 70.2% (59/84). These results suggest that phase 3 oncology trials are likely underpowered, contributing to the high failure rates in oncology research.
Cancer Care Beyond Walls (CCBW): A randomized pragmatic trial of home-based versus in-clinic cancer therapy administration.
LBA1551 Background: Traditional cancer therapy is primarily delivered in clinical settings, imposing logistical, emotional, and financial burdens, particularly on rural and underserved patients. While international studies have demonstrated the safety of home-based chemotherapy, no randomized U.S. trials have evaluated this approach. Mayo Clinic’s CCBW program aims to expand access to high-quality cancer care by providing in-home cancer treatment, lab testing, telemedicine, remote patient monitoring, command center and paramedic support. This pragmatic randomized controlled trial evaluates feasibility and impact of home-based versus in-clinic cancer directed therapy on patient preference, acceptability, safety, and patient-reported outcomes. Methods: Adult patients (ECOG 0-2) receiving chemotherapy or hormonal therapy at Mayo Clinic Florida were randomized 1:1 after confirmation of treatment tolerance in clinic to receive (1) home-based care for 24 weeks or (2) in-clinic care for 8 weeks followed by home-based care for 16 weeks. Target accrual is 200 patients. A planned interim analysis after 50 enrollments assessed accrual, data completeness, technical challenges, safety, and study outcomes. The primary endpoint is patient ratings of their overall cancer care experience (0–10 scale, CAHPS Cancer Care Survey) at 8 weeks. 200 patients provide 80% power to detect a 0.45 standard deviation difference in mean ratings between arms with a 2-sided 2-sample t-test (α=0.05) and 20% missing data rate. Secondary endpoints are patient preference, comfort with home infusions, treatment worthwhileness, functional/symptom assessments (EORTC QLQ-F17, PRO-CTCAE, GP5), grade ≥3 AEs, hospitalizations, and overall survival. Cost is a tertiary endpoint. The trial is IRB-approved (#23001719) and registered (NCT05969860). Results: Enrollment began 8/23/23. As of 2/21/25, 52 patients (26 per arm) were enrolled and 36 started protocol treatment. Common cancers were breast (38%), colorectal (21%), prostate (19%), and multiple myeloma (14%). 64% (28/44) of patients were female; 84% identified as White, 14% as Black, and 2% as multiple races. Median distance to clinic was 20 miles (range 2-66). After 8 weeks, patients in both arms rated their overall cancer care experience highly (mean [SD]=9.69 [0.85] versus 9.54 [0.66] for home-based vs. in-clinic care, n=26). After 24 weeks, 73% preferred home-based care, 18% had no preference, and 9% preferred in-clinic care; 100% felt comfortable with home infusions. No grade ≥3 AEs related to location of care have occurred. Conclusions: Early findings support the feasibility, safety, and high patient acceptability of home-based cancer therapy. No safety concerns related to care location were observed and most patients preferred home-based treatment. Ongoing accrual and analysis will assess clinical outcomes and cost implications. Clinical trial information: NCT05969860 .
A pilot single-arm, pragmatic trial in progress of in-home versus in-clinic subcutaneous nivolumab administration through Cancer Care (connected access and remote expertise) Beyond Walls (CCBW) program.
TPS1657 Background: Cancer treatments are traditionally administered in clinical settings, which can isolate patients from their familiar environments and exacerbate physical, psychosocial, and financial burdens. Travel requirements further amplify these challenges, particularly for underserved populations. Studies indicate that patients prefer receiving care at home, and international models have demonstrated the safety of home-delivered chemotherapy since the 1990s; however, no U.S. clinical trial data exists. In response, Mayo Clinic has developed the Cancer CARE (Connected Access and Remote Expertise) Beyond Walls (CCBW) program, a distributed cancer care delivery model that expands access to quality cancer care by bringing it to the home environment, providing in-home cancer treatment, lab testing, telemedicine, and community paramedic support. This trial evaluates the safety, acceptability, and impact of home-based subcutaneous (SC) nivolumab (Nivo) administration compared to in-clinic treatment within the CCBW initiative. Methods: This open-label, single-arm trial evaluates the impact of SC Nivo administration location—home versus infusion center—on patient reported cancer care experience, patient-preferred treatment location, acceptability, safety, and patient-reported outcomes. Eligible adult patients (ECOG 0-1) receiving IV Nivo for an FDA-approved indication and residing within 75 miles of Mayo Clinic Florida will transition to SC Nivo, receiving two initial in-clinic cycles. If tolerated without injection reactions, four cycles will be administered at home before resuming in-clinic treatment. Exclusion criteria include concurrent investigational/standard treatments or contraindications to immunotherapy. Fifty patients will be enrolled, with an estimated 75% (n=38) providing cancer care ratings after 8 weeks in-clinic and 8 weeks at-home, offering 85% power to detect a mean difference in ratings of 0.50 standard deviations. The primary endpoint is within-patient change in cancer care rating (0–10 scale, CAHPS Cancer Care Survey) comparing 8 weeks of in-clinic vs. at-home care. Secondary endpoints include patient-preferred treatment location, comfort with home injections, safety (grade 3+ adverse events), function (EORTC QLQ-F17), symptoms (PRO-CTCAE), side effect impact (GP5), and healthcare utilization (ER visits, hospitalizations). Cost will be assessed as a tertiary endpoint. The trial has FDA approval (IND #170079), Mayo Clinic IRB approval (#23009663), and ClinicalTrials.gov registration (NCT06265285). Enrollment began in April 2024, with an expected accrual period of 24 months. To date, 10 patients have been enrolled, and final analysis is expected 2.5 years after trial activation. Clinical trial information: NCT06265285 .
Self-reported adherence to cancer therapy: Development and validation of a cancer-specific DOSE-Nonadherence measure.
11106 Background: Patients with cancer take different types of medication (e.g., enteral, parenteral), with varying treatment schedules, in various settings. They are also sometimes instructed to stop medication in response to toxicity. To measure medication nonadherence in this heterogenous population, we modified and pilot-tested a self-report measure originally developed to assess nonadherence to daily oral medication, the Domains of Subjective Extent of Nonadherence (DOSE-Nonadherence), in adults with cancer. Methods: Participants were ≥21 years, on active cancer treatment at Memorial Sloan Kettering, and spoke English and/or Spanish. A branching logic was added to allow participants to select the setting where they take cancer medication: 1) only at home, 2) only in clinic, or 3) partly at home/partly in clinic. Based on administration setting, participants reported nonadherence to medications their clinician expected them to take over a given reference period (1 week for home and 1 month for clinic medications). Participants then reported on setting-relevant reasons for nonadherence. Survey instructions/items were refined in an iterative process using feedback from a patient investigator committee and participant cognitive interviews. During interviews, we asked participants about the interpretation of instructions/items, recall period, and comprehensiveness of reasons for nonadherence, regardless of their own adherence. After initial testing in English, a Spanish version was developed through transcreation. Adherence was dichotomized for analysis (complete adherence vs. any nonadherence). For all participants who received clinic medications, concordance between chart abstracted and self-reported adherence was evaluated. Results: Of 55 participants who completed the surveys and interviews (67% in English; 33% in Spanish), 87% were female and 44% identified as Latino. The majority (73%) had breast cancer; 60% had metastatic disease. 12 of 45 who received medication in clinic reported nonadherence as did 8 of 35 who took medication at home. Participants felt able to respond accurately to both recall periods. All reasons for nonadherence were perceived as relevant to themselves or other patients. There was 89% concordance between self-reported and chart abstracted adherence for clinic-administered medication. To improve concordance, changes were made to the formatting and instructions. Of 12 participants who completed the final version of the survey for clinic-administered medication, there was 100% concordance between self-reported and chart abstracted nonadherence. Conclusions: Our results support the reliability and validity of modified DOSE-Nonadherence for cancer patients. This instrument can be used to better identify nonadherence to cancer medications in a population of adult patients with cancer receiving various treatment regimens.