Citations 17

Psychometric Evaluation of the PRO-CTCAE Average Composite Score: Reliability, Responsiveness, Known-Groups Validity, and Sensitivity to Group Differences

Cancers | July 16, 2026 | Volume: 18 | Issue: 14 | Pages: 2265

10.3390/cancers18142265 | PMID 42512331

Background/Objectives: The PRO-CTCAE Average Composite Score (ACS), calculated as the mean of PRO-CTCAE composite scores, summarizes overall symptom and side effect burden. This study evaluated the test–retest reliability, responsiveness to change, known-groups validity, and sensitivity to group differences in the ACS. Methods: Analyses used the original PRO-CTCAE validation dataset, including lung (n = 174), breast (n = 222), and head and neck (n = 139) cancer cohorts, and data from the COMET-2 randomized phase III trial comparing cabozantinib (n = 53) and mitoxantrone–prednisone (n = 54) in men with previously treated prostate cancer. Test–retest reliability was assessed using intraclass correlation coefficients (ICCs) from two-way mixed-effects models for agreement. Responsiveness was evaluated by relating ACS change scores (Visit 1 minus follow-up Visit 2) to patient-reported global ratings of change (GRC; worsened, unchanged, or improved) using standardized response means (SRMs) and Jonckheere–Terpstra trend tests. Known-groups validity was examined by comparing mean ACS values between ECOG performance status groups (0–1 vs. 2–4). Sensitivity to treatment group differences was assessed using model-based area-under-the-curve (AUC) comparisons of longitudinal ACS trajectories. Results: Test–retest reliability was acceptable, with ICCs among GRC-defined stable patients of 0.80 (95% CI: 0.70–0.87) in lung cancer, 0.84 (95% CI: 0.77–0.89) in breast cancer, and 0.77 (95% CI: 0.63–0.86) in head and neck cancer; ICCs based on assessments completed one day apart ranged from 0.88 to 0.90. The ACS demonstrated responsiveness, with SRMs of 0.30/0.15/−0.37 (lung), 0.29/0.14/−0.40 (breast), and −0.01/−0.20/−0.56 (head/neck) for improved/no-change/worsened groups, respectively, and significant monotonic trends across GRC categories (all p < 0.01). Known-groups validity was supported by conceptually expected differences in ACS values across distinct levels of self-reported patient-reported physical functioning and ECOG performance status categories. Mean ACS values were lower among patients with good versus limited physical functioning (0.71 vs. 1.23 in lung cancer, 0.52 vs. 1.19 in breast cancer, and 0.69 vs. 1.29 in head and neck cancer) and among patients with ECOG PS 0–1 versus 2–4 (0.93 vs. 1.31, 0.74 vs. 1.22, and 0.90 vs. 1.06, respectively). In COMET-2, higher symptom burden was detected in the cabozantinib arm compared with the mitoxantrone–prednisone arm (AUC difference = 1.5, 95% CI: 0.2–2.8, p = 0.02). Conclusions: The ACS demonstrated acceptable test–retest reliability, responsiveness, and known-groups validity across multiple cancer populations. These findings support its use as a complementary summary measure of overall symptomatic adverse event burden alongside individual symptom-level analyses.
Psychometric Properties and Interpretability of PRO-CTCAE® Average Composite Scores as a Summary Metric of Symptomatic Adverse Event Burden

Cancers | October 28, 2025 | Volume: 17 | Issue: 21 | Pages: 3459

10.3390/cancers17213459 | PMID 41228252

Background: The PRO-CTCAE provides patient-reported data on symptomatic AEs. A summary metric—the ACS—reflecting total AE burden can be calculated by averaging AE-level composite scores at a given timepoint for each participant. This study investigated the psychometric properties and interpretability of this PRO-CTCAE ACS in patients with breast, lung, or head/neck cancers. Methods: We conducted a secondary analysis of a PRO-CTCAE validation dataset comprising 940 adults undergoing chemotherapy or radiation therapy (clinicaltrials.gov: NCT02158637). We focused on empirically recommended symptom terms for three cancer sites. Analyses included Spearman’s correlations, coefficient alpha, and eigenvalues from the correlation matrices, confirmatory factor analysis (CFA), and principal component analysis (PCA). Latent profile analysis (LPA) was used to assess ACS interpretability in the lung cohort. Results: Mean composite score inter-correlations were moderate (0.30–0.35), and coefficient alphas were high (0.81–0.91). Eigenvalue ratios and CFA supported retention of a single factor/component, with suitable model fit indices. ACS correlated highly with factor scores and the first principal component from the PCA. Reduced sets of terms produced reliable scores that closely approximated the full set scores and aligned with external criteria. LPA in the lung subgroup identified four latent classes; ACS differentiated high vs. low symptom burden groups but did not distinguish the two groups expressing distinct symptom profiles. Conclusion: The ACS demonstrated structural validity through adequately fitting linear factor models and effectively summarized symptomatic AE burden. However, similar ACS values may mask clinically distinct symptomatic AE profiles, underscoring the value of both summary metrics and profile-based approaches.
Establishing the content validity of patient-reported outcome measures used in neuro-oncology based on the WHO ICF framework: Part of the RANO-PRO initiative

Neuro-Oncology | April 28, 2025 | Volume: 27 | Issue: 9 | Pages: 2399-2414

10.1093/neuonc/noaf108 | PMID 40293144

Abstract Background Instruments to assess patient-reported outcomes (PRO) should generate high-quality evidence. Reliable PRO evidence is essential to policymakers, in conjunction with outcomes such as survival and radiological response, to understand the net clinical benefit of antitumor treatments. This study aimed to establish the content validity of 215 identified PRO measures used in patients with brain tumors. Methods A survey (n = 148 items) was developed reflecting aspects of the WHO International Classification of Functioning, Disability, and Health (ICF) framework. Patients with brain tumors, their proxies, and healthcare professionals (HCPs) were asked to rate each survey item on relevance. An item was considered a relevant issue if ≥25% of the patients or proxies or ≥50% of the HCPs considered that item to be an issue. Next, all items in the identified PRO measures were linked to ICF and relevant items in the survey, and the percentage of content coverage was calculated. Results In total, 114 patients, 71 proxies, and 65 HCPs from different countries completed the survey. Fifty-six of 148 (37.8%) items in the survey were considered relevant. The most important aspects mentioned by both patients and proxies were difficulty concentrating, difficulty remembering, multitasking, and handling stress. Depending on the definition, between 35% and 49% of PRO measures were considered to have sufficient content validity (≥80% coverage). Conclusion The content validity was insufficient in more than half of the identified PRO measures, particularly multidimensional measures. Future research should investigate whether different approaches to PRO assessment better meet the needs of all stakeholders.
Prevalence of symptomatic toxicities for novel therapies in adult oncology trials: a scoping review

JNCI Cancer Spectrum | March 31, 2025 | Volume: 9 | Issue: 3 | Pages: No page available

10.1093/jncics/pkaf036 | PMID 40152251

Abstract Background Patients’ self-report of their symptoms can provide important data for the evaluation of treatment benefit and tolerability of oncology drugs. Contemporary treatment approaches, including immunotherapy and molecular targeted therapies, have unique toxicities based on their novel mechanisms of action. This scoping review aimed to summarize evidence from existing reviews and clinical practice guidelines to examine the type and prevalence of toxicities including symptomatic adverse events (sympAEs) for adult cancer patients to inform clinical care and therapeutic trials. Methods A systematic search of PubMed, Web of Science, and Embase was performed using predefined eligibility criteria. Thirty-one literature reviews and 3 clinical practice guidelines met inclusion criteria and were selected for review and data abstraction. Results Findings from this scoping review demonstrated several leading sympAEs that were reported across immunotherapy and targeted therapy drugs, including fatigue, diarrhea, and rash. In addition to these more prevalent sympAEs, there were some less frequently reported class-specific sympAEs, which had potential for significant harm or disability to the patient if not properly identified and treated. Many studies reported toxicities as AEs or syndromes solely using data reported by clinicians without additional self-report from patients. Conclusion We identified several core sympAEs experienced by patients participating in oncology trials using immunotherapy and targeted therapy agents, which has implications for future trial design and drug labeling. Future cancer trials should assess patient-reported sympAEs based on the identified drug mechanism to inform the tolerability of these newer agents and enhance patient safety during trial participation and clinical care.
Statistical properties of items and summary scores from the Patient-Reported Outcomes version of the Common Terminology Criteria for Adverse Events (PRO-CTCAE ® ) in a diverse cancer sample

Clinical Trials | October 23, 2024 | Volume: 22 | Issue: 2 | Pages: 161-169

10.1177/17407745241286065 | PMID 39440720

Background/Aims: The Patient-Reported Outcomes version of the Common Terminology Criteria for Adverse Events (PRO-CTCAE ® ) was developed to capture symptomatic adverse events from the patient perspective. We aim to describe statistical properties of PRO-CTCAE items and summary scores and to provide evidence for recommendations regarding PRO-CTCAE administration and reporting. Methods: Using data from the PRO-CTCAE validation study (NCT02158637), prevalence, means, and standard deviations of PRO-CTCAE items, composite scores, and mean and maximum scores across attributes (frequency, severity, and/or interference) of symptomatic adverse events were calculated. For each adverse event, correlations and agreement between attributes, correlations between attributes and composite scores, and correlations between composite, mean, and maximum scores were estimated. Results: PRO-CTCAE items were completed by 899 patients with various cancer types. Most patients reported experiencing one or more adverse events, with the most prevalent being fatigue (87.7%), sad/unhappy feelings (66.0%), anxiety (63.6%), pain (63.2%), insomnia (61.8%), and dry mouth (60.0%). Attributes were moderately to strongly correlated within an adverse event ( r = 0.53 to 0.77, all p < 0.001) but not fully concordant (κ weighted = 0.26 to 0.60, all p < 0.001), with interference demonstrating lowest mean scores and prevalence among attributes of the same adverse event. Attributes were moderately to strongly correlated with composite scores ( r = 0.67 to 0.97, all p < 0.001). Composite scores were moderately to strongly correlated with mean and maximum scores for the same adverse event ( r = 0.69 to 0.94, all p < 0.001). Correlations between composite scores of different adverse events varied widely ( r = 0.04 to 0.68) but were moderate to strong for conceptually related adverse events. Conclusions: Results provide evidence for PRO-CTCAE administration and reporting recommendations that the full complement of attributes be administered for each adverse event, and that attributes as well as summary scores be reported.
Trans-Pacific Multicenter Collaborative Study of Minimally Invasive Proximal Versus Total Gastrectomy for Proximal Gastric and Gastroesophageal Junction Cancers

No container title available | January 5, 2023 | Volume: No volume available | Issue: No issue available | Pages: No page available

10.21203/rs.3.rs-1805561/v1

Abstract Background: The current standard operation for proximal gastric and gastroesophageal junction (P/GEJ) cancers with limited esophageal extension is total gastrectomy (TG). TG is associated with impaired appetite and weight loss, which is caused by a decreased level of ghrelin and anemia due to intrinsic factor loss and vitamin B12 malabsorption. Theoretically, proximal gastrectomy (PG) can mitigate these problems by preserving gastric function. However, PG with direct esophagogastric reconstruction is associated with severe postoperative reflux, delayed gastric emptying, and poor quality of life (QoL). Minimally invasive PG (MIPG) with antireflux techniques has been increasingly performed by experts but is technically demanding owing to its complexity. Moreover, the actual advantages of MIPG over minimally invasive TG (MITG) with regards to postoperative QoL are unknown. Our overall objective of this study is to determine the short-term QoL benefits of MIPG. Our central hypotheses are that MIPG is safe and that patients have improved appetite after MIPG with effective antireflux techniques, which leads to an overall QoL improvement when compared with MITG. Methods: Enrollment of a total of 60 patients in this prospective survey-collection study is expected. Procedures (MITG versus MIPG, antireflux techniques for MIPG [double-tract reconstruction versus the double-flap technique]) will be chosen based on surgeon and/or patient preference. Randomization is not considered feasible because patients often have strong preferences regarding MITG and MIPG. The primary outcome is appetite level (reported on a 0-10 scale) at 3 months after surgery. With an expected 30 patients per cohort (MITG versus MIPG), this study will have 80% power to detect a one-point difference in appetite level. Patient-reported outcomes will be longitudinally collected (including questions about appetite and reflux), and specific QoL items, body weight, body mass index and ghrelin, albumin, and hemoglobin levels will be compared. Discussion: Surgeons from the US, Japan, and South Korea formed this collaboration with the agreement that the surgical approach to P/GEJ cancers is an internationally important but controversial topic that requires immediate action. At the completion of the proposed research, our expected outcome is the establishment of the benefit and safety of MIPG. Trial Registration Number: This trial was registered with Clinical Trials Reporting Program Registration under the registration number NCI-2022-00267 on January 11, 2022, as well as with ClinicalTrials.gov under the registration number NCT05205343 on January 11, 2022.
Effects of patient-reported outcome assessment order

Clinical Trials | January 28, 2022 | Volume: 19 | Issue: 3 | Pages: 307-315

10.1177/17407745211073788 | PMID 35088616

Background In clinical trials and clinical practice, patient-reported outcomes are almost always assessed using multiple patient-reported outcome measures at the same time. This raises concerns about whether patient responses are affected by the order in which the patient-reported outcome measures are administered. Methods This questionnaire-based study of order effects included adult cancer patients from five cancer centers. Patients were randomly assigned to complete questionnaires via paper booklets, interactive voice response system, or tablet web survey. Linear Analogue Self-Assessment, Patient-Reported Outcomes Version of the Common Terminology Criteria for Adverse Events, and Patient-Reported Outcomes Measurement Information System assessment tools were each used to measure general health, physical function, social function, emotional distress/anxiety, emotional distress/depression, fatigue, sleep, and pain. The order in which the three tools, and domains within tools, were presented to patients was randomized. Rates of missing data, scale scores, and Cronbach’s alpha coefficients were compared by the order in which they were assessed. Analyses included Cochran–Armitage trend tests and mixed models adjusted for performance score, age, sex, cancer type, and curative intent. Results A total of 1830 patients provided baseline patient-reported outcome assessments. There were no significant trends in rates of missing values by whether a scale was assessed earlier or later. The largest order effect for scale scores was due to a large mean score at one assessment time point. The largest difference in Cronbach’s alpha between the versions for the Patient-Reported Outcomes Measurement Information System scales was 0.106. Conclusion The well-being of a cancer patient has many different aspects such as pain, fatigue, depression, and anxiety. These are assessed using a variety of surveys often collected at the same time. This study shows that the order in which the different aspects are collected from the patient is not important.
Systematic review on the use of patient-reported outcome measures in brain tumor studies: part of the Response Assessment in Neuro-Oncology Patient-Reported Outcome (RANO-PRO) initiative

Neuro-Oncology Practice | February 14, 2021 | Volume: 8 | Issue: 4 | Pages: 417-425

10.1093/nop/npab013 | PMID 34277020

Abstract Background The Response Assessment in Neuro-Oncology Patient-Reported Outcome (RANO-PRO) working group aims to provide guidance on the use of PROs in brain tumor patients. PRO measures should be of high quality, both in terms of relevance and other measurement properties. This systematic review aimed to identify PRO measures that have been used in brain tumor studies to date. Methods A systematic literature search for articles published up to June 25, 2020 was conducted in several electronic databases. Pre-specified inclusion criteria were used to identify studies using PRO measures assessing symptoms, (instrumental) activities of daily living [(I)ADL] or health-related quality of life (HRQoL) in adult patients with glioma, meningioma, primary central nervous system lymphoma, or brain metastasis. Results A total of 215 different PRO measures were identified in 571 published and 194 unpublished studies. The identified PRO measures include brain tumor-specific, cancer-specific, and generic instruments, as well as instruments designed for other indications or multi- or single-item study-specific questionnaires. The most frequently used instruments were the EORTC QLQ-C30 and QLQ-BN20 (n = 286 and n = 247), and the FACT-Br (n = 167), however, the majority of the instruments were used only once or twice (150/215). Conclusion Many different PRO measures assessing symptoms, (I)ADL or HRQoL have been used in brain tumor studies to date. Future research should clarify whether these instruments or their scales/items exhibit good content validity and other measurement properties for use in brain tumor patients.
Composite grading algorithm for the National Cancer Institute’s Patient-Reported Outcomes version of the Common Terminology Criteria for Adverse Events (PRO-CTCAE)

Clinical Trials | December 1, 2020 | Volume: 18 | Issue: 1 | Pages: 104-114

10.1177/1740774520975120 | PMID 33258687

Background: The Patient-Reported Outcomes version of the Common Terminology Criteria for Adverse Events is an item library designed for eliciting patient-reported adverse events in oncology. For each adverse event, up to three individual items are scored for frequency, severity, and interference with daily activities. To align the Patient-Reported Outcomes version of the Common Terminology Criteria for Adverse Events with other standardized tools for adverse event assessment including the Common Terminology Criteria for Adverse Events, an algorithm for mapping individual items for any given adverse event to a single composite numerical grade was developed and tested. Methods: A five-step process was used: (1) All 179 possible Patient-Reported Outcomes version of the Common Terminology Criteria for Adverse Events score combinations were presented to 20 clinical investigators to subjectively map combinations to single numerical grades ranging from 0 to 3. (2) Combinations with <75% agreement were presented to investigator committees at a National Clinical Trials Network cooperative group meeting to gain majority consensus via anonymous voting. (3) The resulting algorithm was refined via graphical and tabular approaches to assure directional consistency. (4) Validity, reliability, and sensitivity were assessed in a national study dataset. (5) Accuracy for delineating adverse events between study arms was measured in two Phase III clinical trials (NCT02066181 and NCT01522443). Results: In Step 1, 12/179 score combinations had <75% initial agreement. In Step 2, majority consensus was reached for all combinations. In Step 3, five grades were adjusted to assure directional consistency. In Steps 4 and 5, composite grades performed well and comparably to individual item scores on validity, reliability, sensitivity, and between-arm delineation. Conclusion: A composite grading algorithm has been developed and yields single numerical grades for adverse events assessed via the Patient-Reported Outcomes version of the Common Terminology Criteria for Adverse Events, and can be useful in analyses and reporting.
Composite grading algorithm for National Cancer Institute’s PRO-CTCAE.

Journal of Clinical Oncology | May 25, 2020 | Volume: 38 | Issue: 15_suppl | Pages: 7018-7018

10.1200/jco.2020.38.15_suppl.7018

7018 Background: Standard reporting of symptomatic adverse events (AEs) in oncology relies on clinicians to rate patient (pt) experience using CTCAE; each symptom is represented by a single graded item. To capture direct pt experience, NCI developed PRO-CTCAE to supplement CTCAE. In PRO-CTCAE, the pt answers up to 3 questions per AE about a symptom’s frequency, severity and interference with daily activities. To align PRO-CTCAE with CTCAE, we developed an algorithm for mapping sets of questions for an AE to a single composite numerical grade. Methods: We used a 5-step process. (1) All 187 possible PRO-CTCAE score permutations were presented to clinical investigators to subjectively map permutations to single numerical grades (range 0-3). (2) Permutations with < 75% agreement were presented to investigator committees at a National Clinical Trials Network meeting to gain majority consensus via anonymous voting. (3) The resulting algorithm was refined via graphical and tabular approaches to assure directional consistency. (4) Validity, reliability and sensitivity were assessed in a national study dataset. (5) Accuracy for delineating AEs between study arms was measured in 2 phase III clinical trials (Alliance for Clinical Trials in Oncology A091105 and Exelixis COMET-2). Results: (1) 12/187 score permutations had < 75% initial agreement. (2) Majority consensus was reached for all permutations. (3) 5 mappings were adjusted to assure directional consistency. (4) Composite grades for 46/59 (78%) AEs were higher in pts with ECOG performance status 2-4 vs 0-1 (median effect size 0.23 [range -0.49-0.73]; 32/59 effect size ≥0.2; 25/59 p< 0.05), similar to when conducting analysis on individual unmapped items. The test-retest reliability for 24 selected composite grades ranged from 0.57-0.96 (median intraclass correlation coefficient [ICC] 0.77) with 18/24 (75%) grades having ICC ≥0.7. Median (range) standardized response means in pts reporting worsening, no change, and improvement were 0.20 (0.03-0.34), -0.06 (-0.20-0.03) and -0.12 (-0.32-0.06). (5) Pattern, directionality and statistical significance of between-arm differences in both trials were preserved with composite grades as compared to individual unmapped items. Conclusions: A composite grading algorithm for PRO-CTCAE was rigorously developed and validated. PRO-CTCAE composite grades may be useful in analyses to provide a single metric for each pt-reported AE for trial and real-world reporting. Support: UG1CA189823; U01CA233046; HHSN261200800043C; Bayer (A091105); https://acknowledgments.alliancefound.org .