Portelli, Joseph

Abstract Changes in the clinical symptoms of acute graft-versus-host disease (GVHD) are currently used to assess treatment responses. The Mount Sinai Acute GVHD International Consortium (MAGIC) consortium has recently revealed that the integration of serum biomarkers with clinical symptoms at the onset of treatment in a MAGIC composite score (MCS) more accurately predicts treatment response and 6-month nonrelapse mortality (NRM) than clinical symptoms alone. In this study, we evaluated whether the integration of serum biomarkers and clinical symptoms on day 28 (D28) would also better predict NRM than clinical response only (CRO). We analyzed data from 1135 patients receiving systemic treatment for acute GVHD and created a fourth MCS category for patients with complete resolution of symptoms and low-risk clinical biomarkers on D28. Using a classification and regression tree model with 6-month NRM as the end point, we identified status of MCS 0 or MCS 1 at D28 as responses, which we termed the MAGIC composite response (MCR). In the validation cohort (n = 309), MCR more accurately predicted 6-month NRM than CRO (area under the curve: 0.77 vs 0.69; P = .014) and demonstrated higher negative and positive predictive values. MCR correctly reclassified both clinical nonresponders and responders: 28 of 213 clinical responders (13%) became nonresponders with fivefold higher NRM (34.3% vs 6.8%, P < .001) and a larger group (29/96, 30%) of clinical nonresponders became responders with sixfold lower NRM (7.6% vs 50.7%, P < .001). These findings support the use of MCR as a superior surrogate end point for long-term GVHD control and survival in future clinical trials.

The overall response rate (ORR) 28 days (D28) after treatment has been adopted as the primary endpoint for clinical trials of acute graft versus host disease (GVHD). ORR combines complete response (CR) and partial response (PR) because CR and PR have very similar non relapse mortality (NRM). D28 ORR has some disadvantages: first, physicians usually decide to modify immunosuppression much earlier than D28, and second, NRM does not always correlate well with ORR at D28, particularly for patients who present with intermediate risk or low risk disease. MAGIC serum biomarkers at day 14 (D14) of GVHD treatment have been shown to correlate better with NRM than clinical symptom response (Srinagesh et al, Blood Advances, 2019). We therefore hypothesized that a combination of clinical symptom severity and biomarkers at D14 of treatment would predict NRM at least as well and possibly better than clinical response at D28. We studied 1144 patients from 23 MAGIC sites who were systemically treated with at least 0.25 mg/kg/day of systemic steroids (prednisone equivalents) and had clinical data and serum samples available in the MAGIC database and biorepository. We divided the patients into a training set (n=764) and a validation set (n=380). We used 12-month NRM from the time of acute GVHD onset as the primary outcome of interest. We first trained a recursive partitioning algorithm in the training set to create a response model (MAGIC D14 clinical response) according to overall GVHD grade at both onset and D14 that predicted 12-month NRM and then applied it to the validation set. Patients that either progressed to grade III/IV GVHD, continued having grade III/IV GVHD, or only improved to grade II at D14 from grade III/IV at D0 had high NRM and were classified as non-responders. Patients with grade I/II GVHD at day 0 who had grade 0-II GVHD at day 14 and patients who improved to grade 0/I at day 14 from grade III/IV at day 0 had low NRM and were classified as responders. Although counterintuitive, responders included patients whose GVHD remained at grade II because the 12 month NRM of this group was only 20%. The new clinical model predicted NRM as well as the D28 standard response model in the validation set. When we integrated the D14 MAP biomarker score (low: ≤ 0.290 vs high: >0.290) with the new D14 clinical response (D14 MAGIC integrated response), we observed three response groups of integrated response with strikingly different 12 month NRM (8%, 35%, 76%, p<0.001), in contrast to the D28 standard response (Figure 1A, 1B). D14 complete response required MAGIC clinical response with low MAP; D14 partial response required either MAGIC clinical response with high MAP or MAGIC clinical non-response with low MAP; and D14 non-response required MAGIC clinical non-response with high MAP. The D14 response groups also displayed significant differences in 12 month OS (82%, 58%, 14% respectively, p<0.001) We then compared the D14 integrated response with the D28 standard response for 12 month NRM prediction. This D14 integrated response model was superior for time-dependent AUC (0.78 vs 0.71, P=0.03), sensitivity (0.71 vs 0.54), positive predictive value (0.52 vs 0.48) and negative predictive value (0.92 vs 0.89), with minimal loss in specificity (0.85 vs 0.87) in the prediction of 12-month NRM compared to the D28 standard response model. Using decision curve analysis, the D14 integrated response displayed higher net benefit (correct identification of patients that will experience NRM by 12 months) over the whole range of threshold probabilities/preferences for changing immunosuppression when 12-month NRM was used as the outcome. We conclude first, that the definition of response that uses onset and D14 grades is as accurate as D28 ORR model; and second, that a model using clinical grades and biomarkers on D14 more accurately predicts long term NRM than the standard D28 definition and may be useful as a clinical trial endpoint.