Relevance of Lesion Volume as an Outcome in Cerebral Cavernous Malformation Drug Trial: Exploratory Analyses in Atorvastatin Treatment of Cavernous Angiomas with Symptomatic Hemorrhage Exploratory Proof of Concept
BACKGROUND AND OBJECTIVES: It is not clear whether changes in lesion volume might represent a clinically relevant and statistically advantageous outcome parameter in early phase trials aimed at preventing bleeding in cerebral cavernous malformations (CCM). METHODS: We examined prospective changes in CCM lesion volume in the double-blinded AT CASH EPOC trial (clinicaltrials.gov NCT02603328). We correlated these with symptomatic hemorrhage (SH) events, contemporaneously assessed changes in lesional iron content by quantitative susceptibility mapping (QSM) on MRI, and objective (modified Rankin Scale (mRS)) and subjective (Euro-QoL Visual Analog Scale [EQ-VAS]) functional status. We also simulated sample sizes needed to detect potential effects on lesion volume. RESULTS: There was excellent correlation between independently assessed maximum lesion diameter and CCM lesion volume (R 2 = 0.68, P < .0001). The mean (SD) percentage change in lesion volume per year was +6 (65) and +18 (94) in atorvastatin and placebo patients, respectively ( P = .43). All cases with SH had increases in lesion volume and increases in mean lesional iron content by QSM, and most had declines in functional status on mRS and EQ-VAS, but there were no overall meaningful correlations of changes in lesion volume with concomitant changes in mean lesional QSM, mRS, or EQ-VAS (all R/R 2 < 0.5 and Bonferroni corrected P > .05), including in brainstem lesions analyzed separately. Sample size simulations indicate larger case numbers needed to demonstrate an effect on change in lesion volume than those needed to detect an effect on QSM change with α = 0.05 and β = 0.8, and even larger samples to detect effects on the number of cases with increased or decreased lesion volume. CONCLUSION: Changes in lesion volume occur frequently in CCM lesions after recent SH, but do not correlate with biomarkers of lesional bleeding, nor reflect functional changes, and are not statistically advantageous compared with QSM measures in detecting potential drug effects.
Identifying features of prior hemorrhage in cerebral cavernous malformations on quantitative susceptibility maps: a machine learning pilot study
Features of new bleeding on conventional imaging in cerebral cavernous malformations (CCMs) often disappear after several weeks, yet the risk of rebleeding persists long thereafter. Increases in mean lesional quantitative susceptibility mapping (QSM) ≥ 6% on MRI during 1 year of prospective surveillance have been associated with new symptomatic hemorrhage (SH) during that period. The authors hypothesized that QSM at a single time point reflects features of hemorrhage in the prior year or potential bleeding in the subsequent year. Twenty-eight features were extracted from 265 QSM acquisitions in 120 patients enrolled in a prospective trial readiness project, and machine learning methods examined associations with SH and biomarker bleed (QSM increase ≥ 6%) in prior and subsequent years. QSM features including sum variance, variance, and correlation had lower average values in lesions with SH in the prior year (p < 0.05, false discovery rate corrected). A support-vector machine classifier recurrently selected sum average, mean lesional QSM, sphericity, and margin sharpness features to distinguish biomarker bleeds in the prior year (area under the curve = 0.61, 95% CI 0.52–0.70; p = 0.02). No QSM features were associated with a subsequent bleed. These results provide proof of concept that machine learning may derive features of QSM reflecting prior hemorrhagic activity, meriting further investigation. Clinical trial registration no.: NCT03652181 ( ClinicalTrials.gov )
Abstract TP161: Machine Learning to Glean Characteristics of Quantitative Susceptibility Maps in Cerebral Cavernous Angiomas with Symptomatic Hemorrhage
Introduction and Hypothesis: New bleeding in cerebral cavernous malformations (CCM) heralds increased risk of future hemorrhage for several years, yet conventional imaging only detects new bleeding that occurred in the prior weeks. A biomarker of hemorrhage could help identifying high risk lesions. An increase of mean lesional quantitative susceptibility mapping (QSM) ≥6% on MRI has been adjudicated as reflecting new bleeding in CCM during longitudinal follow-up. However, mean lesional QSM from a single acquisition could not diagnose or prognosticate a bleed. We hypothesize that machine learning (ML) may identify diagnostic and prognostic features of bleeding within QSM maps at a single point in time. Material and Methods: Two hundred and sixty-five QSM maps of CCM lesions were acquired in 120 patients enrolled in National Institute of Health (NIH) multisite trial readiness project (NCT03652181). Each map was classified (Yes/No) in association with symptomatic hemorrhage (SH) and/or biomarker event with QSM increase ≥6% in the prior (diagnostic association) and subsequent (prognostic association) year. Twenty-eight features were extracted including 14 texture, 5 first-order statistical, as well as 3 size, shape, and morphological. Five-fold cross-validation was conducted on a support-vector machine (SVM) with linear stepwise kernel for both diagnostic and prognostic associations. Performance of individual features and composite classifiers was evaluated using student t-test ( p <0.05) with Bonferroni-correction and receiver operating characteristic (ROC) analysis, area under the curve (AUC). Results: Lesions with SH in the prior year had lower average values for sum variance (AUC=0.79, p<0.001), variance (AUC=0.79, p<0.001), and correlation (AUC=0.71, p=0.004) as compared to lesions without SH. The SVM classification method tasked with distinguishing lesions with mean QSM increase ≥6% in the prior year included recurrent selection of sum average, mean, sphericity and margin sharpness, yielding an AUC of 0.61 (p=0.02). In the prognostic cohort, no individual feature nor any SVM classification model was able to distinguish cases with a subsequent clinical bleed or biomarker event. Conclusion: This proof-of-concept suggests that ML may assist in deriving features on QSM maps acquired at a single timepoint, which reflect prior hemorrhagic activity in CCM. Further investigation is planned in larger cohorts and in conjunction with clinical trials of bleeding in CCM.
Trial Readiness of Cavernous Malformations With Symptomatic Hemorrhage, Part II: Biomarkers and Trial Modeling
BACKGROUND: Quantitative susceptibility mapping (QSM) and dynamic contrast-enhanced quantitative perfusion (DCEQP) magnetic resonance imaging sequences assessing iron deposition and vascular permeability were previously correlated with new hemorrhage in cerebral cavernous malformations. We assessed their prospective changes in a multisite trial-readiness project. METHODS: Patients with cavernous malformation and symptomatic hemorrhage (SH) in the prior year, without prior or planned lesion resection or irradiation were enrolled. Mean QSM and DCEQP of the SH lesion were acquired at baseline and at 1- and 2-year follow-ups. Sensitivity and specificity of biomarker changes were analyzed in relation to predefined criteria for recurrent SH or asymptomatic change. Sample size calculations for hypothesized therapeutic effects were conducted. RESULTS: We logged 143 QSM and 130 DCEQP paired annual assessments. Annual QSM change was greater in cases with SH than in cases without SH ( P =0.019). Annual QSM increase by ≥6% occurred in 7 of 7 cases (100%) with recurrent SH and in 7 of 10 cases (70%) with asymptomatic change during the same epoch and 3.82× more frequently than clinical events. DCEQP change had lower sensitivity for SH and asymptomatic change than QSM change and greater variance. A trial with the smallest sample size would detect a 30% difference in QSM annual change during 2 years of follow-up in 34 or 42 subjects (1 and 2 tailed, respectively); power, 0.8, α=0.05. CONCLUSIONS: Assessment of QSM change is feasible and sensitive to recurrent bleeding in cavernous malformations. Evaluation of an intervention on QSM percent change may be used as a time-averaged difference between 2 arms using a repeated measures analysis. DCEQP change is associated with lesser sensitivity and higher variability than QSM. These results are the basis of an application for certification by the US Food and Drug Administration of QSM as a biomarker of drug effect on bleeding in cavernous malformations. REGISTRATION: URL: https://www.clinicaltrials.gov ; Unique identifier: NCT03652181.
Trial Readiness of Cavernous Malformations With Symptomatic Hemorrhage, Part I: Event Rates and Clinical Outcome
BACKGROUND: Cerebral cavernous malformation with symptomatic hemorrhage (SH) are targets for novel therapies. A multisite trial-readiness project ( https://www.clinicaltrials.gov ; Unique identifier: NCT03652181) aimed to identify clinical, imaging, and functional changes in these patients. METHODS: We enrolled adult cerebral cavernous malformation patients from 5 high-volume centers with SH within the prior year and no planned surgery. In addition to clinical and imaging review, we assessed baseline, 1- and 2-year National Institutes of Health Stroke Scale, modified Rankin Scale, European Quality of Life 5D-3 L, and patient-reported outcome-measurement information system, Version 2.0. SH and asymptomatic change rates were adjudicated. Changes in functional scores were assessed as a marker for hemorrhage. RESULTS: One hundred twenty-three, 102, and 69 patients completed baseline, 1- and 2-year clinical assessments, respectively. There were 21 SH during 178.3 patient years of follow-up (11.8% per patient year). At baseline, 62.6% and 95.1% of patients had a modified Rankin Scale score of 1 and National Institutes of Health Stroke Scale score of 0 to 4, respectively, which improved to 75.4% ( P =0.03) and 100% ( P =0.06) at 2 years. At baseline, 74.8% had at least one abnormal patient-reported outcome-measurement information system, Version 2.0 domain compared with 61.2% at 2 years ( P =0.004). The most common abnormal European Quality of Life 5D-3 L domains were pain (48.7%), anxiety (41.5%), and participation in usual activities (41.4%). Patients with prospective SH were more likely than those without SH to display functional decline in sleep, fatigue, and social function patient-reported outcome-measurement information system, Version 2.0 domains at 2 years. Other score changes did not differ significantly between groups at 2 years. The sensitivity of scores as an SH marker remained poor at the time interval assessed. CONCLUSIONS: We report SH rate, functional, and patient-reported outcomes in trial-eligible cerebral cavernous malformation with SH patients. Functional outcomes and patient-reported outcomes generally improved over 2 years. No score change was highly sensitive or specific for SH and could not be used as a primary end point in a trial.
Abstract 114: Changes In Quantitative Susceptibility Mapping On Magnetic Resonance Imaging During Prospective Follow-Up Of Cavernous Angiomas With Symptomatic Hemorrhage In Trial Readiness Project
Background: Quantitative susceptibility mapping (QSM) is a measure of iron content, and ≥6% increase in QSM has been correlated with new hemorrhage in previously stable cavernous angiomas. Longitudinal changes in QSM are not known in cavernous angiomas with symptomatic hemorrhage (CASH) with high rates of rebleeding and are the targets of novel pharmacotherapies. In a prospective multisite Trial Readiness project (clinicaltrials.gov NCT03652181), QSM is longitudinally assessed. Methods: Trial eligible subjects with CASH in the prior year and not undergoing lesion resection or radiation, were enrolled. Mean QSM of CASH lesion was acquired at baseline and at 1 and 2 year planned follow-ups. Relative change in mean lesional QSM during each follow-up year was assessed, and any symptomatic hemorrhage (SH), asymptomatic changes (AC; defined as subclinical bleed or growth) in the lesion during the same epoch. Results: Paired QSM assessments were completed to date in 99 CASH lesions (67 year 1, and 32 year 2) and are reported herein. Four SH and 6 ACs occurred during 1 st follow-up year, and 3 SH during 2 nd year. QSM increased in 54 lesion-years, decreased in 44, and remained stable in 1. The % lesional QSM change in year 1 was significantly higher than that observed in year 2 (mean +9.33, SD 37.52 vs. +5.20; SD= 24.86; p=0.05; Spearman correlation ρ -0.36). CAs with clinical SH or AC had a significantly higher % QSM change than lesions without (mean +28.03, SD 17.77 vs. +4.97, SD= 34.75; p=0.0014). All 13 lesions with SH/AC demonstrated a QSM increase ≥6% while 31 of 86 (36%) lesions with no clinical events had a ≥6% QSM increase. Conclusion: QSM change of ≥6% is present in every CASH lesion manifesting a new SH or AC (100% specificity), and is more common than clinical events (3.4X higher sensitivity). The biomarker can hence be used as a more sensitive categorical outcome than SH or AC in clinical trials of novel therapies aimed at bleeding in CASH lesions. Effect of an intervention on % QSM change may also be proposed as a time-averaged difference between 2 arms using a repeated measures analysis implemented as an unadjusted linear mixed model. These results are the basis of application for certification by the U.S F.D.A. of QSM as a monitoring biomarker of drug effect in CASH.
Baseline Characteristics of Patients With Cavernous Angiomas With Symptomatic Hemorrhage in Multisite Trial Readiness Project
Background and Purpose: Brain cavernous angiomas with symptomatic hemorrhage (CASH) have a high risk of neurological disability from recurrent bleeding. Systematic assessment of baseline features and multisite validation of novel magnetic resonance imaging biomarkers are needed to optimize clinical trial design aimed at novel pharmacotherapies in CASH. Methods: This prospective, multicenter, observational cohort study included adults with unresected, adjudicated brain CASH within the prior year. Six US sites screened and enrolled patients starting August 2018. Baseline demographics, clinical and imaging features, functional status (modified Rankin Scale and National Institutes of Health Stroke Scale), and patient quality of life outcomes (Patient-Reported Outcomes Measurement Information System-29 and EuroQol-5D) were summarized using descriptive statistics. Patient-Reported Outcomes Measurement Information System-29 scores were standardized against a reference population (mean 50, SD 10), and one-sample t test was performed for each domain. A subgroup underwent harmonized magnetic resonance imaging assessment of lesional iron content with quantitative susceptibility mapping and vascular permeability with dynamic contrast-enhanced quantitative perfusion. Results: As of May 2020, 849 patients were screened and 110 CASH cases enrolled (13% prevalence of trial eligible cases). The average age at consent was 46±16 years, 53% were female, 41% were familial, and 43% were brainstem lesions. At enrollment, ≥90% of the cohort had independent functional outcome (modified Rankin Scale score ≤2 and National Institutes of Health Stroke Scale score <5). However, perceived health problems affecting quality of life were reported in >30% of patients (EuroQol-5D). Patients had significantly worse Patient-Reported Outcomes Measurement Information System-29 scores for anxiety ( P =0.007), but better depression ( P =0.002) and social satisfaction scores ( P =0.012) compared with the general reference population. Mean baseline quantitative susceptibility mapping and permeability of CASH lesion were 0.45±0.17 ppm and 0.39±0.31 mL/100 g per minute, respectively, which were similar to historical CASH cases and consistent across sites. Conclusions: These baseline features will aid investigators in patient stratification and determining the most appropriate outcome measures for clinical trials of emerging pharmacotherapies in CASH.
A Roadmap for Developing Plasma Diagnostic and Prognostic Biomarkers of Cerebral Cavernous Angioma With Symptomatic Hemorrhage (CASH)
Abstract BACKGROUND Cerebral cavernous angioma (CA) is a capillary microangiopathy predisposing more than a million Americans to premature risk of brain hemorrhage. CA with recent symptomatic hemorrhage (SH), most likely to re-bleed with serious clinical sequelae, is the primary focus of therapeutic development. Signaling aberrations in CA include proliferative dysangiogenesis, blood-brain barrier hyperpermeability, inflammatory/immune processes, and anticoagulant vascular domain. Plasma levels of molecules reflecting these mechanisms and measures of vascular permeability and iron deposition on magnetic resonance imaging are biomarkers that have been correlated with CA hemorrhage. OBJECTIVE To optimize these biomarkers to accurately diagnose cavernous angioma with symptomatic hemorrhage (CASH), prognosticate the risk of future SH, and monitor cases after a bleed and in response to therapy. METHODS Additional candidate biomarkers, emerging from ongoing mechanistic and differential transcriptome studies, would further enhance the sensitivity and specificity of diagnosis and prediction of CASH. Integrative combinations of levels of plasma proteins and characteristic micro-ribonucleic acids may further strengthen biomarker associations. We will deploy advanced statistical and machine learning approaches for the integration of novel candidate biomarkers, rejecting noncorrelated candidates, and determining the best clustering and weighing of combined biomarker contributions. EXPECTED OUTCOMES With the expertise of leading CA researchers, this project anticipates the development of future blood tests for the diagnosis and prediction of CASH to clinically advance towards precision medicine. DISCUSSION The project tests a novel integrational approach of biomarker development in a mechanistically defined cerebrovascular disease with a relevant context of use, with an approach applicable to other neurological diseases with similar pathobiologic features.
Phantom validation of quantitative susceptibility and dynamic contrast‐enhanced permeability MR sequences across instruments and sites
BackgroundQuantitative susceptibility mapping (QSM) and dynamic contrast‐enhanced quantitative permeability (DCEQP) on magnetic resonance (MR) have been shown to correlate with neurovascular disease progression as markers of vascular leakage and hemosiderin deposition. Applying these techniques as monitoring biomarkers in clinical trials will be necessary; however, their validation across multiple MR platforms and institutions has not been rigorously verified.PurposeTo validate quantitative measurement of MR biomarkers on multiple instruments at different institutions.Study TypePhantom validation between platforms and institutions.Phantom ModelT1/susceptibility phantom, two‐compartment dynamic flow phantom.Field Strength/Sequence3T/QSM, T1 mapping, dynamic 2D SPGR.AssessmentPhilips Ingenia, Siemens Prisma, and Siemens Skyra at three different institutions were assessed. A QSM phantom with concentrations of gadolinium, corresponding to magnetic susceptibilities of 0, 0.1, 0.2, 0.4, and 0.8 ppm was assayed. DCEQP was assessed by measuring a MultiHance bolus as the consistency of the width ratio of the curves at the input and outputs over a range of flow ratios between outputs.Statistical TestsEach biomarker was assessed by measures of accuracy (Pearson correlation), precision (paired t‐test between repeated measurements), and reproducibility (analysis of covariance [ANCOVA] between instruments).ResultsQSM accuracy of r2 > 0.997 on all three platforms was measured. Precision (P = 0.66 Achieva, P = 0.76 Prisma, P = 0.69 Skyra) and reproducibility (P = 0.89) were good. T1 mapping of accuracy was r2 > 0.98. No significant difference between width ratio regression slopes at site 2 (P = 0.669) or site 3 (P = 0.305), and no significant difference between width ratio regression slopes between sites was detected by ANCOVA (P = 0.48).Data ConclusionThe phantom performed as expected and determined that MR measures of QSM and DCEQP are accurate and consistent across repeated measurements and between platforms.Level of Evidence: 1Technical Efficacy Stage: 2J. Magn. Reson. Imaging 2020;51:1192–1199.
Trial Readiness in Cavernous Angiomas With Symptomatic Hemorrhage (CASH)
Abstract BACKGROUND Brain cavernous angiomas with symptomatic hemorrhage (CASH) are uncommon but exact a heavy burden of neurological disability from recurrent bleeding, for which there is no proven therapy. Candidate drugs to stabilize the CASH lesion and prevent rebleeding will ultimately require testing of safety and efficacy in multisite clinical trials. Much progress has been made in understanding the epidemiology of CASH, and novel biomarkers have been linked to the biological mechanisms and clinical activity in lesions. Yet, the ability to enroll and risk-stratify CASH subjects has never been assessed prospectively at multiple sites. Biomarkers and other outcomes have not been evaluated for their sensitivity and reliability, nor have they been harmonized across sites. OBJECTIVE To address knowledge gaps and establish a research network as infrastructure for future clinical trials, through the Trial Readiness grant mechanism, funded by National Institute of Neurological Disorders and Stroke/National Institutes of Health. METHODS This project includes an observational cohort study to assess (1) the feasibility of screening, enrollment rates, baseline disease categorization, and follow-up of CASH using common data elements at multiple sites, (2) the reliability of imaging biomarkers including quantitative susceptibility mapping and permeability measures that have been shown to correlate with lesion activity, and (3) the rates of recurrent hemorrhage and change in functional status and biomarker measurements during prospective follow-up. EXPECTED OUTCOMES We propose a harmonized multisite assessment of enrollment rates of CASH, baseline features relevant to stratification in clinical trials, and follow-up assessments of functional outcomes in relation to clinical bleeds. We introduce novel biomarkers of vascular leak and hemorrhage, with firm mechanistic foundations, which have been linked to clinical disease activity. We shall test their reliability and validity at multiple sites, and assess their changes over time, with and without clinical rebleeds, hence their fitness as outcome instruments in clinical trials. DISCUSSION The timing cannot be more opportune, with therapeutic targets identified, exceptional collaboration among researchers and the patient community, along with several drugs ready to benefit from development of a path to clinical testing using this network in the next 5 years.