Li, Jing

Learning from multimodal data sets can leverage complementary information and lead to improved performance for prediction tasks. A commonly used strategy to account for feature correlations in high-dimensional data sets is the latent variable approach. Several latent variable methods have been proposed for multimodal data sets; however, these methods either focus on extracting a shared component across all modalities or extracting a shared component and individual components specific to each modality, overlooking correlations within partial subsets of modalities. We propose multimodal fission learning (MMFL), the first supervised latent variable model that adopts a generalizable decomposition into globally joint, partially joint, and individual components from multimodal data sets. A key strength of MMFL is a natural extension to incorporate incomplete multimodal data in either training and test phases by leveraging the learned modality structure. Through simulation studies, we demonstrate that MMFL outperforms a variety of existing multimodal algorithms under both complete modality and incomplete modality settings. We applied MMFL to two real-world case studies: early prediction of Alzheimer’s disease using neuroimaging and genetic data and predicting posttraumatic headache improvement using clinical data collected via questionnaires and brain neuroimaging data. MMFL achieved improved predictive accuracy and enhanced interpretability offering insights for within- and cross-modal relationships of multimodal data sets. History: Rema Padman served as the senior editor for this article. Funding: This research was supported by the National Institutes of Health [Grants 2R42AG053149-02A1, R01AG069453, 30AG072980, R01AG069453, and 1R61NS113315-01], the National Science Foundation [Grant DMS-2053170], and the Department of Defense [Award W81XWH-19-0534]. The grantee organization is the Northern California Institute for Research and Education. In the past, ADNI has also received funding from the National Institute of Biomedical Imaging and Bioengineering, the Canadian Institutes of Health Research, and private sector contributions through the Foundation for the National Institutes of Health including generous contributions from the following: AbbVie, Alzheimer’s Association; Alzheimer’s Drug Discovery Foundation; Araclon Biotech; BioClinica, Inc.; Biogen; Bristol-Myers Squibb Company; CereSpir, Inc.; Cogstate; Eisai Inc.; Elan Pharmaceuticals, Inc.; Eli Lilly and Company; EuroImmun; F. Hoffmann-La Roche Ltd and its affiliated company Genentech, Inc.; Fujirebio; GE Healthcare; IXICO Ltd.; Janssen Alzheimer Immunotherapy Research & Development, LLC.; Johnson & Johnson Pharmaceutical Research & Development LLC.; Lumosity; Lundbeck; Merck & Co., Inc.; Meso Scale Diagnostics, LLC.; NeuroRx Research; Neurotrack Technologies; Novartis Pharmaceuticals Corporation; Pfizer Inc.; Piramal Imaging; Servier; Takeda Pharmaceutical Company; and Transition Therapeutics. Data Ethics & Reproducibility Note: The code capsule is available at https://github.com/lingchm/MMFL and in the e-Companion to this article (available at https://doi.org/10.1287/ijds.2024.0059 ).

Background Headache is a common symptom following mild traumatic brain injury (mTBI). Post-traumatic headache (PTH), a secondary headache disorder that develops after mTBI, often persists for months or years. To identify potential recovery mechanisms and prognostic biomarkers, the present study investigated whether longitudinal changes in pain-induced brain activation differ between healthy controls (HC) and PTH participants showing headache improvement and those without improvement. Methods Thirty-three participants who met International Classification of Headache Disorders, 3rd edition, criteria for acute PTH within 59 days post-mTBI and 33 HC participants were included with no significant differences in demographics. All participants underwent functional magnetic resonance imaging scans at baseline, four weeks, and 16 weeks post-enrollment using a thermal stimulation paradigm with noxious and non-painful heat stimuli. ‘Painful vs. Non-Painful Heat’ contrasts were generated using SPM12. PTH improvement was assessed at three months post-enrollment via electronic headache diaries. Two-sample t -tests compared the brain activation between HC and PTH at baseline. Linear mixed-effects models examined longitudinal changes for HC, PTH improvement and non-improvement groups across visits. Generalized linear models compared these groups within visits. Results Baseline analysis revealed several regions with significantly higher activation in acute PTH compared to HC, including bilateral postcentral gyrus, right superior temporal gyrus, right middle temporal gyrus, left inferior parietal gyrus, right superior parietal gyrus, left ventral striatum, left olfactory cortex, left gyrus rectus, and left middle occipital gyrus. Over time, the PTH improvement group demonstrated progressive normalization across all identified brain regions, whereas the non-improvement group showed only partial normalization in left ventral striatum, left olfactory cortex, and left gyrus rectus. Sustained elevated activation in specific regions distinguished PTH participants without headache improvement from those with headache improvement, suggesting potential biomarkers for persistent PTH. Conclusions Our findings demonstrate significantly altered pain-induced brain activations in participants with acute PTH compared to HC. Longitudinal analysis revealed distinct recovery trajectories: progressive normalization in the improvement group versus persistent alterations in the non-improvement group. These neuroimaging patterns may serve as biomarkers for identifying individuals at risk for persistent PTH, with implications for early intervention and personalized treatment approaches.

Abstract Intratumoral heterogeneity poses a significant challenge to the diagnosis and treatment of glioblastoma (GBM). This heterogeneity is further exacerbated during GBM recurrence, as treatment-induced reactive changes produce additional intratumoral heterogeneity that is ambiguous to differentiate on clinical imaging. There is an urgent need to develop non-invasive approaches to map the heterogeneous landscape of histopathological alterations throughout the entire lesion for each patient. We propose to predictively fuse Magnetic Resonance Imaging (MRI) with the underlying intratumoral heterogeneity in recurrent GBM using machine learning (ML) by leveraging image-localized biopsies with their associated locoregional MRI features. To this end, we develop BioNet, a biologically-informed neural network model, to predict regional distributions of three tissue-specific gene modules: proliferating tumor, reactive/inflammatory cells, and infiltrated brain tissue. BioNet offers valuable insights into the integration of multiple implicit and qualitative biological domain knowledge, which are challenging to describe in mathematical formulations. BioNet performs significantly better than a range of existing methods on cross-validation and blind test datasets. Voxel-level prediction maps of the gene modules by BioNet help reveal intratumoral heterogeneity, which can improve surgical targeting of confirmatory biopsies and evaluation of neuro-oncological treatment effectiveness. The non-invasive nature of the approach can potentially facilitate regular monitoring of the gene modules over time, and making timely therapeutic adjustment. These results also highlight the emerging role of ML in precision medicine.

Objectives The objective of this longitudinal study was to determine whether brain iron accumulation, measured using magnetic resonance imaging magnetic transverse relaxation rates (T2*), is associated with response to erenumab for the treatment of migraine. Methods Participants (n = 28) with migraine, diagnosed using international classification of headache disorders 3rd edition criteria, were eligible if they had six to 25 migraine days during a four-week headache diary run-in phase. Participants received two treatments with 140 mg erenumab, one immediately following the pre-treatment run-in phase and a second treatment four weeks later. T2* data were collected immediately following the pre-treatment phase, and at two weeks and eight weeks following the first erenumab treatment. Patients were classified as erenumab responders if their migraine-day frequency at five-to-eight weeks post-initial treatment was reduced by at least 50% compared to the pre-treatment run-in phase. A longitudinal Sandwich estimator approach was used to compare longitudinal group differences (responders vs non-responders) in T2* values, associated with iron accumulation. Group visit effects were calculated with a significance threshold of p = 0.005 and cluster forming threshold of 250 voxels. T2* values of 19 healthy controls were used for a reference. The average of each significant region was compared between groups and visits with Bonferroni corrections for multiple comparisons with significance defined as p < 0.05. Results Pre- and post-treatment longitudinal imaging data were available from 28 participants with migraine for a total of 79 quantitative T2* images. Average subject age was 42 ± 13 years (25 female, three male). Of the 28 subjects studied, 53.6% were erenumab responders. Comparing longitudinal T2* between erenumab responders vs non-responders yielded two comparisons which survived the significance threshold of p < 0.05 after correction for multiple comparisons: the difference at eight weeks between the erenumab-responders and non-responders in the periaqueductal gray (mean ± standard error; responders 43 ± 1 ms vs non-responders 32.5 ± 1 ms, p = 0.002) and the anterior cingulate cortex (mean ± standard error; responders 50 ± 1 ms vs non-responders 40 ± 1 ms, p = 0.01). Conclusions Erenumab response is associated with higher T2* in the periaqueductal gray and anterior cingulate cortex, regions that participate in pain processing and modulation. T2* differences between erenumab responders vs non-responders, a measure of brain iron accumulation, are seen at eight weeks post-treatment. Less iron accumulation in the periaqueductal gray and anterior cingulate cortex might play a role in the therapeutic mechanisms of migraine reduction associated with erenumab.