Botha, Hugo

Purpose: This study examined whether phoneme-level posterior probabilities generated by an articulatory-informed deep learning model (Phonet) can serve as interpretable and sensitive markers of articulatory impairment in motor speech disorders (MSDs). The goal was to determine whether these features distinguish individuals with and without MSDs and reflect varying severity levels of articulatory impairment. Method: A total of 676 participants (199 with MSDs, 477 without MSDs) completed a remotely captured word repetition task. Speech recordings were phonetically aligned, and posterior probabilities were extracted using a retrained version of the Phonet model, which estimates frame-level probabilities for 23 phonological classes. Segment-level posterior values were computed and compared across groups and severity levels using linear mixed-effects regression models. Results: Posterior probabilities were significantly reduced in the MSD group across all phoneme types. Within the MSD group, posterior probabilities decreased progressively with greater clinical severity, as measured by both perceptual sound distortion ratings and a cumulative articulation error score. Segment-specific analyses revealed systematic differences across phoneme classes, indicating that posterior probabilities capture distinct patterns of articulatory degradation associated with motor speech impairment. Conclusions: Phoneme-level posterior probabilities serve as interpretable, segment-specific indicators of articulatory impairment in MSDs. These features differentiate clinical status and reflect gradations of severity, making them promising tools for augmenting traditional perceptual speech assessments. Their linguistic transparency and scalability support future clinical applications in diagnosis, monitoring, and targeted intervention.

Abstract Purpose To evaluate whether two automated measures of nasality, Nasal Cognate Distinctiveness (NCD) and nasal posterior probability (NPP), provide clinically meaningful markers of hypernasality in speakers with motor speech disorders (MSDs) and to determine whether hypernasality-related information extends beyond stop consonants, which are typically targeted in cognate-based approaches. Method Sentence-level speech recordings were obtained from 561 patients, including 374 neurologically typical controls and 187 individuals with MSDs. NCD was computed for voiceless stops (/p/, /t/, /k/) using likelihood ratios between stops and their nasal cognates. NPP was extracted using a phonological feature-based neural network model and analyzed for stops, consonants, and vowels. Hypernasality severity was rated by speech-language pathologists. Group differences and associations with hypernasality severity were evaluated using linear mixed-effects models and Spearman correlations, and receiver operating characteristic (ROC) analyses were used to evaluate discrimination of absent versus present hypernasality. An additional 20 controls with repeat recordings were used to evaluate test-retest reliability and minimal detectable change (MDC). Results NCD generally decreased and NPP increased with increasing hypernasality severity, with phoneme-specific severity effects observed for NCD. Across stops, NCD and NPP were strongly inversely correlated and showed comparable discrimination of absent versus present hypernasality (AUCs = 0.796 and 0.730, respectively). Consonant and vowel NPP measures were both positively associated with hypernasality severity and demonstrated identical classification performance (AUC = 0.853). No significant differences in ROC performance were observed between NCD and NPP or between consonant and vowel NPP measures. Test-retest change exceeded the MDC threshold in 2 of 20 controls for NCD and 1 of 20 for NPP. Conclusions Both NCD and NPP provide objective markers of hypernasality in speakers with MSDs. The measures capture related aspects of nasalization and demonstrate comparable ability to identify clinically meaningful hypernasality. NPP captures hypernasality-related acoustic information across both consonants and vowels, with similar relationships to severity and classification performance across sound classes. Test-retest findings provide preliminary MDC benchmarks for interpreting longitudinal change.

Abstract Introduction Remote cognitive assessments offer an accessible, scalable way to support clinical characterization and longitudinal monitoring of cognition. This study evaluates the feasibility of implementing Mayo Test Drive (MTD), a remote, self-administered digital cognitive assessment, within a specialized clinic focused on eligibility assessments for anti-amyloid therapies for Alzheimer’s disease (AD). Method Two-hundred and nine ( N =209) patients (M age =71.2, 53% female) were evaluated through the Mayo Clinic Rochester Alzheimer’s Disease Treatment Clinic (ADTC) and had the opportunity to complete MTD, either as a remote, patient-initiated session through a patient-facing healthcare portal or during an in-clinic neuropsychological evaluation. Results Clinical diagnoses included 55.2% mild cognitive impairment (MCI), 31.0% mild dementia, and 11.6% moderate dementia, in addition to 2.2% cognitively unimpaired (CU), as determined by neurology consensus at a multidisciplinary case conference. Among those who initiated MTD ( n =197/209), 97.5% completed a session (70.6% remotely, 26.9% in clinic). Completion rates were high across diagnostic groups and did not significantly differ by clinical severity ( p =.12): CU (100%), MCI (99.1%), mild dementia (97.0%), and moderate dementia (89.5%). Remote completion rates overall were high (97.9%). Among completers, administration setting (remote vs. in-clinic) did not significantly differ by clinical stage, χ²(3)=2.37, p =.49. Reasons for non-initiation included not receiving or opening portal messages and other/unknown factors. Discussion Remote digital cognitive assessment is feasible within the context of clinic eligibility evaluations for AD therapies. The high completion rates of MTD across clinical impairment levels in this setting support development of paths for broader use in cognitive characterization in AD care.

Abstract Motor speech disorders (MSDs) are early markers of neurological disease, but expert perceptual analysis is rarely available outside specialized centers. Automated speech analysis offers a scalable alternative, yet prior studies have not systematically compared modeling approaches or assessed clinically relevant metrics in independent datasets. This study compared static acoustic features, articulatory informed Phonet features, and self-supervised pretrained models for binary and multi label MSD classification. We trained and evaluated models on 583 speech samples using speaker level splits. Baseline models included logistic regression and Gated Recurrent Units (GRUs) trained on eGeMAPS and MFCCs. We extracted three types of Phonet derived features and evaluated pretrained HuBERT and SSAST models in frozen, partially fine-tuned, and fully fine-tuned configurations. Binary classification distinguished MSDs from controls, while multi label classification identified six MSD subtypes. Models were assessed using validation AUC, and cut points were tested on two independent datasets. Pretrained and Phonet based models substantially outperformed static acoustic features. In binary classification, HuBERT achieved the highest AUC (0.95), while compact Phonet derived GRUs achieved comparable performance (up to 0.94). These models generalized well to independent datasets, maintaining high sensitivity (0.94) and specificity (0.97). In multi label classification, Phonet models achieved the highest macro average AUC (0.86), but threshold-based subtype performance declined on unseen data. Automated MSD detection is feasible and clinically promising. Binary classification generalized well, whereas multi label classification showed limited threshold stability across datasets.

Abstract This study examined the extent to which goodness of pronunciation (GoP) scores and phonological posterior probabilities capture perceptual ratings of speech severity in individuals with motor speech disorders (MSD). Speech recordings of the word catastrophe were obtained from 489 participants, including 333 neurologically typical controls and 156 individuals with MSD. GoP scores were derived using traditional acoustic features and self-supervised speech representations, including WavLM and XLS-R, across multiple modeling approaches, while phonological posterior probabilities were extracted using Phonet. Model performance was evaluated using Kendall’s rank correlations, regression, and receiver operating characteristic analyses against speech-language pathologists’ perceptual ratings of sound distortion and intelligibility. Both GoP and phonological posterior probabilities were significantly associated with perceptual ratings. Self-supervised speech representations substantially outperformed traditional acoustic features, with WavLM-based GoP using k-nearest neighbors achieving the strongest performance. Across correlation, regression, and classification analyses, GoP consistently outperformed phonological posterior probabilities for both sound distortion and intelligibility. Age and gender had minimal influence on model-derived measures or their relationships with perceptual ratings. These findings demonstrate the value of self-supervised GoP as an objective measure of speech impairment while highlighting the complementary role of phonological posterior probabilities in characterizing articulatory aspects of motor speech disorders.

Abstract Alzheimer’s disease (AD) emerges from multi-scale interactions between molecular pathology and disruptions in large-scale brain network dynamics. Understanding how these processes co-evolve and relate to disease stages is essential for advancing complex systems models of aging and AD, and for developing system-informed interventions. However, progress has been limited by a lack of large-scale longitudinal data. To address this, we examined the longitudinal relationship between subsystems of the default mode network (DMN) (posterior DMN, ventral DMN, anterior dorsal DMN) using task-free functional MRI (fMRI) and amyloid positron emission tomography (PET) imaging in a large longitudinal cohort spanning the clinico-biological spectrum of AD (n = 1,451; 2,763 time points) using mixed-effect models. We also assessed whether patterns of DMN connectivity predicted conversion to amyloid positivity, mild cognitive impairment (MCI), and dementia using Cox proportional hazards models. Our findings reveal a dynamic interplay between amyloid accumulation and connectivity within and between DMN subsystems, with both hyper- and hypoconnectivity emerging across DMN subsystems in association with increasing amyloid burden. Importantly, survival models showed that DMN connectivity patterns predicted conversion to critical stages of the disease, including not only conversion to MCI and dementia, but also conversion to amyloid positivity in otherwise clinically unimpaired individuals who were amyloid negative at baseline. These associations were independent of age, APOE4 status, sex, education, and in-scanner motion. These results support a model in which breakdowns in tightly regulated feedback loops governing DMN physiology represent a core systems-level pathophysiology of AD. Notably, this functional dyshomeostasis precedes detectable amyloidosis on imaging. Future studies should focus on the development of robust biomarkers of brain function that can be applied at the individual level, which could in turn help support the development of therapeutic approaches targeting system-level pathophysiology.

Purpose: This viewpoint addresses the complexity of the nomenclature of progressive speech-language disorders, which often exists at the intersection of descriptive symptoms, clinical syndromes, and underlying neuropathology. Using primary progressive apraxia of speech (PPAOS) as an example, we explore how overlapping diagnostic frameworks employed by speech-language pathologists, neurologists, and other clinicians and researchers can lead to different diagnostic labels that may evolve throughout disease progression. These discrepancies and changes can complicate patient understanding, clinical care, and affect eligibility for clinical trials. We highlight the importance of diagnostic specificity, flexibility, and multidisciplinary collaboration in improving patient counseling, prognostication, treatment planning, and clinical research alignment, particularly in the context of the growing number of clinical trials and specialized, multidisciplinary clinics. Conclusions: This viewpoint explores how symptom-based, syndrome-based, and pathology-based diagnoses can work together to support patient care and research. Accurate and specific diagnosis of speech-language disorders has important implications for patient understanding of their condition, identity, prognostic accuracy, access to care, clinical trial enrollment, and treatment planning and efficacy. Misdiagnosis or vague labeling can result in inappropriate interventions, delayed support, and skewed research findings. We argue that multidisciplinary collaboration and flexibility in recognizing evolving symptom-based and syndrome-based labels over the disease course—and as the fields learn more—is essential to empower patients with accurate, actionable information. Embracing both the specificity and the complexity of progressive speech-language disorders can both enhance communication and facilitate research.

Abstract Importance Voice-based health technologies are growing rapidly, but they lack standardized terminology, which hinders interdisciplinary collaboration, research quality, and clinical translation. Objective The objective of this work is to develop universally accepted definitions in the rapidly evolving field of vocal biomarkers, as part of the VOCAL ( V ocal Biomarker Guidelines for O ntology, C lassification, A pplication, and L ogistics) initiative, a structured, international consensus-based framework that aims to provide standards, and guidelines. Design VOCAL is a rigorous, international, multi-stage consensus-building study conducted in 2024-2025. Setting Multi-institutional collaboration between representatives from the Bridge2AI-Voice Consortium (North America) and the eVoiceNet Network (European Union), culminating in an in-person workshop at the 2025 Bridge2AI Voice Symposium. Participants A group of 24 international experts in medicine, clinical research, speech and language, audio signal processing, statistics, methodology, regulation, ethics. Methods VOCAL’s iterative process involved five rounds of review, feedback, and an in-person workshop at the international 2025 Bridge2AI Voice Symposium, ensuring the incorporation of diverse perspectives and achieving a robust agreement on the proposed definitions. Main outcomes and measures Consensus-based definitions for vocal biomarkers, spanning from broad concepts (biomarker, digital biomarker, vocal biomarker) to domain-specific measures (cardio-respiratory acoustic, voice, speech/articulatory, cognitive/language). Results A hierarchical continuum model of vocal biomarkers was established. We first distinguished between the concepts of vocal measures and vocal biomarkers. We then defined terms from broad, overarching concepts (Level 0: Biomarker, Digital Biomarker, Vocal Biomarker) to more specific physiological and cognitive domains (Level 1: Cardio-Respiratory Acoustic; Level 2: Voice; Level 3: Speech/Articulatory; Level 4: Cognitive/Language, including linguistic and paralinguistic subtypes). Conclusions and Relevance This work provides a shared vocabulary that is essential for fostering communication through interdisciplinary collaboration, improving the quality and efficiency of research and development, and ensuring the ethical, reliable, and scalable deployment of future voice-based health technologies. It lays foundational groundwork for upcoming guidelines and standards, which are crucial for advancing the field of vocal biomarkers into widespread clinical utility. Key points Question Can we establish an international consensus on the definitions related to vocal biomarkers? Findings Through a multi-stage international consensus process involving expert representatives from the Bridge2AI-Voice Consortium and eVoiceNet Network, a hierarchical model of vocal biomarkers was developed, defining terms from broad concepts (biomarker, digital biomarker, vocal biomarker) to specific physiological and cognitive domains (cardio-respiratory acoustic, voice, speech/articulatory, cognitive/language). Meaning Standardized definitions for vocal biomarkers provide an essential shared vocabulary for interdisciplinary collaboration and lay the foundational groundwork for future guidelines needed to advance the implementation of voice-based health technologies into clinical practice and clinical research.