PurposeIn this article, the authors report reliability and validity evidence for the Dynamic Evaluation of Motor Speech Skill (DEMSS), a new test that uses dynamic assessment to aid in the differential diagnosis of childhood apraxia of speech (CAS).MethodParticipants were 81 children between 36 and 79 months of age who were referred to the Mayo Clinic for diagnosis of speech sound disorders. Children were given the DEMSS and a standard speech and language test battery as part of routine evaluations. Subsequently, intrajudge, interjudge, and test–retest reliability were evaluated for a subset of participants. Construct validity was explored for all 81 participants through the use of agglomerative cluster analysis, sensitivity measures, and likelihood ratios.ResultsThe mean percentage of agreement for 171 judgments was 89% for test–retest reliability, 89% for intrajudge reliability, and 91% for interjudge reliability. Agglomerative hierarchical cluster analysis showed that total DEMSS scores largely differentiated clusters of children with CAS vs. mild CAS vs. other speech disorders. Positive and negative likelihood ratios and measures of sensitivity and specificity suggested that the DEMSS does not overdiagnose CAS but sometimes fails to identify children with CAS.ConclusionsThe value of the DEMSS in differential diagnosis of severe speech impairments was supported on the basis of evidence of reliability and validity.
Evidence-Based Systematic Review: Effects of Nonspeech Oral Motor Exercises on Speech
PurposeThe purpose of this systematic review was to examine the current evidence for the use of oral motor exercises (OMEs) on speech (i.e., speech physiology, speech production, and functional speech outcomes) as a means of supporting further research and clinicians' use of evidence-based practice.MethodThe peer-reviewed literature from 1960 to 2007 was searched for articles examining the use of OMEs to affect speech physiology, production, or functional outcomes (i.e., intelligibility). Articles that met selection criteria were appraised by 2 reviewers and vetted by a 3rd for methodological quality, then characterized as efficacy or exploratory studies.ResultsFifteen studies met inclusion criteria; of these, 8 included data relevant to the effects of OMEs on speech physiology, 8 on speech production, and 8 on functional speech outcomes. Considerable variation was noted in the participants, interventions, and treatment schedules. The critical appraisals identified significant weaknesses in almost all studies.ConclusionsInsufficient evidence to support or refute the use of OMEs to produce effects on speech was found in the research literature. Discussion is largely confined to a consideration of the need for more well-designed studies using well-described participant groups and alternative bases for evidence-based practice.
Introduction: Literacy Problems in Children With Severe Speech Sound Disorders, Including CAS
PurposeTo review the content and psychometric characteristics of 6 published tests currently available to aid in the study, diagnosis, and treatment of motor speech disorders in children.MethodWe compared the content of the 6 tests and critically evaluated the degree to which important psychometric characteristics support the tests' use for their defined purposes.ResultsThe tests varied considerably in content and methods of test interpretation. Few of the tests documented efforts to support reliability and validity for their intended purposes, often when relevant information was probably available during the test’s development.ConclusionsProblems with the reviewed tests appear related to overly broad plans for test development and inadequate attention to relevant psychometric principles during the development process. Recommendations are offered for future test revisions and development efforts that can benefit from recent research in test development and in pediatric motor speech disorders.