Skip to main content
Top
Gepubliceerd in: Journal of Autism and Developmental Disorders 5/2023

24-02-2022 | Original Paper

Psychometric Properties of Standardized Instruments that are Used to Measure Pragmatic Intervention Effects in Children with Developmental Language Disorder: A Systematic Review

Auteurs: Tatiana Pereira, Marisa Lousada

Gepubliceerd in: Journal of Autism and Developmental Disorders | Uitgave 5/2023

Log in om toegang te krijgen
share
DELEN

Deel dit onderdeel of sectie (kopieer de link)

  • Optie A:
    Klik op de rechtermuisknop op de link en selecteer de optie “linkadres kopiëren”
  • Optie B:
    Deel de link per e-mail

Abstract

This review aimed to analyze the psychometric properties of standardized instruments that are used to measure pragmatic intervention effects in children with developmental language disorder. Following PRISMA structure, a comprehensive literature research was conducted in five electronic indexing databases: Central, PubMed, Medline, Web of Science and Scopus. Six studies between 2005 and 2019 were included and seven standardized instruments have been analyzed. All instruments present some evidence of validity and reliability, but none reported responsiveness. The instruments reviewed were not used for their original purpose, which may explain the results. The small number of studies prevent drawing clear conclusions. Future studies should focus on appropriate, valid, reliable, and responsive measures. Research focusing on psychometric properties is crucial, mostly about responsiveness.
Literatuur
go back to reference Adams, C., Cooke, R., Crutchley, A., Hesketh, A., & Reeves, D. (2001). Assessment of comprehension and expression 6–11 (ACE 6–11). NFER-Nelson. Adams, C., Cooke, R., Crutchley, A., Hesketh, A., & Reeves, D. (2001). Assessment of comprehension and expression 6–11 (ACE 6–11). NFER-Nelson.
go back to reference Adams, C., Lockton, E., Freed, J., Gaile, J., Earl, G., McBean, K., Nash, M., Green, J., Vail, A., & Law, J. (2012). The social communication intervention project: A randomized controlled trial of the effectiveness of speech and language therapy for school-age children who have pragmatic and social communication problems with or without autism spectrum disorder. International Journal of Language & Communication Disorders, 47(3), 233–244. https://doi.org/10.1111/j.1460-6984.2011.00146.xCrossRef Adams, C., Lockton, E., Freed, J., Gaile, J., Earl, G., McBean, K., Nash, M., Green, J., Vail, A., & Law, J. (2012). The social communication intervention project: A randomized controlled trial of the effectiveness of speech and language therapy for school-age children who have pragmatic and social communication problems with or without autism spectrum disorder. International Journal of Language & Communication Disorders, 47(3), 233–244. https://​doi.​org/​10.​1111/​j.​1460-6984.​2011.​00146.​xCrossRef
go back to reference American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders—fifth edition. American Psychiatric Association Publishing. American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders—fifth edition. American Psychiatric Association Publishing.
go back to reference Bishop, D. V. M. (2003). The children’s communication checklist—2. Psychological Corporation. Bishop, D. V. M. (2003). The children’s communication checklist—2. Psychological Corporation.
go back to reference Bishop, D. V. M. (2004). Expression, reception and recall of narrative instrument: ERRNI. Harcourt Assessment. Bishop, D. V. M. (2004). Expression, reception and recall of narrative instrument: ERRNI. Harcourt Assessment.
go back to reference Bishop, D. V. M. (2006). Children’s communication checklist—2. Harcourt Assessment. Bishop, D. V. M. (2006). Children’s communication checklist—2. Harcourt Assessment.
go back to reference Bishop, D. V. M., & Rosenbloom, L. (1987). Classification of childhood language disorders. Language Development and Disorders, 22(1), 61–81. Bishop, D. V. M., & Rosenbloom, L. (1987). Classification of childhood language disorders. Language Development and Disorders, 22(1), 61–81.
go back to reference Bishop, D. V. M., Snowling, M. J., Thompson, P. A., Greenhalgh, T., CATALISE Consortium. (2017). Phase 2 of CATALISE: A multinational and multidisciplinary delphi consensus study of problems with language development: Terminology. Journal of Child Psychology and Psychiatry and Allied Disciplines, 58(10), 1068–1080. https://doi.org/10.1111/jcpp.12721CrossRefPubMed Bishop, D. V. M., Snowling, M. J., Thompson, P. A., Greenhalgh, T., CATALISE Consortium. (2017). Phase 2 of CATALISE: A multinational and multidisciplinary delphi consensus study of problems with language development: Terminology. Journal of Child Psychology and Psychiatry and Allied Disciplines, 58(10), 1068–1080. https://​doi.​org/​10.​1111/​jcpp.​12721CrossRefPubMed
go back to reference Bowers, L., Huisingh, R., & LoGuidice, C. (2018). Test of problem solving—third edition elementary: Normative update. LinguiSystems. Bowers, L., Huisingh, R., & LoGuidice, C. (2018). Test of problem solving—third edition elementary: Normative update. LinguiSystems.
go back to reference Cummings, L. (2017). Research in clinical pragmatics. In Perspectives in pragmatics, philosophy & psychology. (Vol. 11). Springer. Cummings, L. (2017). Research in clinical pragmatics. In Perspectives in pragmatics, philosophy & psychology. (Vol. 11). Springer.
go back to reference Dunn, L. M., Dunn, L. M., & Whetton, C. (1997). The British Picture Vocabulary Scale (2nd ed.). NFER-Nelson. Dunn, L. M., Dunn, L. M., & Whetton, C. (1997). The British Picture Vocabulary Scale (2nd ed.). NFER-Nelson.
go back to reference Feinberg, M. J. (2002). Using social stories to teach specific social skills to individuals diagnosed with autism [Unpublished Doctoral Dissertation]. California School of Professional Psychology. Feinberg, M. J. (2002). Using social stories to teach specific social skills to individuals diagnosed with autism [Unpublished Doctoral Dissertation]. California School of Professional Psychology.
go back to reference Fleiss, J. L. (1986). Reliability of measurements. Wiley. Fleiss, J. L. (1986). Reliability of measurements. Wiley.
go back to reference Friedman, N., & Novogrodsky, R. (2008). Subtypes of SLI: SySLI, PhoSLI. Cambridge Scholars Press. Friedman, N., & Novogrodsky, R. (2008). Subtypes of SLI: SySLI, PhoSLI. Cambridge Scholars Press.
go back to reference Goodyer, I. M. (2000). Language difficulties and psychopathology. In D. V. M. Bishop & L. B. Leonard (Eds.), Speech and language impairments in children: Causes, characteristics, intervention and outcome (pp. 227–244). Psychology Press. Goodyer, I. M. (2000). Language difficulties and psychopathology. In D. V. M. Bishop & L. B. Leonard (Eds.), Speech and language impairments in children: Causes, characteristics, intervention and outcome (pp. 227–244). Psychology Press.
go back to reference Gray, C. A. (1994). Comic strip conversations: Illustrated interactions that teach conversation skills to students with autism and related disorders. Future Horizons. Gray, C. A. (1994). Comic strip conversations: Illustrated interactions that teach conversation skills to students with autism and related disorders. Future Horizons.
go back to reference Gresham, F. M., & Elliott, S. N. (1990). The social skills rating system. American Guidance Service. Gresham, F. M., & Elliott, S. N. (1990). The social skills rating system. American Guidance Service.
go back to reference Gresham, F. M., & Elliott, S. N. (2008). Social skills improvement system: Rating scales. Pearson Assessments. Gresham, F. M., & Elliott, S. N. (2008). Social skills improvement system: Rating scales. Pearson Assessments.
go back to reference Huisingh, R., Bowers, L., & LoGiudice, C. (2005). The test of problem solving, third edition—elementary. LinguiSystems. Huisingh, R., Bowers, L., & LoGiudice, C. (2005). The test of problem solving, third edition—elementary. LinguiSystems.
go back to reference Mokkink, L. B., Terwee, C. B., Patrick, D. L., Alonso, J., Stratford, P. W., Knol, D. L., Bouter, L. M., & de Vet, H. C. (2010). The COSMIN study reached international consensus on taxonomy, terminology, and definitions of measurement properties for health-related patient-reported outcomes. Journal of Clinical Epidemology, 63(7), 737–745. https://doi.org/10.1016/j.jclinepi.2010.02.006CrossRef Mokkink, L. B., Terwee, C. B., Patrick, D. L., Alonso, J., Stratford, P. W., Knol, D. L., Bouter, L. M., & de Vet, H. C. (2010). The COSMIN study reached international consensus on taxonomy, terminology, and definitions of measurement properties for health-related patient-reported outcomes. Journal of Clinical Epidemology, 63(7), 737–745. https://​doi.​org/​10.​1016/​j.​jclinepi.​2010.​02.​006CrossRef
go back to reference Nelson, K. (1978). How young children represent knowledge of their world in and out of language. In R. S. Siegler (Ed.), Children’s thinking: What develops? (pp. 225–273). Erlbaum. Nelson, K. (1978). How young children represent knowledge of their world in and out of language. In R. S. Siegler (Ed.), Children’s thinking: What develops? (pp. 225–273). Erlbaum.
go back to reference Norbury, C. F., Gooch, D., Wray, C., Baird, G., Charman, T., Simonoff, E., Vamvakas, G., & Pickles, A. (2016). The Impact of nonverbal ability on prevalence and clinical presentation of language disorder: Evidence from a population study. Journal of Child Psychology and Psychiatry, 57(11), 1247–1257. https://doi.org/10.1111/jcpp.12573CrossRefPubMed Norbury, C. F., Gooch, D., Wray, C., Baird, G., Charman, T., Simonoff, E., Vamvakas, G., & Pickles, A. (2016). The Impact of nonverbal ability on prevalence and clinical presentation of language disorder: Evidence from a population study. Journal of Child Psychology and Psychiatry, 57(11), 1247–1257. https://​doi.​org/​10.​1111/​jcpp.​12573CrossRefPubMed
go back to reference Pereira, T., Lousada, M., Ramalho, M., & Machado, B. (2019). Programa de intervenção em competências pragmáticas—Versão Pré-Escolar [Manual de Aplicação]. Edição de Autor. Pereira, T., Lousada, M., Ramalho, M., & Machado, B. (2019). Programa de intervenção em competências pragmáticas—Versão Pré-Escolar [Manual de Aplicação]. Edição de Autor.
go back to reference Pereira, T., Lousada, M., Ramalho, M., & Machado, B. (2021). Programa de Intervenção em Competências Pragmáticas: Desenvolvimento, validação de conteúdo e estudo piloto de aceitabilidade. Revista Portuguesa de Terapia da Fala. https://doi.org/11.2181/rptf.2021.12.02 Pereira, T., Lousada, M., Ramalho, M., & Machado, B. (2021). Programa de Intervenção em Competências Pragmáticas: Desenvolvimento, validação de conteúdo e estudo piloto de aceitabilidade. Revista Portuguesa de Terapia da Fala. https://​doi.​org/​11.​2181/​rptf.​2021.​12.​02
go back to reference Polit, D., & Yang, M. (2016). Measurement and the measurement of change. Wolters Kluwer. Polit, D., & Yang, M. (2016). Measurement and the measurement of change. Wolters Kluwer.
go back to reference Rapin, I., & Allen, D. A. (1983). Developmental language disorders: Nosologic considerations. Academic Press. Rapin, I., & Allen, D. A. (1983). Developmental language disorders: Nosologic considerations. Academic Press.
go back to reference Rinaldi, W. (1995). The social use of language programme (primary and pre-school teaching pack). NFER. Rinaldi, W. (1995). The social use of language programme (primary and pre-school teaching pack). NFER.
go back to reference Semel, E., Wiig, E. H., & Secord, W. A. (2000). Clinical evaluation of language fundamentals (3rd ed.). Psychological Corporation. Semel, E., Wiig, E. H., & Secord, W. A. (2000). Clinical evaluation of language fundamentals (3rd ed.). Psychological Corporation.
go back to reference Semel, E., Wiig, E. H., & Secord, W. A. (2006). Clinical evaluation of language fundamentals (4th ed.). Pearson Assessments. Semel, E., Wiig, E. H., & Secord, W. A. (2006). Clinical evaluation of language fundamentals (4th ed.). Pearson Assessments.
go back to reference Shipley, K. G., & McAfee, J. G. (2021). Assessment in speech-language pathology: A resource manual (6th ed.). Plural Publishing. Shipley, K. G., & McAfee, J. G. (2021). Assessment in speech-language pathology: A resource manual (6th ed.). Plural Publishing.
go back to reference Statley, M. J. (2002). An investigation of social-story effectiveness using reversal and multiple-baseline designs [Unpublished Doctoral Dissertation]. Statley, M. J. (2002). An investigation of social-story effectiveness using reversal and multiple-baseline designs [Unpublished Doctoral Dissertation].
go back to reference Vermon, D. S., Schumaker, J. B., & Deshler, D. D. (1996). Score skills: Social skills for cooperative groups. Edge Enterprises Inc. Vermon, D. S., Schumaker, J. B., & Deshler, D. D. (1996). Score skills: Social skills for cooperative groups. Edge Enterprises Inc.
go back to reference Volden, J., Dodd, E., Engel, K., Smith, I. M., Szatmari, P., Fombonne, E., Zwaigenbaum, L., Mirenda, P., Bryson, S., Roberts, W., Vaillancourt, T., Waddell, C., Elsabbagh, M., Teresa, B., Bennett, T., Georgiades, S., Duku, E., study team, P. A. S. D. (2017). Beyond sentences: Using the expression, reception, and recall of narratives instrument to assess communication in school-aged children with autism spectrum disorder. Journal of Speech, Language and Hearing Research, 60(8), 2228–2240. https://doi.org/10.1044/2017_JSLHR-L-16-0168CrossRef Volden, J., Dodd, E., Engel, K., Smith, I. M., Szatmari, P., Fombonne, E., Zwaigenbaum, L., Mirenda, P., Bryson, S., Roberts, W., Vaillancourt, T., Waddell, C., Elsabbagh, M., Teresa, B., Bennett, T., Georgiades, S., Duku, E., study team, P. A. S. D. (2017). Beyond sentences: Using the expression, reception, and recall of narratives instrument to assess communication in school-aged children with autism spectrum disorder. Journal of Speech, Language and Hearing Research, 60(8), 2228–2240. https://​doi.​org/​10.​1044/​2017_​JSLHR-L-16-0168CrossRef
go back to reference Wiig, E. H., Semel, E., & Secord, W. A. (2013). Clinical evaluation of language fundamentals (5th ed.). Pearson Assessments. Wiig, E. H., Semel, E., & Secord, W. A. (2013). Clinical evaluation of language fundamentals (5th ed.). Pearson Assessments.
go back to reference Ziegenfusz, S., Coughlan, A., Paynter, J., Simpson, K., & Westerveld, M. F. (2018). Measuring language progress in students with developmental language disorder while attending a specialist school: A retrospective analysis. Journal of Clinical Practice in Speech-Language Pathology, 20(1), 1–7. Ziegenfusz, S., Coughlan, A., Paynter, J., Simpson, K., & Westerveld, M. F. (2018). Measuring language progress in students with developmental language disorder while attending a specialist school: A retrospective analysis. Journal of Clinical Practice in Speech-Language Pathology, 20(1), 1–7.
Metagegevens
Titel
Psychometric Properties of Standardized Instruments that are Used to Measure Pragmatic Intervention Effects in Children with Developmental Language Disorder: A Systematic Review
Auteurs
Tatiana Pereira
Marisa Lousada
Publicatiedatum
24-02-2022
Uitgeverij
Springer US
Gepubliceerd in
Journal of Autism and Developmental Disorders / Uitgave 5/2023
Print ISSN: 0162-3257
Elektronisch ISSN: 1573-3432
DOI
https://doi.org/10.1007/s10803-022-05481-7

Andere artikelen Uitgave 5/2023

Journal of Autism and Developmental Disorders 5/2023 Naar de uitgave