Skip to main content
Top
Gepubliceerd in:

15-12-2017 | Original Paper

Identifying Autism with a Brief and Low-Cost Screening Instrument—OERA: Construct Validity, Invariance Testing, and Agreement Between Judges

Auteurs: Cristiane S. Paula, Graccielle Rodrigues Cunha, Daniela Bordini, Decio Brunoni, Ana Claudia Moya, Cleonice Alves Bosa, Jair J. Mari, Hugo Cogo-Moreira

Gepubliceerd in: Journal of Autism and Developmental Disorders | Uitgave 5/2018

Log in om toegang te krijgen
share
DELEN

Deel dit onderdeel of sectie (kopieer de link)

  • Optie A:
    Klik op de rechtermuisknop op de link en selecteer de optie “linkadres kopiëren”
  • Optie B:
    Deel de link per e-mail

Abstract

Simple and low-cost observational-tools to detect symptoms of Autism Spectrum Disorder (ASD) are still necessary. The OERA is a new assessment tool to screen children eliciting observable behaviors with no substantial knowledge on ASD required. The sample was 99 children aged 3–10: 76 with ASD and 23 without ASD (11/23 had intellectual disability). The 13 remained items exhibited high interrater agreement and high reliability loaded onto a single latent trait. Such model showed excellent fit indices evaluated via confirmatory factor analysis and no item showed differential function in terms of age/sex/IQ. A cutoff of five points or higher resulted in the highest sensitivity (92.75) and specificity (90.91) percentages. OERA is a brief, stable, low-cost standardized observational-screening to identify ASD children.
Literatuur
go back to reference Agency for Healthcare Research and Quality, A. E. H. C. P. (2014). Therapies for children with autism spectrum disorder: Behavioral interventions update. Rockville, MD. Agency for Healthcare Research and Quality, A. E. H. C. P. (2014). Therapies for children with autism spectrum disorder: Behavioral interventions update. Rockville, MD.
go back to reference American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders, 5th edn. Arlington, VA: American Psychiatric Publishing.CrossRef American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders, 5th edn. Arlington, VA: American Psychiatric Publishing.CrossRef
go back to reference Bagaiolo, L., Mari, JdeJ., Bordini, D., Ribeiro, T. C., Martone, M. C. C., Brunoni, D., … Paula, C. S. (2017). Procedures and compliance of a videomodeling ABA intervention for Brazilian parents of children with Autism Spectrum Disorders. Autism: The International Journal of Research and Practice, 21(5), 603–610.CrossRef Bagaiolo, L., Mari, JdeJ., Bordini, D., Ribeiro, T. C., Martone, M. C. C., Brunoni, D., … Paula, C. S. (2017). Procedures and compliance of a videomodeling ABA intervention for Brazilian parents of children with Autism Spectrum Disorders. Autism: The International Journal of Research and Practice, 21(5), 603–610.CrossRef
go back to reference Baker, F. B., & Kim, S.-H. (2004). Item response theory: Parameter estimation techniques (2nd edn.). CRC Press: Boca Raton, FL. Baker, F. B., & Kim, S.-H. (2004). Item response theory: Parameter estimation techniques (2nd edn.). CRC Press: Boca Raton, FL.
go back to reference Becker, M. M., Wagner, M. B., Bosa, C., Schmidt, C., Longo, D., Papaleo, C., & Riesgo, R. S. (2012). Translation and validation of autism diagnostic interview-revised (ADI-R) for autism diagnosis in Brazil. Arquivos de Neuro-Psiquiatria, 70(3), 185–190. Retrieved from http://www.ncbi.nlm.nih.gov/pubmed/22392110. Becker, M. M., Wagner, M. B., Bosa, C., Schmidt, C., Longo, D., Papaleo, C., & Riesgo, R. S. (2012). Translation and validation of autism diagnostic interview-revised (ADI-R) for autism diagnosis in Brazil. Arquivos de Neuro-Psiquiatria, 70(3), 185–190. Retrieved from http://​www.​ncbi.​nlm.​nih.​gov/​pubmed/​22392110.
go back to reference Bishop, S. L., Huerta, M., Gotham, K., Havdahl, A. K., Pickles, A., Duncan, A., … Lord, C. (2017). The autism symptom interview, school-age: A brief telephone interview to identify autism spectrum disorders in 5-to-12-year-old children. Autism Research, 10(1), 78–88. https://doi.org/10.1002/aur.1645.CrossRefPubMed Bishop, S. L., Huerta, M., Gotham, K., Havdahl, A. K., Pickles, A., Duncan, A., … Lord, C. (2017). The autism symptom interview, school-age: A brief telephone interview to identify autism spectrum disorders in 5-to-12-year-old children. Autism Research, 10(1), 78–88. https://​doi.​org/​10.​1002/​aur.​1645.CrossRefPubMed
go back to reference Bollen, K. (1998). Structural equations with latent variables. New York: Wiley. Bollen, K. (1998). Structural equations with latent variables. New York: Wiley.
go back to reference Brown, T. (2015). Confirmatory factor analysis for applied research. New York: Guilford Publications. Brown, T. (2015). Confirmatory factor analysis for applied research. New York: Guilford Publications.
go back to reference Cohen, J. (2013). Statistical power analysis for the behavioral sciences. New York: Academic Press. Cohen, J. (2013). Statistical power analysis for the behavioral sciences. New York: Academic Press.
go back to reference Cruz, M. (2005). WISC III: Escala de Inteligência Wechsler para crianças: Manual. Avaliação Psicológica, 4(2), 199–201. Cruz, M. (2005). WISC III: Escala de Inteligência Wechsler para crianças: Manual. Avaliação Psicológica, 4(2), 199–201.
go back to reference de Bildt, A., Mulder, E. J., Hoekstra, P. J., van Lang, N. D. J., Minderaa, R. B., & Hartman, C. A. (2009). Validity of the Children’s Social Behavior Questionnaire (CSBQ) in children with intellectual disability: Comparing the CSBQ with ADI-R, ADOS, and clinical DSM-IV-TR classification. Journal of Autism and Developmental Disorders, 39(10), 1464–1470. https://doi.org/10.1007/s10803-009-0764-x.CrossRefPubMedPubMedCentral de Bildt, A., Mulder, E. J., Hoekstra, P. J., van Lang, N. D. J., Minderaa, R. B., & Hartman, C. A. (2009). Validity of the Children’s Social Behavior Questionnaire (CSBQ) in children with intellectual disability: Comparing the CSBQ with ADI-R, ADOS, and clinical DSM-IV-TR classification. Journal of Autism and Developmental Disorders, 39(10), 1464–1470. https://​doi.​org/​10.​1007/​s10803-009-0764-x.CrossRefPubMedPubMedCentral
go back to reference de Macedo, E. C., Mecca, T. P., Valentini, F., Laros, J. A., de Lima, R. M. F., & Schwartzman, J. S. (2013). Utilizando o teste não verbal de inteligência SON-R 2 1/2—7 [a] para avaliar crianças com Transtornos do Espectro do Autismo. Revista Educação Especial, 26(47), 603–618. https://doi.org/10.5902/1984686X9779.CrossRef de Macedo, E. C., Mecca, T. P., Valentini, F., Laros, J. A., de Lima, R. M. F., & Schwartzman, J. S. (2013). Utilizando o teste não verbal de inteligência SON-R 2 1/2—7 [a] para avaliar crianças com Transtornos do Espectro do Autismo. Revista Educação Especial, 26(47), 603–618. https://​doi.​org/​10.​5902/​1984686X9779.CrossRef
go back to reference Du Toit, M. (2003). IRT from SSI: Bilog-MG, multilog, parscale, testfact. Lincolnwood: Scientific Software International. Du Toit, M. (2003). IRT from SSI: Bilog-MG, multilog, parscale, testfact. Lincolnwood: Scientific Software International.
go back to reference Figueiredo, V. (2002). WISC-III: Escala de Inteligência Weschler para crianças—adaptação brasileira da 3° edição. São Paulo: Casa do Psicólogo. Figueiredo, V. (2002). WISC-III: Escala de Inteligência Weschler para crianças—adaptação brasileira da 3° edição. São Paulo: Casa do Psicólogo.
go back to reference Gollenberg, A. L., Lynch, C. D., Jackson, L. W., McGuinness, B. M., & Msall, M. E. (2010). Concurrent validity of the parent-completed Ages and Stages Questionnaires, 2nd Ed. with the Bayley Scales of Infant Development II in a low-risk sample. Child: Care, Health and Development, 36(4), 485–490. https://doi.org/10.1111/j.1365-2214.2009.01041.x. Gollenberg, A. L., Lynch, C. D., Jackson, L. W., McGuinness, B. M., & Msall, M. E. (2010). Concurrent validity of the parent-completed Ages and Stages Questionnaires, 2nd Ed. with the Bayley Scales of Infant Development II in a low-risk sample. Child: Care, Health and Development, 36(4), 485–490. https://​doi.​org/​10.​1111/​j.​1365-2214.​2009.​01041.​x.
go back to reference Krug, D. A., Arick, J., & Almond, P. (1980). Behavior checklist for identifying severely handicapped individuals with high levels of autistic behavior. Journal of Child Psychology and Psychiatry, and Allied Disciplines, 21(3), 221–229. Retrieved from http://www.ncbi.nlm.nih.gov/pubmed/7430288. Krug, D. A., Arick, J., & Almond, P. (1980). Behavior checklist for identifying severely handicapped individuals with high levels of autistic behavior. Journal of Child Psychology and Psychiatry, and Allied Disciplines, 21(3), 221–229. Retrieved from http://​www.​ncbi.​nlm.​nih.​gov/​pubmed/​7430288.
go back to reference Le Couteur, A., Rutter, M., Lord, C., Rios, P., Robertson, S., Holdgrafer, M., & McLennan, J. (1989). Autism diagnostic interview: A standardized investigator-based instrument. Journal of Autism and Developmental Disorders, 19(3), 363–387. Retrieved from http://www.ncbi.nlm.nih.gov/pubmed/2793783. Le Couteur, A., Rutter, M., Lord, C., Rios, P., Robertson, S., Holdgrafer, M., & McLennan, J. (1989). Autism diagnostic interview: A standardized investigator-based instrument. Journal of Autism and Developmental Disorders, 19(3), 363–387. Retrieved from http://​www.​ncbi.​nlm.​nih.​gov/​pubmed/​2793783.
go back to reference Lord, C., Risi, S., Lambrecht, L., Cook, E. H., Leventhal, B. L., DiLavore, P. C., … Rutter, M. (2000). The autism diagnostic observation schedule-generic: A standard measure of social and communication deficits associated with the spectrum of autism. Journal of Autism and Developmental Disorders, 30(3), 205–223. Retrieved from http://www.ncbi.nlm.nih.gov/pubmed/11055457. Lord, C., Risi, S., Lambrecht, L., Cook, E. H., Leventhal, B. L., DiLavore, P. C., … Rutter, M. (2000). The autism diagnostic observation schedule-generic: A standard measure of social and communication deficits associated with the spectrum of autism. Journal of Autism and Developmental Disorders, 30(3), 205–223. Retrieved from http://​www.​ncbi.​nlm.​nih.​gov/​pubmed/​11055457.
go back to reference Marsh, H., Hau, K., & Wen, Z. (2004). In search of golden rules: Comment on hypothesis-testing approaches to setting cutoff values for fit indexes and dangers in overgeneralizing Hu and Bentler’s 1999 findings. Structural Equation Modeling, 11, 320–341.CrossRef Marsh, H., Hau, K., & Wen, Z. (2004). In search of golden rules: Comment on hypothesis-testing approaches to setting cutoff values for fit indexes and dangers in overgeneralizing Hu and Bentler’s 1999 findings. Structural Equation Modeling, 11, 320–341.CrossRef
go back to reference McEwen, F. S., Stewart, C. S., Colvert, E., Woodhouse, E., Curran, S., Gillan, N., … Bolton, P. (2016). Diagnosing autism spectrum disorder in community settings using the Development and Well-Being Assessment: Validation in a UK population-based twin sample. Journal of Child Psychology and Psychiatry, 57(2), 161–170. https://doi.org/10.1111/jcpp.12447.CrossRefPubMed McEwen, F. S., Stewart, C. S., Colvert, E., Woodhouse, E., Curran, S., Gillan, N., … Bolton, P. (2016). Diagnosing autism spectrum disorder in community settings using the Development and Well-Being Assessment: Validation in a UK population-based twin sample. Journal of Child Psychology and Psychiatry, 57(2), 161–170. https://​doi.​org/​10.​1111/​jcpp.​12447.CrossRefPubMed
go back to reference Muthen, B., & Asparouhov, T. (2004). IRT studies of many groups: The alignment method. Frontiers in Psychology, 11, 320–341. Muthen, B., & Asparouhov, T. (2004). IRT studies of many groups: The alignment method. Frontiers in Psychology, 11, 320–341.
go back to reference Muthén, B., Toit, D. S. H., & Spisic, D. (1997). Robust inference using weighted least squares and quadratic estimating equations in latent variable modeling with categorical and continuous outcomes. Psychometrika, 75, 1–45. Muthén, B., Toit, D. S. H., & Spisic, D. (1997). Robust inference using weighted least squares and quadratic estimating equations in latent variable modeling with categorical and continuous outcomes. Psychometrika, 75, 1–45.
go back to reference Obuchowski, N., McClish, D. (1997). Sample size determination for diagnostic accuracy studies involving binormal roc curve indices. Statistics in Medicine, 16(13), 1529–1542.CrossRefPubMed Obuchowski, N., McClish, D. (1997). Sample size determination for diagnostic accuracy studies involving binormal roc curve indices. Statistics in Medicine, 16(13), 1529–1542.CrossRefPubMed
go back to reference Ozonoff, S., Goodlin-Jones, B. L., & Solomon, M. (2005). Evidence-based assessment of autism spectrum disorders in children and adolescents. Journal of Clinical Child and Adolescent Psychology: The Official Journal for the Society of Clinical Child and Adolescent Psychology, American Psychological Association, Division 53, 34(3), 523–540. https://doi.org/10.1207/s15374424jccp3403_8.CrossRef Ozonoff, S., Goodlin-Jones, B. L., & Solomon, M. (2005). Evidence-based assessment of autism spectrum disorders in children and adolescents. Journal of Clinical Child and Adolescent Psychology: The Official Journal for the Society of Clinical Child and Adolescent Psychology, American Psychological Association, Division 53, 34(3), 523–540. https://​doi.​org/​10.​1207/​s15374424jccp340​3_​8.CrossRef
go back to reference Raykov, T. (1997). Scale reliability, Cronbach’s coefficient alpha, and violations of essential tau-equivalence for fixed congeneric components. Multivariate Behavioral Research, 32, 329–354.CrossRefPubMed Raykov, T. (1997). Scale reliability, Cronbach’s coefficient alpha, and violations of essential tau-equivalence for fixed congeneric components. Multivariate Behavioral Research, 32, 329–354.CrossRefPubMed
go back to reference The Psychological Corporation. (1992). Weschler Individual Achievement Test. San Antonio, CA: The Psychological Corporation. The Psychological Corporation. (1992). Weschler Individual Achievement Test. San Antonio, CA: The Psychological Corporation.
go back to reference Van de Schoot, R., Kluytmans, A., Tummers, L., Lugtig, P., Hox, J., & Muthen, B. (2013). Facing off with Scylla and Charybdis: A comparison of scalar, partial, and the novel possibility of approximate measurement invariance. Frontiers in Psychology, 23(4), 770. https://doi.org/10.3389/fpsyg.2013.00770. Van de Schoot, R., Kluytmans, A., Tummers, L., Lugtig, P., Hox, J., & Muthen, B. (2013). Facing off with Scylla and Charybdis: A comparison of scalar, partial, and the novel possibility of approximate measurement invariance. Frontiers in Psychology, 23(4), 770. https://​doi.​org/​10.​3389/​fpsyg.​2013.​00770.
go back to reference Yu, C.-Y. (2002). Evaluating cutoff criteria of model fit indices for latent variable models with binary and continuous outcomes. University of California, Los Angeles. Yu, C.-Y. (2002). Evaluating cutoff criteria of model fit indices for latent variable models with binary and continuous outcomes. University of California, Los Angeles.
Metagegevens
Titel
Identifying Autism with a Brief and Low-Cost Screening Instrument—OERA: Construct Validity, Invariance Testing, and Agreement Between Judges
Auteurs
Cristiane S. Paula
Graccielle Rodrigues Cunha
Daniela Bordini
Decio Brunoni
Ana Claudia Moya
Cleonice Alves Bosa
Jair J. Mari
Hugo Cogo-Moreira
Publicatiedatum
15-12-2017
Uitgeverij
Springer US
Gepubliceerd in
Journal of Autism and Developmental Disorders / Uitgave 5/2018
Print ISSN: 0162-3257
Elektronisch ISSN: 1573-3432
DOI
https://doi.org/10.1007/s10803-017-3440-6

Andere artikelen Uitgave 5/2018

Journal of Autism and Developmental Disorders 5/2018 Naar de uitgave