Hostname: page-component-8448b6f56d-c47g7 Total loading time: 0 Render date: 2024-04-24T20:25:33.262Z Has data issue: false hasContentIssue false

Examining criterion-oriented validity of the Repetitive Behavior Scales for Early Childhood (RBS-EC) and the Video-Referenced Rating of Reciprocal Social Behavior (vrRSB)

Published online by Cambridge University Press:  28 August 2019

Carolyn Lasch
Affiliation:
Institute of Child Development, University of Minnesota, Minneapolis, MN, USA
Jason J. Wolff
Affiliation:
Department of Educational Psychology, University of Minnesota, Minneapolis, MN, USA
Jed T. Elison*
Affiliation:
Institute of Child Development, University of Minnesota, Minneapolis, MN, USA Department of Pediatrics, University of Minnesota, Minneapolis, MN, USA
*
Author for Correspondence: Jed T. Elison, Institute of Child Development, University of Minnesota, 51 E. River Parkway, Minneapolis, MN55455. E-mail: jtelison@umn.edu.

Abstract

Improved characterization of quantitative traits and dimensionally distributed complex behaviors during toddlerhood may improve early identification of autism spectrum disorder and related neurodevelopmental disorders. Parents of 205 community-ascertained toddlers (age: mean = 20.2, SD = 2.6 months) completed the Repetitive Behavior Scales for Early Childhood (RBS-EC) and the Video-Referenced Rating of Reciprocal Social Behavior (vrRSB), with longitudinal follow-up of behavioral assessments and/or another round of parent-report questionnaires. Criterion validity was examined both concurrently and longitudinally using the Infant Toddler Social Emotional Assessment (ITSEA) as a criterion anchor. Reciprocal social behavior as measured by the vrRSB was significantly associated with social competence as measured by the ITSEA, longitudinally and concurrently. Reciprocal social behavior was not associated with the externalizing subscale on the ITSEA, providing evidence of discriminant validity. Higher-order repetitive behaviors (restricted interests; rituals and routines) as measured by RBS-EC subscales were associated with the dysregulation and internalizing subscales of the ITSEA, longitudinally and concurrently. All RBS-EC subscales (excepting repetitive motor) were associated concurrently and longitudinally with the dysregulation subscale of the ITSEA. We report evidence of criterion-oriented and discriminant validity for the constructs/domains captured by the RBS-EC and vrRSB. These instruments may be particularly useful in characterizing dimensional variability across the typical-to-atypical continuum.

Type
Regular Articles
Copyright
Copyright © Cambridge University Press 2019

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders (5th ed.). Arlington, VA: American Psychiatric Publishing. https://doi.org/10.1176/appi.books.9780890425596Google Scholar
Arnott, B., McConachie, H., Meins, E., Fernyhough, C., Le Couteur, A., … & Leekam, S. (2010). The frequency of restricted and repetitive behaviors in a community sample of 15-month-old infants. Journal of Developmental & Behavioral Pediatrics, 31, 223–9. doi:10.1097/DBP.0b013e3181d5a2adCrossRefGoogle Scholar
Baron-Cohen, S., Wheelwright, S., Skinner, R., Martin, J., & Clubley, E. (2001). The autism-spectrum quotient (AQ): Evidence from asperger syndrome/high-functioning autism, males and females, scientists and mathematicians. Journal of Autism and Developmental Disorders, 31, 517. http://dx.doi.org/10.1023/A:1005653411471CrossRefGoogle ScholarPubMed
Bodfish, J. W., Symons, F. J., Parker, D. E., & Lewis, M. H. (2000). Varieties of repetitive behavior in autism: Comparisons to mental retardation. Journal of Autism and Developmental Disorders, 30, 237243. https://doi.org/10.1023/A:1005596502855CrossRefGoogle ScholarPubMed
Carter, A. S., Black, D. O., Tewani, S., Connolly, C.E., Kadlec, M. B., & Tager-Flusberg, H. (2007). Sex differences in toddlers with autism spectrum disorder. Journal of Autism and Developmental Disorders, 37, 8697. doi:10.1007/s10803-006-0331-7CrossRefGoogle Scholar
Carter, A. S., Briggs-Gowan, M. J., Jones, S. M., & Little, T. D. (2003). The infant–toddler social and emotional assessment (ITSEA): Factor structure, reliability, and validity. Journal of Abnormal Child Psychology, 31, 495514. https://doi.org/10.1023/A:1025449031360CrossRefGoogle ScholarPubMed
Cicchetti, D. (1984). The emergence of developmental psychopathology. Child Development, 55, 17.CrossRefGoogle ScholarPubMed
Cicchetti, D. (1993). Developmental psychopathology: Reactions, reflections, projections. Developmental Review, 13, 471502. https://doi.org/10.1006/drev.1993.1021CrossRefGoogle Scholar
Cicchetti, D., & Rogosch, F. A. (1996). Equifinality and multifinality in developmental psychopathology. Development and Psychopathology, 8, 597600.CrossRefGoogle Scholar
Constantino, J. N. (2011). The quantitative nature of autistic social impairment. Pediatric Research, 69, 55R62R. doi:10.1203/PDR.0b013e318212ec6eCrossRefGoogle ScholarPubMed
Constantino, J.N. (2018). Deconstructing autism: From unitary syndrome to contributory developmental endophenotypes. International Review of Psychiatry, 30, 1824. doi:10.1080/09540261.2018.1433133CrossRefGoogle ScholarPubMed
Constantino, J. N., Davis, S. A., Todd, R. D., Schindler, M. K., Gross, M. M., … & Reich, W. (2003). Validation of a brief quantitative measure of autistic traits: Comparison of the social responsiveness scale with the autism diagnostic interview–revised. Journal of Autism and Developmental Disorders, 33, 427433. https://doi.org/10.1023/A:1025014929212CrossRefGoogle ScholarPubMed
Constantino, J. N. & Gruber, C. P. (2005). Social responsiveness scale (SRS-2). Los Angeles: Western Psychological Services.Google Scholar
Constantino, J. N., & Todd, R. D. (2003). Autistic traits in the general population: A twin study. Archives of General Psychiatry, 60, 524530. doi:10.1001/archpsyc.60.5.524CrossRefGoogle ScholarPubMed
Cronbach, L. J., & Meehl, P. E. (1955). Construct validity in psychological tests. Psychological Bulletin, 52, 281302. http://dx.doi.org/10.1037/h0040957CrossRefGoogle ScholarPubMed
Davis, N. O., & Carter, A. S. (2008). Parenting stress in mothers and fathers of toddlers with autism spectrum disorders: Associations with child characteristics. Journal of Autism and Developmental Disorders, 38, 12781291. doi:10.1007/s10803-007-0512-zCrossRefGoogle ScholarPubMed
Dawson, G., Rogers, S., Munson, J., Smith, M., Winter, J., … & Varley, J. (2010). Randomized, controlled trial of an intervention for toddlers with autism: The Early Start Denver model. Pediatrics, 125, e17e23. doi:10.1542/peds.2009-0958CrossRefGoogle ScholarPubMed
Dawson, G., Jones, E. J., Merkle, K., Venema, K., Lowy, R., Faja, S., … Winter, J., & Webb, S.J. (2012). Early behavioral intervention is associated with normalized brain activity in young children with autism. Journal of the American Academy of Child and Adolescent Psychiatry, 51, 1150–9. doi:10.1016/j.jaac. 2012.08.018CrossRefGoogle ScholarPubMed
Dimian, A. F., Botteron, K. N., Dager, S. R., Elison, J. T., Estes, A. M., … & Wolff, J. J.for the IBIS Network. (2017). Potential risk factors for the development of self-injurious behavior among infants at risk for autism spectrum disorder. Journal of Autism and Developmental Disorders, 47, 14031415. doi:10.1007/s10803-017-3057-9.CrossRefGoogle ScholarPubMed
Elison, J. T., Wolff, J. J., Reznick, J. S., Botteron, K. N., Estes, A. M., Gu, H., … Piven, J. (2014). Repetitive behavior in 12-month-olds later classified with autism spectrum disorder. Journal of the American Academy of Child & Adolescent Psychiatry, 53, 12161224. doi:10.1016/j.jaac.2014.08.004CrossRefGoogle ScholarPubMed
Estes, A., Munson, J., Rogers, S. J., Greenson, J., Winter, J., & Dawson, G. (2015). Long-term outcomes of early intervention in 6-year-old children with autism spectrum disorder. Journal of the American Academy of Child & Adolescent Psychiatry, 54, 580587. doi:10.1016/j.jaac.2015.04.005CrossRefGoogle ScholarPubMed
Evans, D. W., Leckman, J. F., Carter, A., Reznick, J. S., Henshaw, D., … & Pauls, D. (1997). Ritual, habit, and perfectionism: The prevelance and development of compulsive-like behaviors in normal young children. Child Development, 68, 5868.CrossRefGoogle Scholar
Evans, D. W., Ujarevic, M., Lusk, L. G., Loth, E., Frazier, T. (2017). Development of two dimensional measures of restricted and repetitive behavior in parents and children. Journal of the American Academy of Child & Adolescent Psychiatry, 56, 51–8. doi:10.1016/j.jaac.2016.10.014CrossRefGoogle ScholarPubMed
Georgiades, S., Szatmari, P., Boyle, M., Hanna, S., Duku, E., … & The Pathways in ASD Study Team. (2013). Investigating phenotypic heterogeneity in children with autism spectrum disorder: A factor mixture modeling approach. Journal of Child Psychology and Psychiatry, 54, 206215. doi:10.1111/j.1469-7610.2012.02588.xCrossRefGoogle ScholarPubMed
Gotham, K., Pickles, A., Lord, C. (2009). Standardizing ADOS scores for a measure of severity in autism spectrum disorders. Journal of Autism and Developmental Disorders, 39, 693705.CrossRefGoogle ScholarPubMed
Happé, F., Ronald, A., & Plomin, R. (2006). Time to give up on a single explanation for autism. Nature Neuroscience, 9, 12181220. doi:10.1038/nn1770CrossRefGoogle ScholarPubMed
Hawks, Z. W., Marrus, N., Glowinski, A. L., & Constantino, J. N. (2018). Early origins of autism comorbidity: Neuropsychiatric traits correlated in childhood are independent in infancy. Journal of Abnormal Psychology [epub ahead of print]. https://doi.org/10.1007/s10802-018-0410-1Google Scholar
Kamio, Y., Inada, N., Moriwaki, A., Kuroda, M., Koyama, T., … & Constantino, J. N. (2013). Quantitative autistic traits ascertained in a national survey of 22,529 Japanese schoolchildren. Acta Psychiatrica Scandinavica, 128, 4553. doi:10.1111/acps.12034CrossRefGoogle Scholar
Kasari, C., Gulsrud, A. C., Wong, C., Kwon, S., & Locke, J. (2010). Randomized controlled caregiver mediated joint engagement intervention for toddlers with autism. Journal of Autism and Developmental Disorders, 40, 10451056. doi:10.1007/s10803-010-0955-5CrossRefGoogle ScholarPubMed
Kim, S. H., Macari, S., Koller, J., & Chawarska, K. (2016). Examining the phenotypic heterogeneity of early autism spectrum disorder: Subtypes and short-term outcomes. Journal of Child Psychology and Psychiatry, 57, 93102. doi:10.1111/jcpp.12448CrossRefGoogle ScholarPubMed
Lam, K. S. L., & Aman, M. G. (2007). The Repetitive Behavior Scale-Revised: Independent validation in individuals with autism spectrum disorders. Journal of Autism and Developmental Disorders, 37, 855866. doi:10.1007/s10803-006-0213-zCrossRefGoogle ScholarPubMed
Landa, R. J., Gross, A. L., Stuart, E. A., & Bauman, M. (2012). Latent class analysis of early developmental trajectory in baby siblings of children with autism. Journal of Child Psychology and Psychiatry, 53, 986996. doi:10.1111/j.1469-7610.2012.02558.xCrossRefGoogle ScholarPubMed
Leekam, S., Tandos, J., McConachie, H., Meins, E., Parkinson, K., … & Le Couteur, A. (2007). Repetitive behaviours in typically developing 2-year-olds. Journal of Child Psychology and Psychiatry, 48, 11311138. doi:10.1111/j.1469-7610.2007.01778.xCrossRefGoogle ScholarPubMed
Lombardo, M. V., Lai, M .C., Auyeung, B., Holt, R. J., Allison, C., … & Baron-Cohen, S. (2016). Unsupervised data-driven stratification of mentalizing heterogeneity in autism. Scientific Reports, 6, 35333. doi:10.1038/srep35333CrossRefGoogle ScholarPubMed
Lord, C., Risi, S., Lambrecht, L., Cook, E. H., Leventhal, B. L., … & Rutter, M. (2000). The autism diagnostic observation schedule-generic: A standard measure of social and communication deficits associated with the spectrum of autism. Journal of Autism and Developmental Disorders, 30, 205223. doi:10.1023/A:1005592401947CrossRefGoogle ScholarPubMed
Marrus, N., Glowinskie, A. L, Jacob, T., Klin, A., Jones, W., … & Constantino, J. N. (2015). Rapid video-referenced ratings of reciprocal social behavior in toddlers: A twin study. Journal of Child Psychology and Psychiatry, 56, 13381346. doi:10.1111/jcpp.12391CrossRefGoogle ScholarPubMed
Marrus, N., Kennon-McGill, S., Harris, B., Zhang, Y., Glowinski, A. L., & Constantino, J. N. (2018). Use of a video scoring anchor for rapid serial assessment of social communication in toddlers. Journal of Visualized Experiments, 133, e57041. doi:10.3791/57041Google Scholar
Messinger, D., Young, G. S., Ozonoff, S., Dobkins, K., Carter, A., … & Sigman, M. (2013). Beyond autism: A baby siblings research consortium study of high-risk children at three years of age. Journal of the American Academy of Child & Adolescent Psychiatry, 52, 300–8. doi:10.1016/j.jaac.2012.12.011CrossRefGoogle Scholar
Mirenda, P., Smith, I. M., Vaillancourt, T., Georgiades, S., Duku, E., … & The Pathways in ASD Study Team. (2010). Validating the repetitive behavior scales-revised in young children with autism spectrum disorder. Journal of Autism and Developmental Disorders, 40, 1521–30. doi:10.1007/s10803-010-1012-0CrossRefGoogle Scholar
Mullen, E. M. (1995). Mullen Scales of Early Learning. Circle Pines, MN: AGS Publishing.Google Scholar
Ozonoff, S., Macari, S., Young, G. S., Goldring, S., Thompson, M., & Rogers, S. J. (2008). Atypical object exploration at 12 months of age is associated with autism in a prospective sample. Autism, 12, 457472. doi:10.1177/1362361308096402CrossRefGoogle Scholar
Pruett, J. R., & Povinelli, D. J. (2016). Commentary—Autism Spectrum Disorder: Spectrum or cluster? Autism Research, 9, 12371240. doi:10.1002/aur.1650CrossRefGoogle ScholarPubMed
Reynolds, A. M., Soke, G. N., Sabourin, K. R., Hepburn, S., Katz, T., … & Levy, S.E. (2019). Sleep problems in 2- to 5-year-olds with autism spectrum disorder and other developmental delays. Pediatrics, 145, e20180492.Google Scholar
Rogers, S. J., Vismara, L., Wagner, A. L., McCormick, C., Young, G., & Ozonoff, S. (2014). Autism treatment in the first year of life: A pilot study or infant start, a parent-implemented intervention for symptomatic infants. Journal of Autism and Developmental Disorders, 44, 29812995. doi:10.1007/s10803-014-2202-yCrossRefGoogle ScholarPubMed
Ronald, A., Happé, F., Bolton, P., Butcher, L. M., Price, T. S., … & Plomin, R. (2006). Genetic heterogeneity between the three components of the autism spectrum: A twin study. Journal of the American Academy of Child & Adolescent Psychiatry, 45, 691699. doi:10.1097/01.chi.0000215325.13058.9dCrossRefGoogle ScholarPubMed
Rutter, M., & Schopler, E. (1987). Autism and pervasive developmental disorders: Concepts and diagnostic issues. Journal of Autism and Developmental Disorders, 17, 159186. http://dx.doi.org/10.1007/BF01495054CrossRefGoogle ScholarPubMed
Shattuck, P. T., Durkin, M., Maenner, M., Newschaffer, C., Mandell, D.S., … & Cuniff, C. (2009). Timing of identification among children with an autism spectrum disorder: Findings from a population-based surveillance study. Journal of the American Academy of Child & Adolescent Psychiatry, 48, 474483. doi:10.1097/CHI.0b013e31819b3848CrossRefGoogle ScholarPubMed
Shattuck, P. T., & Grosse, S. D. (2007). Issues related to the diagnosis and treatment of autism spectrum disorder. Mental Retardation and Developmental Disabilities Research Reviews, 13, 129135. doi:10.1002/mrdd.20143CrossRefGoogle Scholar
Sifre, R., Lasch, C., Fenoglio, A., Georgieff, M. K., Wolff, J. J., & Elison, J. T. (2018). Restricted, repetitive, and reciprocal social behavior in toddlers born small for gestational duration. Journal of Pediatrics, 200, 118124. https://doi.org/10.1016/j.jpeds.2018.05.003CrossRefGoogle Scholar
Singer, E., & Ye, C. (2013). The use and effects of incentives in surveys. Annals of the American Academy of Political and Social Science, 645, 112141. https://doi.org/10.1177/0002716212458082CrossRefGoogle Scholar
Sparrow, S., Balla, D., & Cicchetti, D. (2005). Vineland adaptive behavior scales, 2nd ed. Shoreview, MN: AGS Publishing.Google Scholar
Sroufe, L.A., & Rutter, M. (1984). The domain of developmental psychopathology. Child Development, 55, 1729.CrossRefGoogle ScholarPubMed
Uljarevic, M., Arnott, B., Carrington, S. J., Meins, E., Fernyhough, C., … & Leekam, S. (2017). Development of restricted and repetitive behaviors from 15 to 77 months: Stability of two distinct subtypes? Developmental Psychology, 53, 18591868. doi:10.1037/dev0000324CrossRefGoogle ScholarPubMed
Vaughan Van Hecke, A., Mundy, P. C., Acra, C. F., Delgado, C. E., Parlade, M. V., … & Pomares, Y.B. (2007). Infant joint attention, temperament, and social competence in preschool children. Child Development, 78, 5369. doi:10.1111/j.1467-8624.2007.00985.x.InfantCrossRefGoogle ScholarPubMed
von Bertalanffy, L. (1968). General systems theory. New York, NY: George Braziller.Google Scholar
Wagner, R. E., Zhang, Y., Gray, T., Abbacchi, A., Cormier, D., … & Constantino, J. N. (2019). Autism-related variation in reciprocal social behavior: A longitudinal study. Child Development, 90, 441451.CrossRefGoogle ScholarPubMed
Wakschlag, L. S., Estabrook, R., Petitclerc, A., Henry, D., Burns, J. L., … & Briggs-Gowan, M. L. (2015). Clinical implications of a dimensional approach: The normal:abnormal spectrum of early irritability. Journal of the American Academy of Child & Adolescent Psychiatry, 54, 626634. doi:10.1016/j.jaac.2015.05.016CrossRefGoogle ScholarPubMed
Weigold, A., Weigold, I. K., & Russell, E. J. (2013). Examination of the equivalence of self-report survey-based paper-and-pencil and internet data collection methods. Psychological Methods, 18, 5370. http://dx.doi.org/10.1037/a0031607CrossRefGoogle ScholarPubMed
Wolff, J. J., Botteron, K. N., Dager, S. R., Elison, J. T., Estes, A. M., … & Piven, J.for the IBIS Network. (2014). Longitudinal patterns of repetitive behavior in toddlers with autism. Journal of Child Psychology and Psychiatry, 55, 945953. https://doi.org/10.1111/jcpp.12207CrossRefGoogle ScholarPubMed
Wolff, J. J., Boyd, B. A. & Elison, J. T. (2016). A quantitative measure of restricted and repetitive behaviors for early childhood. Journal of Neurodevelopmental Disorder, 8. https://doi.org/10.1186/s11689-016-9161-xCrossRefGoogle ScholarPubMed
Wolff, J. J., Dimian, A. F., Botteron, K. N., Dager, S. R., Elison, J. T., … & Piven, J.for the IBIS Network. (2019). A longitudinal study of parent-reported sensory responsiveness in toddlers at-risk for autism. Journal of Child Psychology and Psychiatry, 60, 314324.CrossRefGoogle ScholarPubMed
Zwaigenbaum, L., Bauman, M. L., Stone, W. L., Yirmiya, N., Estes, A., … & Wetherby, A. (2015). Early identification of autism spectrum disorder: Recommendations for practice and research. Pediatrics, 136 s10s40. doi:10.1542/peds.2014-3667CCrossRefGoogle ScholarPubMed