Skip to main content
SpringerLink
Log in

Inter-rater Reliability of the Anxiety Disorders Interview Schedule for DSM-IV in High-Functioning Youth with Autism Spectrum Disorder

  • ORIGINAL ARTICLE
  • Published:
Journal of Developmental and Physical Disabilities Aims and scope Submit manuscript

Abstract

The present study examined inter-rater agreement on the Anxiety Disorder Interview Schedule DSM-IV Child and Parent Interview (ADIS-IV-C/P) in high-functioning youth with autism spectrum disorder and if age and ASD diagnosis moderated agreement. Diagnoses established for 70 7 to 16-year-old youth with ASD during a live administration of the ADIS-IV-C/P were compared to diagnoses identified by a second rater after listening to audiotaped recordings of the interviews. Clinician-to-clinician agreement on individual parent and child reports was excellent (k = 1.00). Inter-rater agreement on principal diagnoses (k = 0.91), individual anxiety diagnoses (k = 0.85–0.97), and other comorbid diagnoses (i.e., major depressive disorder, dysthymia, oppositional defiant disorder) (k = 0.89–1.00) were excellent; agreement did not differ as a function of ASD diagnosis or age. Results suggest good to excellent inter-rater agreement for disorders assessed by the ADIS-IV-C/P.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • American Psychiatric Association. (2000). Diagnostic and statistical manual of mental disorders, 4th edition (DSM-IV). Washington, DC: American Psychiatric Press.

    Google Scholar 

  • Attwood, T. (2003). Framework for behavioral interventions. Child and Adolescent Psychiatric Clinics of North America, 12, 65–86.

    Article  PubMed  Google Scholar 

  • Bauminger, N., & Kasari, C. (2000). Loneliness and friendship in high-functioning children with autism. Child Development, 71, 447–456.

    Article  PubMed  Google Scholar 

  • Bellini, S. (2004). Social skill deficits and anxiety in high-functioning adolescents with autism spectrum disorders. Focus on Autism and Other Developmental Disabilities, 19, 78–86.

    Article  Google Scholar 

  • Blackman, N. J. M., & Koval, J. J. (2000). Interval estimation for Cohen’s kappa as a measure of agreement. Statistics in Medicine, 19, 723–741.

    Article  PubMed  Google Scholar 

  • Buitelaar, J. K., Van der Gaag, R., Klin, A., & Volkmar, F. (1999). Exploring the boundaries of pervasive developmental disorder not otherwise specified: analyses of data from the DSM-IV autistic disorder field trials. Journal of Autism and Developmental Disorders, 29, 33–43.

    Article  PubMed  Google Scholar 

  • Chamberlin, B., Kasari, C., & Rotheram-Fuller, E. (2007). Involvement or isolation? The social networks of children with autism in regular classrooms. Journal of Autism and Developmental Disorders, 37, 230–242.

    Article  Google Scholar 

  • Choudhury, M. S., Pimentel, S. S., & Kendall, P. C. (2003). Childhood anxiety disorders: parent–child (dis)agreement using a structured interview for the DSM-IV. Journal of the American Academy of Child and Adolescent Psychiatry, 42, 957–964.

    Article  PubMed  Google Scholar 

  • Cohen, J. (1960). A coefficient of agreement for nominal scales. Educational and Psychological Measurement, 20, 37–46.

    Article  Google Scholar 

  • Cormier, S., Nurius, P. S., & Osborn, C. J. (2009). Interviewing and change strategies for helpers. Belmont: Brooks/Cole, Cengage Learning.

    Google Scholar 

  • de Bruin, E. I., Verheij, F., & Ferdinand, R. F. (2006). WISC-R subtest but no overall VIQ-PIQ differences in Dutch children with PDD-NOS. Journal of Abnormal Child Psychology, 34, 254–262.

    Article  Google Scholar 

  • de Bruin, E. I., Ferdinand, R. F., Meester, S., de Nijs, P. F. A., & Verheij, F. (2007). High rates of psychiatric co-morbidity in PDD-NOS. Journal of Autism and Developmental Disorders, 37, 877–886.

    Article  PubMed  Google Scholar 

  • Edelbrock, C., Costello, A. J., Dulcan, M. K., Kalas, R., & Conover, N. C. (1985). Age differences in the reliability of the psychiatric interview of the child. Child Development, 56, 265–275.

    Article  PubMed  Google Scholar 

  • Gillott, A., Furniss, F., & Walter, A. (2001). Anxiety in high-functioning children with autism. Autism, 5, 277–286.

    Article  PubMed  Google Scholar 

  • Grills, A. E., & Ollendick, T. H. (2003). Multiple informant agreement and the anxiety disorders interview schedule for parents and child. Journal of the American Academy of Child and Adolescent Psychiatry, 42, 30–40.

    Article  PubMed  Google Scholar 

  • Grondhuis, S. N., & Aman, M. G. (2012). Assessment of anxiety in children and adolescents with Autism Spectrum Disorders. Research in Autism Spectrum Disorders, 6, 1345–1365.

    Article  Google Scholar 

  • Groth-Marnet, G. (2009). Handbook of psychological assessment. Hoboken: John Wiley and Sons, Inc.

    Google Scholar 

  • Gwet, K. L. (2012). Handbook of inter-rater reliability. Gaithersburg: Advanced Analytics, LLC.

    Google Scholar 

  • Kim, J. A., Szatmari, P., Bryson, S. E., Streiner, D. L., & Wilson, F. J. (2000). The prevalence of anxiety and mood problems among children with autism and Asperger syndrome. Autism, 4, 117–132.

    Article  Google Scholar 

  • King, B. H., Hollander, E., Sikich, L., McCracken, J. T., Scahill, L., Bregman, J. D., et al. (2009). Lack of efficacy of citalopram in children with autism spectrum disorders and high levels of repetitive behavior: citalopram ineffective in children with autism. Archives of General Psychiatry, 66, 583–590.

    Article  PubMed  Google Scholar 

  • Lewin, A. B., & Piacentini, J. (2010). Evidence-based assessment of child obsessive compulsive disorder: recommendations for clinical practice and treatment research. Child & Youth Care Forum, 39(2), 73–89.

    Article  Google Scholar 

  • Lewin, A. B., Wood, J. J., Gunderson, S., Murphy, T. K., & Storch, E. A. (2011). Obsessive compulsive symptoms in youth with high functioning autism spectrum disorders. Journal of Developmental and Physical Disabilities, 23, 543–553.

    Article  Google Scholar 

  • Leyfer, O. T., Folstein, S. E., Bacalman, S., Davis, N. O., Dinh, E., Morgan, J., et al. (2006). Comorbid psychiatric disorders in children with autism: interview development and rates of disorders. Journal of Autism and Developmental Disorders, 36, 849–861.

    Article  PubMed  Google Scholar 

  • Lord, C., Rutter, M., & Le Couteur, A. (1994). Autism diagnostic interview-revised: a revised version of a diagnostic interview for caregivers of individuals with possible pervasive developmental disorders. Journal of Autism and Developmental Disorders, 24, 659–685.

    Article  PubMed  Google Scholar 

  • Lord, C., Rutter, M., DiLavore, P. C., & Risi, S. (1999). Autism diagnostic observation schedule. Los Angeles: Western Psychological Services.

    Google Scholar 

  • Lord, C., Rutter, M., DiLavore, P. C., & Risi, S. (2000). Autism diagnostic observation schedule. Los Angeles: Western Psychological Services.

    Google Scholar 

  • Lyneham, H. J., & Rapee, R. M. (2005). Agreement between telephone and in-person delivery of a structured interview for anxiety disorders in children. Journal of the American Academy of Child and Adolescent Psychiatry, 44, 274–282.

    Article  PubMed  Google Scholar 

  • Lyneham, H. J., Abbott, M. J., & Rapee, R. M. (2007). Inter-rater reliability of the anxiety disorders interview schedule for DSM-IV: child and parent version. Journal of the American Academy of Child and Adolescent Psychiatry, 46, 731–736.

    Article  PubMed  Google Scholar 

  • Mannuzza, S., Fyer, A. J., Martin, L. Y., Gallops, M. S., Endicott, J., Gorman, J., et al. (1989). Reliability of anxiety assessment: I. Diagnostic agreement. Archives of General Psychiatry, 46, 1093–1101.

    Article  PubMed  Google Scholar 

  • Muris, P., Steerneman, P., Merckelbach, H., Holdrinet, I., & Meesters, C. (1998). Comorbid anxiety symptoms in children with pervasive developmental disorders. Journal of Anxiety Disorders, 12, 387–393.

    Article  PubMed  Google Scholar 

  • Nadeau, J., Sulkowski, M. L., Ung, D., Wood, J. J., Lewin, A. B., Murphy, T. K., et al. (2011). Treatment of comorbid anxiety and autism spectrum disorder. Neuropsychiatry, 1, 567–578.

    Article  PubMed Central  PubMed  Google Scholar 

  • Prior, M., Eisenmajer, R., Leckam, S., Wing, L., Gould, J., Ong, et al. (1998). Are there subgroups within the autistic spectrum? A cluster analysis of a group of children with autistic spectrum disorders. Journal of Child Psychology and Psychiatry, 39, 893–902.

    Article  PubMed  Google Scholar 

  • Rapee, R. M., Barrett, P. M., Dadds, M. R., & Evans, L. (1994). Reliability of the DSM-III-R childhood anxiety disorders using structured interview: inter-rater and parent–child agreement. Journal of the American Academy of Child and Adolescent Psychiatry, 33, 984–992.

    Article  PubMed  Google Scholar 

  • Reaven, J., Blakeley-Smith, A., Culhane-Shelburne, K., & Hepburn, S. (2011). Group cognitive behavior therapy for children with high-functioning autism spectrum disorders and anxiety: a randomized trial. Journal of Child Psychology and Psychiatry, 53, 410–419.

    Article  Google Scholar 

  • Rutter, M., LeCouteur, A., & Lord, C. (2003). Autism diagnostic interview revised: Wps edition manual. Los Angeles: Western Psychological Services.

    Google Scholar 

  • Silverman, W. K., & Nelles, W. B. (1988). The anxiety disorders interview schedule for children. Journal of the American Academy of Child and Adolescent Psychiatry, 27, 772–778.

    Article  PubMed  Google Scholar 

  • Silverman, W. K, & Eisen, A. R. (1992). Age differences in the reliability of parent and child reports of child anxious symptomatology using a structured interview. Journal of American Academy of Child and Adolescent Psychiatry, 31, 117–124.

    Google Scholar 

  • Silverman, W. K., & Albano, A. M. (1996). The anxiety disorders interview schedule for DSM-IV - Child and parent versions. San Antonio: Psychological Corporation.

    Google Scholar 

  • Silverman, W. K., Saavedra, L. M., & Pina, A. A. (2001). Test-retest reliability of anxiety symptoms and diagnoses with anxiety disorders interview schedule for DSM-IV: child and parent versions. Journal of the American Academy of Child and Adolescent Psychiatry, 40, 937–944.

    Article  PubMed  Google Scholar 

  • Simonoff, E., Pickles, A., Charman, T., Chandler, S., Loucas, T., & Baird, G. (2008). Psychiatric disorders in children with autism spectrum disorders: prevalence, comorbidity, and associated factors in a population-derived sample. Journal of the American Academy of Child and Adolescent Psychiatry, 47, 921–929.

    Article  PubMed  Google Scholar 

  • Storch, E. A., Merlo, L. J., Larson, M. J., Geffken, G. R., Lehmkuhl, H. D., Jacob, M. L., et al. (2008). Impact of comorbidity on cognitive-behavioral therapy response in pediatric obsessive-compulsive disorder. Journal of the American Academy of Child and Adolescent Psychiatry, 47, 583–592.

    Article  PubMed  Google Scholar 

  • Storch, E. A., Larson, M. J., Ehrenreich-May, J., Arnold, E. B., Jones, A. M., Renno, P., et al. (2012). Peer victimization in youth with autism spectrum disorders and co-occurring anxiety: relations with psychopathology and loneliness. Journal of Developmental and Physical Disabilities, 24, 575–590.

    Article  Google Scholar 

  • Storch, E. A., May, J. E., Wood, J. J., Jones, A. M., De Nadai, A. S., Lewin, A. B., et al. (2012). Multiple informant agreement on the anxiety disorders interview schedule in youth with autism spectrum disorders. Journal of Child and Adolescent Psychopharmacology, 22, 292–299.

    Article  PubMed  Google Scholar 

  • Storch, E. A., Arnold, E. B., Lewin, A. M., Nadeau, J., Jones, A. M., Mutch, P. J., et al. (2013). The effect of cognitive-behavioral therapy versus treatment as usual for anxiety in children with autism spectrum disorders: a randomized, controlled trial. Journal of the American Academy of Child and Adolescent Psychiatry, 52, 132–142.

    Article  PubMed  Google Scholar 

  • Sukhodolsky, D. G., Scahill, L., Gadow, K. D., Arnold, L. E., Aman, M. G., McDougle, C. J., et al. (2008). Parent-rated anxiety symptoms in children with pervasive developmental disorders: frequency and association with core autism symptoms and cognitive functioning. Journal of Abnormal Child Psychology, 36, 117–128.

    Article  PubMed  Google Scholar 

  • Tantam, D. (2003). The challenge of adolescents and adults with asperger syndrome. Child and Adolescent Psychiatric Clinics of North America, 12, 143–163.

    Article  PubMed  Google Scholar 

  • van Steensel, F. J. A., Bogels, S. M., & Perrin, S. (2011). Anxiety disorders in children and adolescents with autistic spectrum disorders: a meta-analysis. Clinical Child and Family Psychology Review, 14, 302–317.

    Article  PubMed Central  PubMed  Google Scholar 

  • White, S. W., Oswald, D., Ollendick, T., & Scahill, L. (2009). Anxiety in children and adolescents with autism spectrum disorder. Clinical Psychology Review, 29, 216–229.

    Article  PubMed Central  PubMed  Google Scholar 

  • Wood, J. J., & Gaddow, K. D. (2010). Exploring the nature and function of anxiety in youth with autism spectrum disorders. Clinical Psychology: Science and Practice, 17, 281–292.

    Google Scholar 

  • Wood, J. J., Piacentini, J. C., Bergman, R. L., McCracken, J., & Barrios, V. (2002). Concurrent validity of the anxiety disorders section of the anxiety disorders interview schedule for DSM-IV: child and parent versions. Journal of Clinical Child and Adolescent Psychology, 31, 335–342.

    PubMed  Google Scholar 

  • Wood, J. J., Drahota, A., Sze, K., Har, K., Chiu, K., & Langer, D. A. (2009). Cognitive behavioral therapy for anxiety in children with autism spectrum disorders: a randomized, controlled trial. Journal of Child Psychology and Psychiatry, 50, 224–234.

    Article  PubMed  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. University of South Florida, Tampa, FL, USA

    Danielle Ung, Alessandro S. De Nadai & Vicky Phares

  2. University of South Florida, St. Petersburg, FL, USA

    Elysse B. Arnold, Adam B. Lewin, Tanya K. Murphy & Eric A. Storch

Authors
  1. Danielle Ung
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Elysse B. Arnold
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Alessandro S. De Nadai
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Adam B. Lewin
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Vicky Phares
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Tanya K. Murphy
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Eric A. Storch
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Eric A. Storch.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Ung, D., Arnold, E.B., De Nadai, A.S. et al. Inter-rater Reliability of the Anxiety Disorders Interview Schedule for DSM-IV in High-Functioning Youth with Autism Spectrum Disorder. J Dev Phys Disabil 26, 53–65 (2014). https://doi.org/10.1007/s10882-013-9343-3

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10882-013-9343-3

Keywords

Search

Navigation