A pilot study examining the use of the autism diagnostic observation schedule in community-based mental health clinics

https://doi.org/10.1016/j.rasd.2015.08.007Get rights and content

Highlights

  • We examined the use of the Autism Diagnostic Observation Schedule (ADOS) by community mental health providers with diagnostically complex youth suspected of Autism Spectrum Disorder (ASD) who received a diagnostic assessment.

  • Results indicated that 57% of youths assessed received an ASD diagnosis.

  • The utility of the ADOS was relatively strong and descriptively similar to data reported about the ADOS in other community samples.

  • All discrepancies between ADOS classifications and final ASD diagnosis were false positives.

  • In these cases, report narratives indicated that social communication difficulties identified on the ADOS were explained by symptoms of other mental health conditions.

Abstract

Community-based mental health (CMH) services play an important, but relatively understudied role in the identification and treatment of youth with autism spectrum disorder (ASD) who may be receiving care for other psychiatric conditions. Little is known about the role of standardized ASD assessment measures administered by providers working in generalist community-based mental health (CMH) settings. This pilot study extracted data from three CMH clinics to examine the use of the Autism Diagnostic Observation Schedule (ADOS) by 17CMH providers who received ASD assessment training with 62 youth (Mean = 10.69 years) referred for an ASD diagnostic evaluation. Results indicated that 57% of youths assessed ultimately received an ASD diagnosis. All cases given a final ASD diagnosis were classified as “Autism” or “ASD” on the ADOS. Seventy percent of youth who did not receive a final ASD diagnosis were classified as “Non-Spectrum” on the ADOS. In these false positive cases, report narratives indicated that social communication difficulties identified on the ADOS were explained by symptoms of other mental health conditions (e.g., ADHD, anxiety). Future research is needed to examine the utility of the ADOS when used by CMH providers to facilitate CMH capacity to identify ASD.

Introduction

Research examining diagnostic practices of Autism Spectrum Disorder (ASD) in community service settings is limited (Akshoomoff, Corsello, & Schmidt, 2006; Corsello, Askshoomoff, & Stahmer, 2013; Daniels et al., 2011, Rosenberg et al., 2009, Wiggins et al., 2006; Williams, Atkins, & Soles, 2009). The research available indicates that delays are common in receiving an initial ASD diagnosis, particularly for children who ultimately receive a diagnosis of Pervasive Developmental Disorder, Not Otherwise Specified (PDD, NOS) or Asperger’s Disorder (Centers for Disease Control and Prevention, 2012, Wiggins et al., 2006, Yeargin-Allsopp et al., 2003). In addition, studies suggest that disparities exist in the timing of an initial ASD diagnosis based on socioeconomic status, child race/ethnicity, and child clinical factors (Fountain, King, & Bearman, 2011; Goin-Kochel, Mackintosh, & Myers, 2006; Mandell, Listerud, Levy, & Pinto-Martin, 2002; Mandell et al., 2009). Specifically, lower family socioeconomic status, child racial/ethnic minority background, and a higher functioning ASD diagnosis are significant correlates of delays in receipt of initial ASD diagnosis. Further, there is variability in adherence of community-based clinicians to best practice guidelines such as using a standardized ASD diagnostic instrument (Wiggins et al., 2006, Williams et al., 2009).

The Autism Diagnostic Observation Schedule (ADOS) (Lord, Rutter, DiLavore, & Risi, 2001) is considered one of the “gold standard” diagnostic assessment tools for research and clinical use. There is minimal research on the use of the ADOS when administered by community-based mental health (CMH) clinicians with children. From what is known, the ADOS retained strong diagnostic classification properties when administered to preschool and school-aged children in an ASD specialty clinic (Mazefsky & Oswald, 2006) and when community-based psychologists who specialized in developmental disabilities administered the ADOS to toddlers (24–36 months) seen in a developmental evaluation clinic (Corsello, Akshoomoff, & Stahmer, 2013). However, it has been shown that the ADOS was less accurate in identifying children without ASD due to misclassifications on the ADOS when used with preschool and school-aged children in a general developmental/behavioral disorders clinic (Molloy, Murray, Akers, Mitchell, & Courtney-Manning, 2011).

Children with ASD are served through multiple service systems, primarily special education/school, developmental disabilities, and pediatrics. The CMH system, which provides publicly-funded services to address psychiatric problems through psychosocial and pharmacological interventions, also plays an important role in differential diagnosis assessment and treatment for individuals with ASD. Children with ASD served in this system are typically school-aged, have average to above average cognitive functioning (i.e., IQ > 70), have a broader subtype of ASD (e.g., PDD, NOS), and exhibit high rates of co-occurring psychopathology and challenging behaviors (Brookman-Frazee, Drahota, & Stadnick, 2012; Brookman-Frazee, Taylor, & Garland, 2010; Brookman-Frazee et al., 2009, Joshi et al., 2014, Mandell et al., 2005). Also, a high proportion of these youth are from racial/ethnic minority backgrounds (e.g., Levy et al., 2010, Mandell et al., 2007; Williams, Atkins, & Soles, 2009). Due to the high rates of co-occurring psychopathology, reported at 70% or greater, and challenging behaviors that are common in children with ASD (e.g., Joshi et al., 2010, Levy et al., 2010, Simonoff et al., 2008), the CMH system provides ongoing mental health care for these children.

CMH providers are typically generalist in practice (i.e., not specializing in a particular disorder) and may have limited ASD training (Brookman-Frazee, Drahota, Stadnick, & Palinkas, 2012; Brookman-Frazee et al., 2010). In research examining the training needs of CMH providers, clinicians in these settings requested comprehensive training in ASD assessment and diagnosis in addition to training in intervention strategies (Brookman-Frazee et al., 2012c). These CMH providers indicated that they were treating many children for other psychiatric conditions whom they suspected had ASD, but these providers did not feel equipped to accurately assess for ASD. Many ASD symptoms (e.g., repetitive behaviors, avoidance of social situations) are shared with other common psychiatric disorders. These factors may increase the difficulty of an accurate or differential ASD diagnosis (White, Bray, & Ollendick, 2012), particularly for providers with less specialized ASD training.

To address the need for research on building CMH capacity to identify ASD when serving diagnostically and racial/ethnically diverse youth, the current pilot study extracted data from routine care to examine the use of the ADOS when administered by CMH clinicians to children referred for an ASD assessment. Specifically, the proportion of ADOS classifications relative to final provider-assigned diagnosis by CMH clinicians who were trained to incorporate the ADOS in their diagnostic evaluations with children suspected of ASD was examined.

Section snippets

Method

This pilot study used extracted, de-identified clinical evaluation reports generated as part of routine clinical care between the Fall of 2008 and the Spring of 2012 in three outpatient CMH clinics from one organization in a large, diverse county. This organization is the largest contractor for publicly funded youth mental health services in the county.

Characteristics of full sample

Descriptive statistics are reported in Table 2. Of the total sample of children referred for an ASD assessment, 70% were classified as “Autism” or “ASD” on the ADOS and approximately half of the total sample (57%) ultimately received a final ASD diagnosis. The total sample of children had an average of 1.88 co-occurring DSM-IV diagnoses (SD = 1.13; Range = 1–5), with 93% being assigned at least one non-ASD Axis I diagnosis.

Characteristics of children who received a final ASD diagnosis

Of the 35 children who received a final DSM-IV ASD diagnosis, 37% received a

Discussion

This pilot study begins to address the paucity of research regarding use of the ADOS when administered by community-based providers to school-aged children referred for an ASD evaluation in CMH clinics. The overarching purpose was to describe the characteristics of children referred for ASD assessment and outcomes of these assessments when community-based clinicians are trained to use the gold standard diagnostic assessment measure with a clinically complex and diverse set of children served in

Conclusions

Findings indicate that the utility of the ADOS within this CMH sample was relatively strong and descriptively comparable to the data reported about the ADOS in other community settings. This study adds to the extant literature by providing preliminary data regarding use of the ADOS administered by CMH providers, who do not specialize in ASD, to clinically complex, diverse, school-aged children suspected of ASD and receiving CMH services. Findings can inform efforts to increase and improve ASD

Acknowledgements

This work was supported by awards from the National Institute of Mental Health (K23MH077584; K23MH071796; R01MH094317) and a Dennis Weatherstone Predoctoral Fellowship (#7060). The authors would like to acknowledge the assistance of Suzanne Lindsay, Ph.D., M.S.W., M.P.H. who reviewed an early version of this manuscript as part of the first author’s Masters in Public Health thesis.

References (36)

  • D.S. Mandell et al.

    Race differences in the age at diagnosis among medicaid-eligible children with autism

    Journal of the American Academy of Child and Adolescent Psychiatry

    (2002)
  • D.M. Sikora et al.

    The performance of children with mental health disorders on the ADOS-G: a question of diagnostic utility

    Research in Autism Spectrum Disorders

    (2008)
  • E. Simonoff et al.

    Psychiatric disorders in children with autism spectrum disorders: prevalence, comorbidity, and associated factors in a population-derived sample

    Journal of the American Academy of Child and Adolescent Psychiatry

    (2008)
  • N. Akshoomoff et al.

    The role of the autism diagnostic observation schedule in the assessment of autism spectrum disorders in school and community settings

    California School Psychologist

    (2006)
  • American Psychiatric Association

    Diagnostic and statistical manual of mental disorders

    (2000)
  • L. Brookman-Frazee et al.

    Parent perspectives on community mental health services for children with autism spectrum disorders

    Journal of Child and Family Studies

    (2012)
  • L. Brookman-Frazee et al.

    Training community mental health therapists to deliver a package of evidence-based practice strategies for school-age children with autism spectrum disorders: A pilot study

    Journal of Autism and Developmental Disorders

    (2012)
  • L. Brookman-Frazee et al.

    Therapist perspectives on community mental health services for children with autism spectrum disorders

    Administration and Policy in Mental Health and Mental Health Services Research

    (2012)
  • L. Brookman-Frazee et al.

    Involvement of youths with autism spectrum disorders or intellectual disabilities in multiple public service systems

    Mental Health Research in Intellectual Disabilities

    (2009)
  • L.I. Brookman-Frazee et al.

    Characterizing community-based mental health services for children with autism spectrum disorders and disruptive behavior problems

    Journal of Autism and Developmental Disorders

    (2010)
  • D.C. Cath et al.

    Symptom overlap between autism spectrum disorder, generalized social anxiety disorder and obsessive-compulsive disorder in adults: a preliminary case-controlled study

    Psychopathology

    (2008)
  • Centers for Disease Control and Prevention

    Prevalence of autism spectrum disorders—autism and developmental disabilities monitoring network, 14 sites, United States, 2008

    Morbidity and Mortality Weekly Report

    (2012)
  • J.N. Constantino et al.

    Social responsiveness scale manual

    (2005)
  • C.M. Corsello et al.

    Diagnosis of autism spectrum disorders in 2-year-olds: a study of community practice

    Journal of Child Psychology and Psychiatry

    (2013)
  • C. Corsello et al.

    Between a ROC and a hard place: decision making and making decisions about using the SCQ

    Journal of Child Psychology and Psychiatry

    (2007)
  • A.M. Daniels et al.

    Stability of initial autism spectrum disorder diagnoses in community settings

    Journal of Autism and Developmental Disorders

    (2011)
  • C. Fountain et al.

    Age of diagnosis for autism: individual and community factors across 10 birth cohorts

    Journal of Epidemiology and Community Health

    (2011)
  • R. Goin-Kochel et al.

    How many doctors does it take to make an autism spectrum diagnosis?

    Autism

    (2006)
  • Cited by (0)

    View full text