The Diagnostic Behavioral Assessment for autism spectrum disorder—Revised: A screening instrument for adults with intellectual disability suspected of autism spectrum disorders

https://doi.org/10.1016/j.rasd.2013.12.016Get rights and content

Highlights

  • The DIBAS-R enables quick screening for ASD in the highly vulnerable ID population.

  • Factor analysis yielded two consistent dimensions.

  • The diagnostic validity was adequate with balanced sensitivity/specificity values of 81%.

  • The interrater reliability was excellent (ICC = 0.88).

  • The convergent validities with established ASD diagnostic scales were high.

Abstract

Given the strong association between intellectual disability (ID) and autism spectrum disorder (ASD), standardized instruments for the assessment of ASD in adults with ID are desirable. The Diagnostic Behavioral Assessment for ASD – Revised (DiBAS-R) is a DSM-5/ICD-10 based caregiver-report screening tool that consists of 19 Likert-scaled items. This study evaluated the item-validities, item-difficulties, item-variances, part-whole corrected item total-correlations, reliability, and the factorial, diagnostic, and convergent/discriminant validities of the DiBAS-R in a clinical, adult ID sample (N = 219). Factor analysis yielded two consistent dimensions; i.e., social interaction/communication and stereotypy/rigidity/sensory abnormalities. The diagnostic validity was adequate, as reflected by an area under the curve of 0.89 and balanced sensitivity and specificity values of 81%. The DiBAS-R total scores were significantly correlated with the Social Communication Questionnaire (r = 0.52), the Scale for Pervasive Developmental Disorders in Mentally Retarded Persons (r = 0.50), and the Autism-Checklist (r = 0.59), while no significant correlation with the Modified Overt Aggression Scale was observed. The interrater reliability was excellent (ICC = 0.88). These findings indicate that the DiBAS-R is a promising and psychometrically sound instrument for ASD screening of adults with ID.

Introduction

Individuals with intellectual disability (ID) exhibit an increased risk for autism spectrum disorder (ASD), which is associated with high rates of comorbid mental health problems and challenging behaviors (Matson and Shoemaker, 2009, McCarthy et al., 2010, Sappok et al., 2010, Sappok et al., 2013b). ASD is a neurodevelopmental disorder characterized by impairments in social communication and repetitive, stereotyped behaviors and interests (DSM-5; American Psychiatric Association, 2013). Approximately 25% of people with ID exhibit comorbid ASD (Fombonne, 2009, Kim, 2011, Sappok et al., 2010). While ASD onset occurs in early childhood, many ASD patients with comorbid ID remain undiagnosed and untreated until adulthood (La Malfa et al., 2004, Sappok et al., 2013c).

Diagnosing mental disorders or ASD in patients with ID remains challenging for a number of reasons. Firstly, individuals with ID are less able to report their inner experiences due to diminished speech comprehension and expressive abilities (Balboni, Coscarelli, Giunti, & Schalock, 2013). Secondly, due to diagnostic overshadowing (Reiss & Szyszko, 1983), problem behaviors or mental disorders may be attributed to the ID itself rather than an additional comorbid diagnostic entity. Thirdly, diagnostic substitution, i.e., diagnosing ASD rather than ID may occur (King and Bearman, 2009, Shattuck, 2006, Weintraub, 2011). Fourthly, neurological disorders, such as sensory or motor impairments and epilepsy, may further hamper diagnostic clarification (Matson & Shoemaker, 2009). Finally, currently, many adults with ID have been raised in long-term mental institutions and/or have lost contact with their relatives (Haberfellner, Grausgruber, Grausgruber-Berner, Ortmair, & Schöny, 2004); thus, their medical histories are fragmented, which produces difficulties in the proper diagnostic classification of ASD. On the background of DSM-5's emphasis on a lifetime perspective for diagnosing ASD, a thorough medical history with detailed and reliable early childhood information get even more important.

For this reason, ASD diagnostics for this group are mainly based on assessments of current behavior. Individuals with ID, especially those with comorbid ASD, may behave differently when interacting with unfamiliar people or when in an unfamiliar environment, such as a clinical setting (Gerber et al., 2011, Kumin, 1994). Therefore, it is mandatory that information from the private living environment, including information from close caregivers, be sought in the diagnostic process. Diagnostic clarification allows for more appropriate treatment options in ID and comorbid ASD that include non-drug strategies and lead to improved mental health and quality of life (Gordon et al., 2011, van Bourgondien et al., 2003). Standardized, evidence-based instruments can support clinicians and researchers in this diagnostic process; e.g., the Autism Diagnostic Observation Schedule (ADOS; Lord et al., 1989), the Pervasive Developmental Disorder in Mental Retardation Scale (PDD-MRS; Kraijer, 2006, Kraijer and Melchers, 2003), the Social Communication Questionnaire (SCQ; Berument et al., 1999, Rutter et al., 2001), the Autism Spectrum Disorder-Diagnostic Scale for Adults (ASD-DA; Matson et al., 2007, Matson et al., 2008), and the Autism-Checklist (ACL; Sappok, Heinrich, & Diefenbacher, 2013).

The ADOS is a semi-structured observational instrument that assesses social communicative abilities (Lord et al., 1989), while the ADI-R is a semi-structured parental interview that evaluates social interaction, communication, and restrictive, repetitive behaviors and interests from childhood to adulthood (Lord, Rutter, & Le Couteur, 1994). These two instruments are frequently used in combination for diagnosing autism in children and they have recently been validated for adults with ID (Sappok, Diefenbacher, Budczies, et al., 2013). However, both measures are time-consuming and can only be applied to a limited number of adults with ID (Sappok, Diefenbacher, Budczies, et al., 2013). With increasing severity of ID and comorbidity of ASD, the feasibility of the ADOS was reduced to 68%, while the applicability of the ADI-R was even reduced to 37%, presumably due to loss of contact to close relatives. The SCQ is a screening instrument that consists of 40 binary items that are rated by parents or close caregivers (Berument et al., 1999, Rutter et al., 2001). There are lifetime and current versions of the SCQ. The SCQ-lifetime has been found to have particularly poor specificity values in cases of moderate and severe ID (Sappok, Diefenbacher, Gaul, & Bölte, in press). Raising the cut-off value of the SCQ-current improves diagnostic validity for this special group of patients, but the specificity remains rather low. The ASD-DA is another diagnostic instrument that consists of 31 items in which the rater endorses as 0 for no impairment/not different, or 1 for some impairment/different. The raters are instructed to compare the target person to an individual with a similar age living in the community. A three-factor model was computed for the scale, which showed good psychometric properties (Matson et al., 2007, Matson et al., 2008). The PDD-MRS assesses behaviors during daily routines and was conceptualized for individuals with ID between the ages of 2 to 70 years (Kraijer, 2006, Kraijer and Melchers, 2003). Although this test is considered a screening instrument, its completion takes approximately half an hour, and the test must be administered by a specialist; e.g., a psychologist or psychiatrist. The Autism-Checklist (ACL) is an ICD-10-based screening instrument for physicians. This test evaluates characteristic social interaction, communication, and stereotypies. The completion of this test requires approximately 10 min. As the sensitivity and specificity values of this test are 91 and 68%, respectively, the ACL is a suitable measure for adults with ID and suspected ASD (Sappok, Heinrich, et al., 2013). In conclusion, there is a need for an ASD screening instrument that can be easily administered by close caregivers without specific knowledge of ASD. For this purpose, we developed a 20-item questionnaire, the Diagnostic Behavioral Assessment for ASD (DiBAS) that is derived from the ICD-10 and DSM-5 criteria for ASD. In a pilot study, the DiBAS was applied to 91 patients with ID and suspected ASD (Sappok, Gaul, et al., 2014). Item validity analysis revealed 8 items that did not differentiate sufficiently between individuals with and without comorbid ASD, and despite the appropriate sensitivity of 83%, the specificity was low (64%). Thus, an item-revision of the DiBAS was recommended to further improve its diagnostic validity. The invalid items were replaced by another 8 ICD-10/DSM-5-based questions to replenish the DiBAS-Revised (DiBAS-R).

The aim of the present study was to examine the reliability and the factorial, diagnostic, and convergent/discriminate validities of the DiBAS-R in screening for ASD in adult patients with ID on the item and scale levels.

Section snippets

Setting and design

The study was conducted at a department of psychiatry specialized in mental health care for adults with ID in Berlin, Germany. This service consists of an in- and outpatient unit and offers assessment and treatment for adults with ID and mental disorders and/or severe challenging behaviors. Given this setting, all participants of this study have had an additional mental or behavioral problem on admission. ASD assessment including the DiBAS-R was applied after remission of the acute mental

Factor analysis

In the first step, all 20 items were used in the factor analysis. Three eigenvalues greater than 1 indicated a three-factor solution (eigenvalues: 9.41, 2.71, 1.13, and 0.93), and exploration of the scree plot indicated a 2-factor solution. Examination of the pattern matrix of the Geomin-rotated 2- and 3-factor solutions identified the 2-factor solution as the most appropriate in terms of interpretability and the DSM-5 diagnostic criteria. Only one item (“Does he use your hand as a tool to

Discussion

ID and ASD co-occur at high rates. The DIBAS-R was designed to enable quick screening for ASD in the highly vulnerable ID population. Factor analysis indicated two subscales, the DiBAS-R Social Communication and Interaction and the DiBAS-R Stereotypy, Rigidity, and Sensory Abnormalities subscales. Diagnostic validity analysis produced an AUC of 0.89, and the balanced sensitivity and specificity values of 81% indicated the scale's potential for screening for ASD in adults with ID. This potential

Acknowledgments

We are grateful to the participants, their families, and caregivers for participation. We kindly thank the “von Bodelschwinghsche Stiftungen Bethel” foundation for the financial support. Thanks also to Heika Kaiser for the psychometric evaluations (SCQ, PDD-MRS, ADOS, and ADI-R) and to the hospital staff, especially the nurses and special needs caregivers, who helped in data collection. Sven Bölte was supported by the Swedish Research Council (grant nr. 523-2009-7054).

References (74)

  • S. Bhaumik et al.

    Psychiatric service use and psychiatric disorders in adults with intellectual disability

    Journal of Intellectual Disability Research

    (2008)
  • T. Bergmann et al.

    Musikbasierte Autismusdiagnostik (MUSAD). Entwicklung eines Untersuchungsverfahrens für erwachsene Menschen mit Intelligenzminderung und Autismusverdacht

    Musiktherapeutische Umschau

    (2012)
  • S.K. Berument et al.

    Autism Screening Questionnaire: Diagnostic validity

    The British Journal of Psychiatry

    (1999)
  • A. Bildt et al.

    Validity of the Children's Social Behavior Questionnaire (CSBQ) in children with intellectual disability: Comparing the CSBQ with ADI-R, ADOS, and clinical DSM-IV-TR classification

    Journal of Autism and Developmental Disorders

    (2009)
  • S. Bölte

    Psychobiosocial interventions for autism

    Nervenarzt

    (2011)
  • S. Bölte et al.

    Der Fragebogen über Verhalten und soziale Kommunikation (VSK)

    Diagnostica

    (2000)
  • S. Bölte et al.

    Fragebogen zur Sozialen Kommunikation (FSK)

    (2006)
  • S. Bölte et al.

    Assessing autistic traits: Cross-cultural validation of the social responsiveness scale (SRS)

    Autism Research

    (2008)
  • J. Bortz et al.

    Quantitative Methoden der Datenerhebung

  • M. Broadstock et al.

    Systematic review of the effectiveness of pharmacological treatments for adolescents and adults with autism spectrum disorder

    Autism

    (2007)
  • D.V. Cicchetti et al.

    From Bayes through marginal utility to effect sizes: A guide to understanding the clinical and statistical significance of the results of autism research findings

    Journal of Autism and Developmental Disorders

    (2011)
  • S.-A. Cooper et al.

    Mental ill-health in adults with intellectual disabilities: Prevalence and associated factors

    The British Journal of Psychiatry

    (2007)
  • A.B. Costello et al.

    Best practices in exploratory factor analysis: Four recommendations for getting the most from your analysis

    Practical Assessment, Research & Evaluation

    (2005)
  • A. de Bildt et al.

    Prevalence of pervasive developmental disorders in children and adolescents with mental retardation

    Journal of Child Psychology and Psychiatry

    (2005)
  • A. Dosen

    Applying the developmental perspective in the psychiatric assessment and diagnosis of persons with intellectual disability: Part I – Assessment

    Journal of Intellectual Disability Research

    (2005)
  • A. Dosen

    Applying the developmental perspective in the psychiatric assessment and diagnosis of persons with intellectual disability: Part II – Diagnosis

    Journal of Intellectual Disability Research

    (2005)
  • M. Eid et al.

    Statistik und Forschungsmethoden

    (2011)
  • R. Elvins et al.

    Pharmacological management of core and comorbid symptoms in autism-spectrum disorder

    Advances in Psychiatric Treatment

    (2010)
  • A.J. Esbensen et al.

    A longitudinal investigation of psychotropic and non-psychotropic medication use among adolescents and adults with autism spectrum disorders

    Journal of Autism and Developmental Disorders

    (2009)
  • L.R. Fabrigar et al.

    Evaluating the use of exploratory factor analysis in psychological research

    Psychological Methods

    (1999)
  • E. Fombonne

    Epidemiology of pervasive developmental disorders

    Pediatric Research

    (2009)
  • F. Gerber et al.

    Comparing residential programmes for adults with autism spectrum disorders and intellectual disability: Outcomes of challenging behaviour and quality of life

    Journal of Intellectual Disability Research

    (2011)
  • F. Goldhammer et al.

    Interpretation von Testresultaten und Testeichung

  • K. Gordon et al.

    A communication-based intervention for nonverbal children with autism: What changes? Who benefits?

    Journal of Consulting and Clinical Psychology

    (2011)
  • F.J. Gravetter et al.

    Statistics for the behavioral sciences

    (2009)
  • E.M. Haberfellner et al.

    Deinstitutionalization of long-stay psychiatric patients in upper Austria-living situation, social and clinical characteristics more than one year after discharge

    Psychiatrische Praxis

    (2004)
  • N. Holmes et al.

    The Disability Assessment Schedule: A brief screening device for use with the mentally retarded

    Psychological Medicine

    (1982)
  • Cited by (33)

    • Screening for autism spectrum disorder in deaf adults with intellectual disability: Feasibility and accuracy of two autism screening instruments

      2022, Research in Developmental Disabilities
      Citation Excerpt :

      The DiBAS-R assesses ASD symptoms in adults with intellectual disability over the preceding 3 months and can be administered by a caregiver or support person without specific knowledge of ASD. Previous research has confirmed the validity of the DiBAS-R as a screening tool for ASD symptoms in adult with intellectual disability and with or without ASD (Heinrich, Böhm, & Sappok, 2018; Mutsaerts, Heinrich, Sterkenburg, & Sappok, 2016; Sappok et al., 2014), with estimates for sensitivity ranging from 75 to 82 % and for specificity from 67 to 81 %. Comparable to the PDD-MRS, sensitivity and specificity are better balanced in individuals with mild to moderate intellectual disability, while specificity is lower in individuals with severe to profound intellectual disability (sensitivity 83 %, specificity: 34 %).

    • Screening tools for autism spectrum disorder, used with people with an intellectual disability: A systematic review

      2020, Research in Autism Spectrum Disorders
      Citation Excerpt :

      The maximum scores of each subscale are 36 and 21 respectively, and the cut-points are 21 and 5 respectively (Mutsaerts et al., 2016). Sappok et al. (2014) proposes two factors: Social Communication and Interaction (SCI) and Stereotypy Rigidity and Sensory Abnormalities (SRS). Both factors and overall score had good internal consistency.

    View all citing articles on Scopus
    1

    These authors shared first authorship.

    View full text