Elsevier

Research in Autism Spectrum Disorders

Volumes 29–30, September–October 2016, Pages 57-65
Research in Autism Spectrum Disorders

Experience sampling of positive affect in adolescents with autism: Feasibility and preliminary findings

https://doi.org/10.1016/j.rasd.2016.06.003Get rights and content

Highlights

  • Adherence was excellent and response rates were not impacted by age or IQ.

  • Groups did not differ in positive affect overall or as a function of activities.

  • Groups differed only in the proportion of assessments completed during restricted interests behaviors.

  • Results suggest that experience sampling in autism is feasible and highly informative.

Abstract

Background

Experience sampling is a powerful method for obtaining ecologically valid data from research participants in real-world contexts. Given the urgent need for innovative and sensitive outcome measures in autism spectrum disorder (ASD) research, the present study sought to examine the feasibility of using experience sampling of positive affect and behavior in adolescents with ASD.

Method

Nineteen high functioning adolescents with ASD and 20 sex and age matched controls completed smartphone- and Qualtrics® −based experience sampling of positive affect and behavior six times over four days.

Results

Adherence was excellent: adolescents with ASD completed 85% of the assessments, compared to 93% in controls, and response rates were not impacted by age or IQ. Groups did not differ in positive affect overall or as a function of activities, nor did groups differ in the proportion of assessments completed during social or nonsocial activities. However, groups did differ in the proportion of assessments completed during preferred activities.

Conclusions

Results suggest that smartphone- and Qualtrics® −based experience sampling with high functioning adolescents with ASD is feasible and captures real-world behaviors that would not be possible using laboratory-based measures.

Introduction

Nearly all questionnaire-based autism spectrum disorder (ASD) research measures are laboratory-based caregiver-report or self-report instruments. Experience sampling is a method for obtaining subjective information in a natural setting that is useful for gathering information about context-dependent states (Stone & Shiffman, 2002). Experience sampling offers new methods to examine social-affective functioning in ASD with strong ecological validity because data are collected in real-time during naturalistic behaviors. Additionally, there is an urgent need for novel, sensitive, and standardized outcome measures in ASD treatment studies (Vivanti, Prior, Williams, & Dissanayake, 2014; Warren et al., 2011), and the high ecological validity of experience sampling suggests that this method may have the potential to be a sensitive ASD treatment outcome measure.

Experience sampling has been used in a number of psychiatric contexts as well as with pediatric and severely mentally ill populations (aan het Rot, Hogenelst, & Schoevers, 2012; Granholm, Ben-Zeev, Fulford, & Swendsen, 2013; Marhe, Waters, van de Wetering, & Franken, 2013; Shiffman, Stone, & Hufford, 2008; Silk, Steinberg, & Morris, 2003; Tan et al., 2012). Experience sampling also offers relatively increased ecological validity relative to laboratory measures and is thus a natural complement to laboratory-based studies (Myin-Germeys et al., 2009, Shiffman et al., 2008, Stone and Shiffman, 2002). For example, experience sampling leads to less underreporting of mood fluctuations (Piasecki, Hufford, Solhan, & Trull, 2007), and experience sampling of mood has very good temporal stability and internal consistency (Larson, 1989). Experience sampling is particularly valuable for gathering information about states and behaviors that may be context-dependent, such as affect (Moskowitz & Young, 2006), and the accessibility of smartphones and freely-available survey software has made experience sampling a valuable method to collect self-report data in naturalistic contexts.

Though there is little ASD research that has used experience sampling, there are a number of factors that suggest that experience sampling may be a particularly suitable assessment method for ASD research. First, the accessibility of smartphones and survey software makes experience sampling accessible to most researchers and families. Second, experience sampling via smartphones may be well suited for older children and adolescents given the high use of smartphones by this age group (nearly 70% of 10 year olds use smartphones daily (Rice et al., 2014)). Finally, experience sampling via smartphones may be ideal for adolescents with ASD given this population’s strengths in using technology (Klin, McPartland, & Volkmar, 2005) and the preference for screen media over other leisure activities for individuals with ASD (Shane & Albert, 2008).

Only a few studies have evaluated experience sampling in ASD. Chen, Bundy, Cordier, and Einfeld (2014) used experience sampling to identify the contexts and content of daily life in a small sample (n = 6) of children with high functioning ASD using an iPod Touch. They reported descriptive analyses of the quality of experiences and corresponding emotions in everyday social interactions in ASD, however children without ASD were not included in this study. Similarly, Chen et al., 2014, Chen et al., 2013 investigated the feasibility of experience sampling in small samples of individuals with and without high functioning ASD (n = 6 and n = 4, respectively), and found acceptable response rates and response validity for seven surveys administered over seven consecutive days. Finally, Khor, Gray, Reid, and Melvin, (2014) used experience sampling across two weeks in adolescents with high-functioning ASD to evaluate stress and coping and reported moderate compliance with the experience sampling protocol as well as moderate concurrent validity with retrospective measures of coping. They also found that similarities between child-reported and parent-reported variables of behavior and emotional difficulty provided promising evidence of the ability of high functioning adolescents with Autism Spectrum Disorders to report on internal states.

In this study, experience sampling of positive affect and behavioral context were examined in high functioning adolescents with ASD (i.e., characterized by average IQ scores). Although research on affective experience in ASD has focused primarily on negative affect (e.g., White et al., 2014; Yirmiya, Kasari, Sigman, & Mundy, 1989), the recent emphasis on understanding motivational aspects of ASD has focused research attention on positive affect given its relevance for the social motivational deficits that characterize the disorder (Chevallier, Kohls, Troiani, Brodkin, & Schultz, 2012; Dawson, Webb, & McPartland, 2005). Additionally, theories that focus on impaired motivational systems in ASD have begun to examine behaviors related to restricted interests, a core symptom of ASD (American Psychiatric Association, 2013), because of converging lines of evidence that ASD is characterized by increased positive affect while processing stimuli related to restricted interests (Cascio et al., 2014; Sasson, Dichter, & Bodfish, 2012; Watson et al., 2015).

The primary goal of this study was to establish the feasibility of experience sampling of positive affect in high functioning adolescents with ASD. Accessibility was emphasized when developing the experience sampling protocol to ensure that promising findings would be replicable in a diverse range of settings. Our secondary goals were to use experience sampling to investigate (1) differences in positive affect and behavioral context in ASD; (2) the relative proportions of time individuals with ASD were engaged in various activities related to preferred activities, and (3) whether the social context of sampling (i.e., if participants were alone or with other people) differentially influenced positive affect in ASD.

Section snippets

Participants

Twenty-two adolescents with ASD and 20 controls between 9 and 19 years old consented to a protocol approved by the local human investigations committee at UNC-Chapel Hill. Groups were recruited to be matched on age, gender distribution, and IQ. Three adolescents with ASD withdrew before completing any assessments, citing conflicts with their schedules in two cases and unspecified reasons in the third case. Thus, the final sample was 19 adolescents with ASD and 20 typically developing controls.

Measures and materials

The experience sampling protocol used the Positive and Negative Affect Scale for Children (PANAS-C; Laurent et al., 1999). The PANAS-C was developed as a child version of the original PANAS, which was designed to measure positive and negative affect in relation to the tripartite model of emotion (Clark & Watson, 1991), and the current study focuses only on the 15 positive affect items from the PANAS-C. Positive affect is a broad affective dimension characterized by feelings of enthusiasm and

Experience sampling procedure

Participants came to the Carolina Institute for Developmental Disabilities to complete diagnostic and questionnaire measures. At the end of this visit, a research staff member explained the experience sampling procedure to each participant and his or her caregiver(s). Participants and their caregivers confirmed that they would have access to a smartphone or computer during the periods of time when they would be contacted. Participants were shown screenshots of what text message prompts would

Feasibility

Each participant was asked to complete six assessments, resulting in a possible total of 234 assessments. Participants completed 208 of those surveys, yielding an 89% overall response rate. The ASD group completed 97/114 (85%) of the assessments and the control group complete 111/120 (93%) of the assessments, a significant difference (t-test comparing proportions = 2.19, p=0.024). Pearson correlations between age and IQ and the proportion of surveys completed across or within groups were not

Discussion

The primary purpose of this study was to establish the feasibility of experience sampling methods using smartphones and Qualtrics ® web-based survey software in adolescents with high functioning ASD. The secondary goal of this study was to use experience sampling methods to investigate positive affect and behavior in naturalistic contexts in adolescents with ASD. Feasibility was excellent: the ASD group completed 85% of the assessments while the control group completed 93% of surveys, and the

Implications

The present study indicates that experience sampling is feasible in adolescents with high functioning ASD and may be implemented using smartphones and commercially available web-based survey software. Given these promising initial findings, future work evaluating the validity and reliability of experience sampling of affect in ASD is warranted. Additionally, there is an urgent need for novel, sensitive, and standardized treatment outcome measures in ASD (Vivanti et al., 2014, Warren et al., 2011

Acknowlegments

We would like to extend our sincere gratitude to the families who participated in this study. This research was supported by MH081285, MH073402, and HD079124.

References (55)

  • Bodfish, J. W., Symons, F. W., & Lewis, M. H. (1999). The Repetitive Behavior Scale-Revised, Western Carolina Center...
  • J.W. Bodfish

    The interests scale

    Western Carolina Center Research Reports

    (2004)
  • C.J. Cascio et al.

    Affective neural response to restricted interests in autism spectrum disorders

    Journal of Child Psychology and Psychiatry

    (2014)
  • Y.W. Chen et al.

    A preliminary study on the reliability and validity of using experience sampling method in children with autism spectrum disorders

    Developmental Neurorehabilitation

    (2013)
  • Y.W. Chen et al.

    Motivation for everyday social participation in cognitively able individuals with autism spectrum disorder

    Journal of Neuropsychiatric Disease and Treatment

    (2015)
  • Y.W. Chen et al.

    The experience of social participation in everyday contexts among individuals with autism spectrum disorders: an experience sampling study

    Journal of Autism and Developmental Disorders

    (2016)
  • B.F. Chorpita et al.

    Tripartite dimensions of emotion in a child clinical sample: measurement strategies and implications for clinical utility

    Journal of Consulting and Clinical Psychology

    (2002)
  • L.A. Clark et al.

    Tripartite model of anxiety and depression: psychometric evidence and taxonomic implications

    Journal of Abnormal Psychology

    (1991)
  • J. Cohen

    Statistical power analysis for the behavioral sciences

    (1988)
  • J.N. Constantino et al.

    The social responsiveness scale

    (2002)
  • R. Cordier et al.

    Piloting the use of experience sampling method to investigate the everyday social experiences of children with Asperger syndrome/high functioning autism

    Developmental Neurorehabilitation

    (2014)
  • G. Dawson et al.

    Understanding the nature of face processing impairment in autism: insights from behavioral and electrophysiological studies

    Developmental Neuropsychology

    (2005)
  • J.A. Durlak

    How to select, calculate, and interpret effect sizes

    Journal of Pediatric Psychology

    (2009)
  • E.E. Forbes et al.

    Altered striatal activation predicting real-world positive affect in adolescent major depressive disorder

    American Journal of Psychiatry

    (2009)
  • K. Gotham et al.

    Standardizing ADOS scores for a measure of severity in autism spectrum disorders

    Journal of Autism and Developmental Disorders

    (2009)
  • A.A. Hughes et al.

    Psychometric properties of the Positive and Negative Affect Scale for Children (PANAS-C) in children with anxiety disorders

    Child Psychiatry and Human Development

    (2009)
  • V. Hus et al.

    The autism diagnostic observation schedule, module 4: revised algorithm and standardized severity scores

    Journal of Autism and Developmental Disorders

    (2014)
  • Cited by (15)

    • Emotional stress, cortisol response, and cortisol rhythm in autism spectrum disorders: A systematic review

      2022, Research in Autism Spectrum Disorders
      Citation Excerpt :

      This method has been applied to participants with a wide range of psychiatric disorders (Myin-Germeys et al., 2009). Although such research is sparse in participants with ASD, the feasibility and usefulness of this method have been supported in this population (Chen, Bundy, Cordier, & Einfeld, 2014; Kovac, Mosner, Miller, Hanna, & Dichter, 2016). The ESM can be easily combined with salivary samples to measure fluctuations of momentary emotional and biological stress levels (Schlotz, 2019).

    • Leisure Participation of Autistic Adults: An Ecological Momentary Assessment Feasibility Study

      2023, American Journal on Intellectual and Developmental Disabilities
    View all citing articles on Scopus
    1

    Current address: New York Presbyterian-Weill Cornell Medical Center, New York, USA.

    2

    Current address: University of North Carolina at Chapel Hill School of Social Work, Chapel Hill, NC, USA.

    3

    Current address: Department of Psychology and Neuroscience, Duke University, Durham, NC, USA.

    View full text