Steep temporal reward discounting in ADHD-Combined type: Acting upon feelings
Introduction
Attention-deficit/hyperactivity disorder (ADHD) is one of the most common psychiatric conditions with onset in childhood (American Psychiatric Association, 2000). It is characterized by impairing levels of inattention and/or hyperactivity–impulsivity. Decades of research have focused on identifying causal mechanisms associated with these symptom domains. Influential theoretical models attempt to explain symptoms as presented in those with ADHD-Combined type (ADHD-C), and not in those with ADHD-Inattentive type (ADHD-I) (e.g., Barkley, 1997, Quay, 1997, Sonuga-Barke, 2002, Sonuga-Barke, 2003, Sonuga-Barke, 2005, Sagvolden et al., 2005, Johansen et al., 2009). These models focus on underlying mechanisms that are closely, but not exclusively, related to the symptom domain of impulsivity, such as executive disinhibition (Barkley), motivational disinhibition (Sonuga-Barke), and a steep delay-of-reinforcement gradient (Sagvolden). Likewise, a large number of experimental studies examining cognitive and motivational processes in ADHD include participants with ADHD-C only, while fewer researchers have included those with ADHD-I, or have compared the various subtypes (see for reviews Nigg, 2001, Adams et al., 2008).
It is worth noting that the DSM-IV lists only three symptoms of impulsivity, while inattention is represented by nine items, and hyperactivity by six. The symptom domain of impulsivity is represented in the DSM-IV by the following three behavior descriptions: “often has difficulty awaiting turn”, “often interrupts or intrudes on others”, “often blurts out answers before questions have been completed”. Here, we will focus on difficulty waiting as one important expression of impulsivity. Based on general theories of impulsivity (Monterosso and Ainslie, 1999, Cardinal et al., 2004, Kalenscher et al., 2006, Winstanley et al., 2006, Dalley et al., 2008), specific ADHD theories (Barkley, 1997, Sonuga-Barke, 2002, Sonuga-Barke, 2003, Sonuga-Barke, 2005, Tripp and Wickens, 2008, Johansen et al., 2009, Luman et al., 2010, Sagvolden et al., 2005), and clinical descriptions of ADHD (American Psychiatric Association, 2000), difficulty waiting seems to play an important role in impulsivity in general, and in ADHD-related impulsivity specifically.
In research studies of ADHD, difficulty waiting is typically assessed with objective measures of choice preference when presented with two options: a small immediate reward and a large delayed reward (but see Antrop et al., 2005, for an interesting exception). Earlier studies made use of single-choice paradigms such as the choice delay task (CDT), in which children were presented with repeated choices between one point that they could receive right away, or two points that they could receive after 30 s (each point being worth 5 cents, with the money being paid to the participants at the end of the block or the entire task). Sonuga-Barke et al. (1992) were the first to show with this task that 6- to 8-year-old hyperactive–impulsive boys demonstrated unusually strong preferences for small immediate rewards. Overall, more recent studies with single-choice paradigms have replicated this finding (Scheres et al., 2010, Schweitzer and Sulzer-Azaroff, 1995, Kuntsi et al., 2001, Solanto et al., 2001, Tripp and Alsop, 2001, Antrop et al., 2006, Bitsakou et al., 2009, Marco et al., 2009, Vloet et al., 2010; but see Solanto et al., 2007; for a review, see Luman et al., 2005). Most recently, studies of ADHD have employed temporal reward discounting tasks (TD tasks) in which the delay preceding the large reward as well as the magnitude of the immediate reward are varied (Barkley et al., 2001, Scheres et al., 2006, Plichta et al., 2009, Shiels et al., 2009, Paloyelis et al., 2010, Wilson et al., 2011, Demurie et al., 2012). Four out of five studies using hypothetical tasks supported the notion that those with ADHD have relatively strong preferences for small immediate rewards, expressed as relatively steep temporal reward discounting (Barkley et al., 2001, Paloyelis et al., 2010, Wilson et al., 2011, Demurie et al., 2012; but not Plichta et al., 2009). One out of three studies using real TD tasks supported this notion too (Scheres et al., 2010; but not Scheres et al., 2006, Paloyelis et al., 2010). Of note is that these findings may depend on contextual factors such as magnitude of the large reward (Barkley et al., 2001, Scheres et al., 2010) and/or type of task (real vs. hypothetical; see for a direct comparison and discussion Scheres et al., 2008), may be specifically related to the symptom domain of hyperactivity/impulsivity (Thorell, 2007, Scheres et al., 2008, Scheres et al., 2010, Scheres and Hamaker, 2010; but see Paloyelis et al., 2009, Wilson et al., 2011), and may be partially mediated by intelligence levels (Wilson et al., 2011).
Relatively strong preferences for small immediate rewards as observed in ADHD may be interpreted as being a result of negative feelings associated with waiting (Sonuga-Barke, 2002, Sonuga-Barke, 2003, Sonuga-Barke, 2005). However, alternative interpretations are available too, and it may be challenging to filter out the unique contribution of delay-related negative feelings to the choices made in these paradigms: relatively strong preferences for small immediate rewards may also be explained by a hypersensitivity to the immediacy of the small reward (Tripp and Alsop, 2001), or by an insensitivity to reward magnitude or maximizing one's total winnings (see Scheres et al., 2010). Some efforts have been made to tease apart these various explanations: for example, varying the magnitude of the delayed reward and of the total maximum gain (e.g., Barkley et al., 2001, Scheres et al., 2010) can shed light on the potential role of insensitivity to reward maximization in strong preferences for small immediate rewards. Additionally, the use of post-immediate-reward delays in order to control for inter-choice interval and overall task duration, in addition to a condition in which no post-immediate-reward delays are used permit making a distinction between sensitivity to reward immediacy and delay aversion as two explanations for relatively strong preferences for small immediate rewards (Sonuga-Barke et al., 1992, Scheres et al., 2006, Marco et al., 2009, Paloyelis et al., 2009).
However, although the use of post-reward delays makes good sense theoretically, and is common practice in animal studies (see Logue, 1988), it is of limited use in human research, especially when money is used as the reward. For example, previous research has shown that TD tasks with post-reward delays often result in ceiling effects: an overwhelming majority of participants choose the large delayed reward on most trials when task duration is kept constant, especially when they are 12 years of age or older (e.g., Logue et al., 1986, Jackson and Hackenberg, 1996, Scheres et al., 2006, Marco et al., 2009). Additionally, and likely related to the previous point, tasks with post-reward delays have been shown to be relatively insensitive to inter-individual differences in symptoms of ADHD (Sonuga-Barke et al., 1992, Scheres et al., 2006, Marco et al., 2009, Paloyelis et al., 2009).
Therefore, in order to gain more insight into the role difficulty waiting may play in relatively strong preferences for small immediate rewards as observed in those with ADHD, additional measures are needed (see for interesting discussions Bitsakou et al., 2009, Marco et al., 2009, Plichta et al., 2009). After all, it is as of yet an empirical question whether feelings of difficulty waiting are associated with choice preferences for small immediate reward in those with ADHD-C. Here, we propose that adding subjective measures to the objective choice measures will shed more light on the motivation that drives children and adolescents with ADHD to prefer the small immediate reward relatively often.
Therefore, we will focus here on a subjective measure of difficulty waiting that we collected in addition to objective choices on TD tasks (note that the objective choices on TD tasks have been reported by Scheres et al., 2010), and answer the following questions: (1) do participants with ADHD-C differ from typically developing controls (TC) and those with ADHD-I in terms of subjectively reported ease/difficulty waiting?; (2) does subjectively reported ease/difficulty waiting correlate with TD rate for each of the groups, and may this association differ between groups? We hypothesized that (1) the ADHD-C group would report more subjectively experienced difficulty waiting than the ADHD-I group and the control group, and (2) subjectively experienced difficulty waiting would correlate significantly with TD rate, to a similar extent for the three groups.
Section snippets
Inclusion criteria
Participants in the ADHD group met the following criteria: (1) a T-score >65 on at least one CPRS-R-L ADHD-related scale and/or a previous diagnosis of ADHD; and (2) a diagnosis of ADHD based on the parent Schedule for Affective Disorders and Schizophrenia for School-Age Children—Present and Lifetime Version (K-SADS-PL); and (3) estimated IQ above 75. Participants in the TC group met the following criteria: (1) T-scores below 65 on all the CPRS-R-L scales; (2) no previous diagnosis of ADHD; and
Objective measure: temporal reward discounting
After entering total IQ as a covariate, the previously reported significant group difference (Scheres et al., 2010) remained significant (F(2,68)=3.6; p<0.03). Fig. 2 displays the discounting curves (averaged across the three conditions) for each group, illustrating the relatively small AUC for the ADHD-C group.
Subjective measure: ratings of experienced ease/difficulty waiting
Contrary to the temporal discounting curves, groups did not differ for AUC for subjective ease/difficulty waiting (F(2,74)=0.90, ns; η2=0.03) (see Fig. 3). This remained unchanged after
Discussion
This study showed that children and adolescents with ADHD-C reported the same subjective ratings of ease/difficulty as those with ADHD-I and typically developing controls, when asked how difficult it was for them to wait for a large reward during increasing delay durations in the context of a temporal reward discounting task. However, the ADHD-C group did have steeper temporal reward discounting rates than ADHD-I and controls (Scheres et al., 2010), even after controlling for total IQ.
Acknowledgment
This research was partially funded by an NIMH R03 grant (No. MH074512-01A1) to AS. We thank Bernadette Duenas, Tiffany Glant, and Kristen Ray for their help with data entry and collection. We thank Bill Burk for statistical advice, and Alan Sanfey for helpful discussions. We gratefully acknowledge all participants and their parents for their time and willingness to be part of this research project.
References (57)
- et al.
Dissociable neural representations of future reward magnitude and delay during temporal discounting
Neuroimage
(2009) - et al.
Delay aversion in Attention Deficit/Hyperactivity Disorder: an empirical investigation of the broader phenotype
Neuropsychologia
(2009) - et al.
Electrophysiological markers of the motivational salience of delay imposition and escape
Neuropsychologia
(2012) - et al.
Continuous theta burst stimulation of right dorsolateral prefrontal cortex induces changes in impulsivity level
Brain Stimulation
(2010) - et al.
Neurobehavioral mechanisms of impulsivity: fronto-striatal systems and functional neurochemistry
Pharmacology, Biochemistry and Behavior
(2008) - et al.
The neuroscience of impulsive and self-controlled decisions
International Journal of Psychophysiology
(2006) - et al.
Brain activation to cues predicting inescapable delay in adolescent Attention Deficit/Hyperactivity Disorder: an fMRI pilot study
Brain Research
(2012) - et al.
The impact of reinforcement contingencies on AD/HD: a review and theoretical appraisal
Clinical Psychology Review
(2005) - et al.
Identifying the neurobiology of altered reinforcement sensitivity in ADHD: a review and research agenda
Neuroscience and Biobehavioral Reviews
(2010) - et al.
Are ADHD symptoms associated with delay aversion or choice impulsivity? A general population study
Journal of the American Academy of Child and Adolescent Psychiatry
(2009)
Neural hyporesposiveness and hyperresponsiveness during immediate and delayed reward processing in adult attention-deficit/ hyperactivity disorder
Biological Psychiatry
Temporal and probabilistic discounting of rewards in children and adolescents: effects of age and ADHD symptoms
Neuropsychologia
What we can and cannot conclude about the relationship between steep temporal reward discounting and hyperactivity-impulsivity symptoms in attention-deficit/hyperactivity disorder
Biological Psychiatry
Temporal reward discounting in attention-deficit/hyperactivity disorder: the contribution of symptom domains, reward magnitude, and session length
Biological Psychiatry
Modeling attention-deficit/hyperactivity disorder: a critical appraisal of the cognitive-energetic model
Biological Psychiatry
The dual pathway model of AD/HD: an elaboration of neuro-developmental characteristics
Neuroscience and Biobehavioral Reviews
Causal models of attention-deficit/hyperactivity disorder: from common simple deficits to multiple developmental pathways
Biological Psychiatry
Executive dysfunction and delay aversion in ADHD: nosologic and diagnostic implications
Child and Adolescent Psychiatric Clinics of North America
Neuroeconomics of attention-deficit/hyperactivity disorder: differential influences of medial, dorsal, and ventral prefrontal brain networks on suboptimal decision making?
Biological Psychiatry
Psychological heterogeneity in AD/HD—a dual pathway model of behavior and cognition
Behavioural Brain Research
Behavioral models of impulsivity in relation to ADHD: translation between clinical and preclinical studies
Clinical Psychology Review
Inhibitory functioning across ADHD subtypes: recent findings, clinical implications, and future directions
Developmental Disabilities Research Reviews
Diagnostic and Statistical Manual of Mental Disorders
Activity in children with ADHD during waiting situations in the classroom: a pilot study
British Journal of Educational Psychology
ADHD and delay aversion: the influence of non-temporal stimulation on choice for delayed rewards
Journal of Child Psychology and Psychiatry
Behavioral inhibition, sustained attention, and executive functions: constructing a unifying theory of ADHD
Psychological Bulletin
Executive functioning, temporal discounting, and sense of time in adolescents with attention deficit/hyperactivity disorder (AD/HD) and oppositional defiant disorder (ODD)
Journal of Abnormal Child Psychology
Limbic corticostriatal systems and delayed reinforcement
Annals of the New York Academy of Sciences
Cited by (44)
An original approach to anomalies in intertemporal choices through functional data analysis: Theory and application for the study of Hikikomori syndrome
2024, Socio-Economic Planning SciencesModels of attention-deficit hyperactivity disorder
2019, Behavioural ProcessesWaiting and working for rewards: Attention-Deficit/Hyperactivity Disorder is associated with steeper delay discounting linked to amygdala activation, but not with steeper effort discounting
2018, CortexCitation Excerpt :There are only a few studies that have examined whether subjective experiences during waiting contribute to an immediate reward preference in ADHD. Scheres, Tontsch, and Thoeny (2013b), for example, showed that impulsive choices were more strongly correlated with difficulty waiting in youth with ADHD than in controls. In another study, self-reported delay aversion was associated with preferences for smaller sooner rewards in undergraduates (Mies, De Water, & Scheres, 2016).
Temporal discounting and emotional self-regulation in children with attention-deficit/hyperactivity disorder
2016, Psychiatry ResearchCitation Excerpt :Most TD tasks follow a similar pattern of offering successive options to choose between a lesser reward immediately and a more advantageous reward after certain time intervals that vary with each trial (Killeen, 2009; Tesch and Sanfey, 2008; Hurst et al., 2011). Research has shown that ADHD patients have steeper TD curves than normal-development individuals (Demurie et al., 2012; Hurst et al., 2011; Demurie et al., 2013a; Wilson et al., 2012; Dias et al., 2014; Rubia et al., 2009; Dai et al., 2013; Scheres et al., 2013, 2010a; Paloyelis et al., 2010). TD rates may vary depending on type of reward (Demurie et al., 2013b), age (Scheres et al., 2008), type of task (Scheres et al., 2008, 2010b; Paloyelis et al., 2010), ADHD symptoms (Scheres et al., 2013, 2010b; Paloyelis et al., 2010) and to a lesser extent on IQ (Wilson et al., 2012).