This article describes an investigation of the psychometric properties of a self-report questionnaire for measuring children’s temperament. The theoretical foundation for this scale, the Early Adolescent Temperament Questionnaire-Revised (EATQ-R), was laid by Mary Rothbart and her colleagues who have defined temperament as individual differences in reactivity and self-regulation (Rothbart and Derryberry 1981), with reactivity referring to the excitability, responsivity, or arousability of the behavioral and physiological systems of an organism, and self-regulation pertaining to neural and behavioral processes that function to modulate this underlying reactivity. In the past decade, the contours of this temperamental model have gradually crystallized (Rothbart 1989; Rothbart and Bates 1998, 2006; Rothbart et al. 1994, 2000, 2006), and not surprisingly this has led to the application of the model in various developmental contexts (e.g., Eisenberg et al. 2004b; Muris and Ollendick 2005; Nigg 2006).
At a more general level, temperament can be defined as “biologically rooted individual differences in behavior tendencies that are present early in life and are relatively stable across various kinds of situations and over the course of time” (Bates 1987; p. 1101). The difference between temperament and personality is rather vague. Temperament is viewed as the part of personality that is genetically determined, and is considered as the observable manifestation of the child’s emerging personality (Matthews et al. 2003). Empirical evidence for the relation between temperament and personality has been provided by Caspi and colleagues (Caspi 2000; Caspi et al. 2003; Caspi and Silva 1995) who followed three temperament groups of young children in their development to adulthood. Children who at 3 years of age had been classified as undercontrolled and overcontrolled still showed signs of these temperament categories at age 26, whereas children who had been classified as well-adjusted when they were young, still represented the normative group in adulthood. Although the links between childhood temperament and adult personality were at best modest, this study demonstrates that there is reasonable stability in individuals’ behavioral characteristics over long time periods. Furthermore, it is increasingly acknowledged that at various ages temperament plays a critical role in youths’ social and emotional functioning, and more specifically in the development of psychopathological syndromes (Muris and Ollendick 2005; Nigg 2006).
Many blueprints have been hypothesized for the structure of temperament in children. A frequently cited framework is the one formulated early on by Chess and Thomas (1985; see also Thomas and Chess 1977) who identified three fundamental temperament types, namely ‘easy’, ‘difficult’, and ‘slow-to-warm-up’, which all reflect clear variations in the type and intensity of children’s responses to stimuli in the environment. Other descriptive frameworks for children’s temperament have adopted a more dimensional approach, and have aimed at identifying basic temperamental traits. A good example of such an approach is Buss and Plomin’s (1984) Emotionality–Activity–Sociability (EAS) model. The first dimension of ‘emotionality’ refers to psychological instability and a proneness to experience feelings of fear, anger, and sadness, the second dimension of ‘activity’ is concerned with characteristics such as tempo, vigor, and endurance, while the third and final dimension is ‘sociability’, which pertains to traits such as tendencies to affiliate and to be responsive to others. Interestingly, a comparison of the EAS model with current theories of personality such as the ‘Big Five’ (Costa and McCrae 1992) and the ‘Giant Three’ (Eysenck 1991) makes clear that the three temperament dimensions are clearly linked to the personality factors of ‘neuroticism’ and ‘extraversion’. That is, neuroticism can be viewed as an equivalent for emotionality, whereas extraversion can be regarded as a mixture of activity level and sociability.
The aforementioned temperament theory of Rothbart (Putnam et al. 2002; Rothbart and Bates 1998) proposes that temperament not only consists of reactive characteristics pertaining to the basis dimensions of emotionality, activity, and sociability, but also contains regulative features that can be subsumed under the concept of ‘effortful control’. Effortful control refers to self-regulative processes and can best be defined as “the ability to inhibit a dominant response to perform a subdominant response” (Rothbart and Bates 1998). The idea is that effortful control enables children to regulate emotions and to control their behavior, which may have positive effects on their social interactions with other children (Eisenberg et al. 2004a; Fabes et al. 1999; Guthrie et al. 1997; Kochanska 1997). In children with low levels of effortful control such normal processes can be disturbed and this may increase their vulnerability to develop psychopathological symptoms (see for reviews Muris and Ollendick 2005; Nigg 2006).
To measure the full range of temperament traits as proposed in Rothbart’s theory, various parent-rating scales have been developed that can be employed in children of various ages (Garnstein and Rothbart 2003; Rothbart 1981; Rothbart et al. 2001; Putnam and Rothbart 2006; Putnam et al. 2006). The EATQ-R (Ellis and Rothbart 2001) has been specifically developed to measure these reactive and regulative temperament factors from the child’s point-of view. Such a self-report scale seems an important addition to the instruments for measuring temperament in youths, as self-description is generally regarded as an important source of information in the field of personality research (Carver and Scheier 1996). The EATQ-R is a revised and updated version of the EATQ (Capaldi and Rothbart 1992) and can be used in children and adolescents aged between 9 and 15 years (Ellis and Rothbart 2001). The full questionnaire consists of 11 scales for measuring various aspects of temperament, and two additional scales for assessing symptoms of aggression and depression among youths. Although researchers increasingly use the EATQ-R for measuring youths’ temperament (e.g., Muris et al. 2007; Oldehinkel et al. 2004; Van Brakel and Muris 2006; Veenstra et al. 2006), a comprehensive study evaluating the reliability and validity of the self-report version of this scale is currently missing in the literature.
With this in mind, the current investigation was set-up. The EATQ-R was administered to a large sample of children and adolescents (N = 1,055) in order to study the following issues: (1) The structure of the questionnaire was explored by means of a principal components analysis; (2) The reliability (i.e., internal consistency and test–retest stability) of various EATQ-R temperament scales was examined; (3) The parent–child agreement of the scale was investigated; and (4) The validity of the EATQ-R temperament scales was established by studying its associations with measures of personality and psychopathology. The relation with personality was examined by studying associations between EATQ-R scales and Gray’s (1991) biologically determined personality factors that are thought to reflect the activity of brain systems that serve to regulate withdrawal and approach behavior in response to environmental stimuli [i.e., the behavioral inhibition system (BIS) and the behavioral activation system (BAS)], and Kagan’s (1994) temperament-based individual difference variable of “behavioral inhibition to the unfamiliar” that can be defined as the tendency to exhibit fearfulness, restraint, and withdrawal in the face of novel events or situations, including unfamiliar rooms, toys, peers, and adults (which may be intimately related to or even overlapping with Gray’s BIS). It was anticipated that EATQ-R scales covering aspects of emotionality would be positively associated with BIS, scales covering aspects of activity and sociability would be positively related to BAS, while EATQ-R shyness would be particularly linked to Kagan’s concept of behavioral inhibition. The connection with psychopathology was investigated by studying associations between EATQ-R scales and symptom levels of internalizing (e.g., anxiety disorders, depression) and externalizing (e.g., aggression) problems. Here, it was anticipated that EATQ-R scales pertaining to emotionality would be positively related to symptoms of internalizing and externalizing, whereas EATQ-R scales referring to effortful control would be negatively related to such symptoms.
Method
Participants
One-thousand-and-fifty-five children and young adolescents (528 boys and 527 girls) were recruited from 17 regular primary and secondary schools in the eastern part of Belgium and the southern and western parts of the Netherlands. Children’s ages ranged between 8 and 14 years (mean age = 11.06 years, SD = 1.00). More precisely, the sample consisted of 1 (0.1%) 8-year-old, 49 (4.6%) 9-year-olds, 252 (23.9%) 10-year-olds, 425 (40.3%) 11-year-olds, 237 (22.5%) 12-year-olds, 90 (8.5%) 13-year-olds, and 1 (0.1%) 14-year-old. The research project was officially approved by the Ethical Committee of Psychological Research of Erasmus University. Written informed consent was obtained from parents who indicated that (1) they had no objection that their child participated in the study, (2) their child was willing to take part in the study, and (3) in case parent scales were included in the study, they agreed to fill out such measures. Due to school constraints, no exact information about the socioeconomic background of the youths was available. However, almost 15% was non-Caucasian, which in The Netherlands and Belgium is generally indicative for a lower socioeconomic status.
Questionnaires
The long version of the EATQ-R (Ellis and Rothbart 2001) measures the following reactive and regulative temperament traits in 9- to 15-year-old children and adolescents: (1) ‘activation control’ is concerned with the ability to perform an action when there is a strong tendency to avoid it (e.g., “If I have a hard assignment to do, I get started right away”), (2) ‘activity level’ involves participation in activities requiring high levels of physical activity (e.g., “I would rather play a sport than watch TV”), (3) ‘affiliation’ has to do with the desire for warmth and closeness with others (e.g., “I enjoy exchanging hugs with people I like”), (4) ‘attention’ relates to the ability to focus and shift attention when desired (e.g., “It is easy for me to really concentrate on homework problems”), (5) ‘fearfulness’ refers to the tendency to experience unpleasant affect related to anticipation of distress (e.g., “I worry about getting into trouble”), (6) ‘frustration’ pertains to the tendency to experience unpleasant affect related to the interruption of ongoing tasks or goal blocking (e.g., “I get upset if I am not able to do a task really well”), (7) ‘high intensity pleasure’ involves the pleasure derived from activities involving high intensity or novelty (e.g., “I enjoy going to places where there are big crowds and lots of excitement”), (8) ‘inhibitory control’ is concerned with the ability to plan, and to suppress inappropriate responses (e.g., “When someone tells me to stop doing something, it is easy for me to stop”), (9) ‘perceptual sensitivity’ relates to the detection and awareness of slight, low-intensity stimulation in the environment (e.g., “I tend to notice little changes that other people do not notice”), (10) ‘pleasure sensitivity’ regards the amount of pleasure related to activities and stimuli involving low intensity, complexity, and novelty (e.g., “I like to look at trees and walk amongst them”), and (11) ‘shyness’ which refers to behavioral inhibition to novelty and challenge, especially social (e.g., “It is a lot easier for me to talk to familiar people than to strangers”). In addition, the EATQ-R includes two behavioral scales for measuring symptoms of aggression and depressive mood. Because the present study was concerned with the study of youths’ temperament, these scales were discarded. Each item has to be answered on a five-point Likert scale ranging from 1 = almost never true to 5 = almost always true. Temperament trait scores can be computed by summing ratings across relevant items (after recoding inversely formulated items).
There is evidence indicating that EATQ-R scales cluster on a number of higher-order temperament factors. More precisely, activation control, attention, and inhibitory control seem to constitute the factor of effortful control, frustration and fear seem to comprise the factor of emotionality, whereas high intensity pleasure, activity level, and low levels of shyness seem to form the higher-order factor of extraversion/surgency (see Ellis and Rothbart 2001; Muris et al. 2007). Other EATQ-R scales show a less consistent pattern of loadings on these three higher-order temperament factors.
The parent version of the EATQ-R is identical to the self-report version except for the fact that items are rephrased in terms of the parents’ perspective. Examples are “My child worries about getting into trouble”, “My child enjoys going to places where there are big crowds and lots of excitement”, and “It is easy for my child to really concentrate on homework problems”.
The child version of the BIS/BAS scales (Carver and White 1994) intends to measure individual differences in sensitivity of the behavioral inhibition and behavioral activation systems (i.e., BIS and BAS; Gray 1991). The items of the original scales were somewhat changed and simplified to make them more appropriate and understandable to children (e.g., “I am hurt when people scold me or tell me that I do something wrong”, “I get thrilled when good things happen to me”; see Muris et al. 2005). Each item has to be scored on a four-point Likert scale with 0 = not true, 1 = somewhat true, 2 = true, and 3 = very true. A recent study by Muris et al. (2005) has shown that the child version of the BIS/BAS scales possesses a theoretically meaningful factor structure with two separate factors for BIS and BAS. Further, the reliability of the BIS and BAS scales appears satisfactory (with Cronbach’s alphas > 0.75), and the scales generally show the expected relationships with other personality traits and psychopathological symptoms.
To measure Kagan’s (1994) temperamental characteristic of behavioral inhibition, the Behavioural Inhibition Scale (see Gest 1997; Muris et al. 1999) was used. The scale consists of four items relating to shyness (“I am shy when I have to talk to an unfamiliar person”), communication (“I talk easily to an unfamiliar person”), fearfulness (“I feel nervous when I have to talk to an unfamiliar person”), and smiling (“I feel good and I am able to laugh, when I talk to an unfamiliar person”). Each item is rated on a four-point Likert scale with 1 = never, 2 = sometimes, 3 = often, and 4 = always. After recoding the positive items, scores are summed to yield a total BIS score ranging from 4 (not apprehensive, not shy and very sociable when meeting an unfamiliar person) to 16 (very apprehensive and shy and not capable of initiating social interaction with an unfamiliar person). Previous research has provided clear support for the reliability (with Cronbach’s alpha > 0.80 and a test–retest correlation of 0.72) and validity of the BIS (Muris et al. 1999, 2001b, 2003a; Van Brakel and Muris 2006; Van Brakel et al. 2004).
The short version of the Revised Child Anxiety and Depression Scale (RCADS; Chorpita et al. 2000) is a 25-item scale for measuring symptoms of DSM-defined anxiety disorders and depression. Items (e.g., “I am afraid of looking foolish in front of people”, “I feel sad or empty”) have to be scored on a 4-point scale with 0 = never, 1 = sometimes, 2 = often, and 3 = always. In the present study, anxiety (20 items) and depression (five items) scores were obtained by summing across relevant items. Previous research has indicated that the (shortened) RCADS has a clear-cut factor structure, is reliable in terms of internal consistency and temporal stability (all Cronbach’s alphas > 0.60 and test–retest correlations between 0.79 and 0.85), and displays good validity as evidenced by positive associations with concurrent childhood questionnaires (Muris et al. 2002).
The Child Rating scale for Aggression (CRA) is a self-report version of the Teacher Rating scale for Aggression (Brown et al. 1996), which consists of 21 items referring to aggressive feelings and behaviors of children (e.g., “I get angry for no reason”, “I am mean”). Each item has to be scored on a five-point scale with 1 = never, 2 = seldom, 3 = sometimes, 4 = often, and 5 = almost always. Recent studies have demonstrated that the CRA is reliable in terms of internal consistency (Cronbach’s alpha > 0.80; Meesters et al. 2007; Roelofs et al. 2006) and temporal stability (test–retest correlation = 0.75; Korchnakova 2007), and correlates significantly with other measures of self-reported disruptive behavior problems such as the Youth Self-Report externalizing scale (Vincken et al. 2004).
The self-report version of the Strengths and Difficulties Questionnaire (SDQ; Goodman 2001) consists of 25 items describing positive and negative attributes of children and adolescents that can be allocated to five subscales of five items each: emotional symptoms, conduct problems, hyperactivity-inattention, peer problems, and prosocial behavior. Each item has to be scored on a three-point scale with 0 = not true, 1 = somewhat true, and 2 = certainly true. Subscale scores can be computed by summing scores on relevant items (after recoding reversed items; range 0–10). Higher scores on the prosocial behaviour subscale reflect strengths, whereas higher scores on the other four subscales reflect difficulties. A total difficulties score can also be calculated by summing the scores on the emotional symptoms, conduct problems, hyperactivity-inattention, and peer problems subscales (range 0–40). Research has shown that the SDQ has acceptable psychometric properties: reliability is reasonable with most Cronbach’s alphas being > 0.60, whereas validity appears good as evidenced by substantial correlations with other scales for measuring internalizing and externalizing problems in youths (Goodman 2001; Muris et al. 2003b; Muris et al. 2004).
All the questionnaires were in Dutch and in case they were derived from English scales carefully translated following a translation/back-translation procedure. As can be seen from the references above, scales have been tested extensively in Dutch samples, and this research has generally provided support for the equivalence of the Dutch and English versions. In passing, it should be noted that, with few exceptions, most scales that were employed in the present study displayed adequate internal consistency. More precisely, Cronbach’s alphas were 0.75 for BIS and 0.80 for BAS, 0.72 for the scale measuring Kagan’s concept of behavioral inhibition, 0.55 for RCADS depression and 0.87 for RCADS anxiety, 0.88 for CRA total aggression, and varied between 0.41 (peer problems) and 0.70 (hyperactivity-inattention) for the SDQ subscales.
Procedure
Children and adolescents completed the EATQ-R and other questionnaires in their classrooms at school. Prior to the assessment session, information was given about the study after children were explicitly asked whether they still agreed to participate. None of the youths declined from participation. While completing various questionnaires, a research assistant and the teacher were always present to ensure confidential and independent responding, and to provide assistance to the children if necessary.
A subsample of children’s parents received the EATQ-R by mail after they had responded favorably to mailed invitation. They completed the questionnaire at home and then returned it to the researchers in a sealed envelope.
The total sample of 1,055 children and adolescents was used for examining the internal consistency reliability and factor structure of the EATQ-R. Subsets of the sample were involved in specific aspects of the study such as the collection of the test–retest data (8-weeks interval) and the validity of the self-report version of the EATQ-R through its relations with the parent version of this scale and other questionnaires. The rationale for deriving subsamples was twofold: First, some of the schools only consented to spend a limited amount of time to the research project, and second, the inclusion of all scales would have yielded a rather lengthy survey, which probably would have undermined children’s dedication. The test–retest sample contained 101 children (46 boys and 55 girls) with a mean age of 10.48 years (SD = 1.07). Three further subsamples were used to examine the parent–child agreement of the EATQ-R and its relationship to measures of psychopathology (N = 390; 191 boys and 199 girls; mean age = 10.90, SD = 0.69) and personality (BIS/BAS scales: N = 240; 120 boys and 120 girls; mean age = 11.57, SD = 1.48; Behavioral inhibition: N = 108; 49 boys and 59 girls; mean age = 10.47, SD = 1.08). There were no significant gender differences among the four subsamples [χ
2(3) = 4.14, p = 0.38]. However, an analysis of variance indicated that the samples did differ with regard to age [F(3, 1,050) = 27.14, p < 0.001]: the subsample in which the relations between the EATQ-R and BIS/BAS scales were examined was significantly older than the other subsamples (all ps < 0.01). It is important to note that almost all data were new and specifically collected for the purpose of the present study. The only exception were the EATQ-R data obtained by Muris et al. (2007), which were included in the total sample for investigating the internal consistency and structure of the scale.
Results
Gender Differences and Internal Consistency
Inspection of the mean scores on various EATQ-R temperament scales (Table 1) indicated that fearfulness, shyness, and high intensity pleasure items were the least frequently endorsed temperament characteristics, whereas affiliation, activity level, and activation control were most often endorsed by these non-clinical youths. Furthermore, t-tests indicated that there were significant gender differences on a number of temperament scales. More precisely, girls exhibited higher levels of affiliation [t(1,053) = 9.90, p < 0.001], fearfulness [t(1,053) = 6.37, p < 0.001], inhibitory control [t(1,053) = 3.89, p < 0.001], pleasure sensitivity [t(1,053) = 2.94, p < 0.005], and shyness [t(1,053) = 3.54, p < 0.001], whereas boys showed higher levels of activity level [t(1,053) = 3.96, p < 0.001] and high intensity pleasure [t(1,053) = 6.41, p < 0.001] (cf. Else-Quest et al. 2006).
Table 1
General statistics (mean scores, gender differences, and reliability coefficients) for various temperament scales of the EATQ-R
Total sample M (SD) | Boys M (SD) | Girls M (SD) | α Original scale | α Final scalea
| |
|---|---|---|---|---|---|
EATQ-R | |||||
Activation control | 3.53 (0.58) | 3.49 (0.58)a
| 3.57 (0.58)a
| 0.61 [8] | 0.68 [6] |
Activity level | 3.69 (0.69) | 3.78 (0.69)a
| 3.61 (0.69)b
| 0.71 [6] | 0.71 [6] |
Affiliation | 3.76 (0.58) | 3.59 (0.58)a
| 3.92 (0.52)b
| 0.65 [8] | 0.65 [8] |
Attention | 3.37 (0.56) | 3.39 (0.58)a
| 3.35 (0.55)a
| 0.51 [7] | 0.61 [5] |
Fearfulness | 2.65 (0.77) | 2.50 (0.75)a
| 2.80 (0.77)b
| 0.62 [6] | 0.62 [6] |
Frustration | 3.12 (0.63) | 3.17 (0.63)a
| 3.07 (0.63)a
| 0.72 [9] | 0.72 [9] |
High intensity pleasure | 2.96 (0.60) | 3.07 (0.57)a
| 2.84 (0.60)b
| 0.67 [11] | 0.73 [9] |
Inhibitory control | 3.19 (0.50) | 3.13 (0.51)a
| 3.25 (0.49)b
| 0.58 [11] | 0.63 [7] |
Perceptual sensitivity | 3.16 (0.68) | 3.18 (0.70)a
| 3.14 (0.66)a
| 0.57 [6] | 0.61 [5] |
Pleasure sensitivity | 3.12 (0.75) | 3.05 (0.72)a
| 3.19 (0.77)b
| 0.70 [7] | 0.74 [6] |
Shyness | 2.80 (0.73) | 2.72 (0.71)a
| 2.88 (0.75)b
| 0.71 [7] | 0.71 [7] |
Internal consistency coefficients were modest but sufficient for most EATQ-R scales. However, for three scales (i.e. attention, inhibitory control, and perceptual sensitivity), Cronbach’s alphas were below acceptable limits (0.51, 0.58, and 0.57, respectively). To improve the internal consistency of various scales, the item-total scale correlations were examined in detail, after which unsatisfactory items (with an item-total correlation < 0.20) were removed. This procedure led to the elimination of 12 items, and resulted in sufficient alpha values for all EATQ-R scales (see right column of Table 1).
Factor Structure
A principal components analysis (with an oblimin rotation) performed on the items of the EATQ-R1 yielded 19 components with an eigenvalue > 1.0, which accounted for 52.77% of the total variance. However, this solution was not satisfactory, and so the next step was to extract 11 components, which was in keeping with the number of temperament scales included in the EATQ-R. Although several interpretable factors emerged, there were also a number of less clear components that only consisted of one or two items. After reducing the number of components to nine, a theoretically meaningful structure emerged, which accounted for 37.24% of the variance. As can be seen in Table 2, most EATQ-R items loaded on a component that was unique for their intended temperament scale. There were three exceptions to this rule, component 1 mainly consisted of a mixture of frustration and inhibitory control, component 8 not only contained fearfulness but also a number of frustration items, whereas component 9 was a compound of activation control, attention, and inhibitory control items and thus essentially reflected effortful control.2 Although the hypothesized structure did not fully emerge, it was decided to use the 11 original scales in the further course of this article in order to enhance comparability with previous studies.
Table 2
Principal components factor analysis (oblimin rotation) performed on the temperament items of the EATQ-R
Abbreviated item | Loading | |
|---|---|---|
Component 1a
| ||
Frustration [91] | Annoyed when waiting in lines | 0.66 |
Frustration [79] | Irritated when stopped doing something pleasant | 0.62 |
Inhibitory control [12] | When excited, hard to wait one’s turn (R) | −0.57 |
Inhibitory control [22] | Hard not to open presents (R) | −0.54 |
Inhibitory control [39] | When having good time, hard to go home (R) | −0.54 |
Frustration [58] | Upset when parents won’t let me do something | 0.52 |
Frustration [42] | Bothered by busy line when making phone call | 0.50 |
Frustration [40] | Patient person (R) | 0.49 |
Frustration [101] | Frustrated when people interrupt me | 0.43 |
Frustration [73] | Bothered when people are slow to get ready | 0.43 |
Attention [44] | When interrupted, forget what saying (R) | −0.39 |
Inhibitory control [46] | Not able to stop oneself (R) | −0.37 |
Inhibitory control [21] | Saying the first thing that comes to mind (R) | −0.34 |
Component 2b
| ||
Affiliation [51] | Do anything to help dear person | 0.60 |
Affiliation [47] | Enjoying to hug people | 0.59 |
Affiliation [75] | Important to have close relationships | 0.53 |
Affiliation [78] | Like looking at other people’s photographs | 0.49 |
Affiliation [94] | Like listening to other people talking | 0.49 |
Affiliation [38] | Like to spend time with good friend every day | 0.48 |
Affiliation [23] | Wanting to share private thoughts | 0.44 |
Affiliation [88] | Warm and friendly person | 0.40 |
Component 3c
| ||
High intensity pleasure [53] | Not afraid to try risky sport | 0.67 |
High intensity pleasure [14] | Scary to ski down a steep slope (R) | 0.66 |
High intensity pleasure [99] | Not afraid to try mountain climbing | 0.63 |
High intensity pleasure [61] | Exciting to drive in race car | 0.59 |
High intensity pleasure [95] | Do not want frightening rides at the fair (R) | 0.54 |
High intensity pleasure [17] | Not afraid to skateboard or ride bike down a steep hill | 0.52 |
High intensity pleasure [2] | Enjoy big crowds and lots of excitement | 0.46 |
High intensity pleasure [103] | Prefer exciting and unpredictable friends | 0.44 |
Fearfulness [54] | Frightened when riding with person who likes to speed | −0.37 |
High intensity pleasure [27] | Want to go on trips to exotic places | 0.31 |
Component 4d
| ||
Pleasure sensitivity [70] | Enjoy listening to birds singing | 0.75 |
Pleasure sensitivity [30] | Like to look at trees | 0.73 |
Pleasure sensitivity [80] | Like to look at clouds in the sky | 0.70 |
Pleasure sensitivity [48] | Like crunching sound of autumn leaves | 0.70 |
Pleasure sensitivity [50] | Like to feel breeze blowing in face | 0.50 |
Pleasure sensitivity [28] | Like the sounds of words | 0.40 |
Component 5e
| ||
Shyness [76] | Shy | 0.82 |
Shyness [87] | Not shy (R) | 0.78 |
Shyness [6] | Shy about meeting people | 0.74 |
Shyness [69] | Easier to talk to people I know than to strangers | 0.49 |
Shyness [52] | Know what to say, even to strangers (R) | 0.46 |
Shyness [9] | Shy with kids of opposite sex | 0.41 |
Shyness [43] | Uncomfortable when delivering message to adults | 0.30 |
Component 6f
| ||
Perceptual sensitivity [11] | Notice even little changes in environment | 0.67 |
Perceptual sensitivity [31] | Notice little changes that other people not notice | 0.65 |
Perceptual sensitivity [35] | Very aware of noises | 0.57 |
Perceptual sensitivity [4] | Notice when people are coughing during movies | 0.53 |
Perceptual sensitivity [41] | Tell another person is angry by their expression | 0.44 |
Component 7g
| ||
Activity level [100] | Prefer outdoor activities | 0.70 |
Activity level [36] | Like to be physically active | 0.68 |
Activity level [83] | Go out of the house during long winter weekends | 0.68 |
Activity level [1] | Rather play a sport than watch TV | 0.66 |
Activity level [16] | Do things with a lot of energy | 0.50 |
Activity level [64] | Have the energy for hard physical work | 0.50 |
Component 8h
| ||
Fearfulness [57] | Worry about my family | 0.65 |
Fearfulness [85] | Worry about parents dying or leaving | 0.60 |
Fearfulness [3] | Worry about getting into trouble | 0.56 |
Frustration [102] | Upset when cannot do task very well | 0.56 |
Frustration [98] | Frustrated when making mistake in school work | 0.51 |
Attention [56] | Hard to shift gears when going to another class (R) | −0.42 |
Fearfulness [77] | Nervous of some kids at school | 0.40 |
Fearfulness [93] | Scared to enter a dark room at home | 0.39 |
Component 9i
| ||
Activation control [63] | Finish homework in time | 0.69 |
Attention [25] | Easy to concentrate on homework problems | 0.60 |
Activation control [66] | Start right away with hard assignment | 0.57 |
Activation control [82] | Put off working on projects (R) | 0.56 |
Attention [97] | Pay close attention when told how to do something | 0.56 |
Activation control [24] | Do something fun before starting homework (R) | 0.53 |
Attention [62] | When studying difficulty to concentrate (R) | 0.51 |
Activation control [7] | Have hard time finishing things on time (R) | 0.51 |
Activation control [65] | Being on time for school and appointments | 0.50 |
Inhibitory control [19] | When told to stop easy to do so | 0.37 |
Inhibitory control [45] | Blurt out answers before teacher calls | 0.36 |
A second-order principal components analysis (with oblimin rotation) carried out on the EATQ temperament scale scores yielded three factors with eigenvalues > 1.0 (i.e., 2.65, 2.02, and 1.46), which accounted for 55.76% of the total variance. As shown in Table 3, the first component consisted of the effortful control-related scales of activation control, attention, and inhibitory control (positive loadings) and the emotionality-related scales of fearfulness and frustration (negative loadings). The second component contained the temperament scales of pleasure sensitivity, affiliation, fearfulness, and perceptual sensitivity (all positive loadings), whereas the third and final component consisted of high intensity pleasure and activity levels (positive loadings) and shyness and fearfulness (negative loadings).3
Table 3
Second-order principal components factor analysis (oblimin rotation) performed on the temperament scales of the EATQ-R
Component 1 | Component 2 | Component 3 | |
|---|---|---|---|
EATQ-R | |||
Inhibitory control | 0.80 | ||
Attention | 0.75 | ||
Activation control | 0.73 | ||
Frustration | −0.70 | ||
Pleasure sensitivity | 0.75 | ||
Affiliation | 0.72 | ||
Fearfulness | −0.43 | 0.58 | −0.43 |
Perceptual sensitivity | 0.53 | ||
High intensity pleasure | 0.79 | ||
Activity level | 0.61 | ||
Shyness | −0.58 | ||
When solely focusing on the temperament scales that are relevant for the three main temperament factors of emotionality, extraversion, and effortful control, a clear-cut three factor structure emerged (eigenvalues were 2.64, 1.49, and 1.06; explained variance = 64.84%): activation control, attention, and inhibitory control loaded clearly on the first component (effortful control), activity level and high intensity pleasure loaded convincingly on the second component (extraversion), whereas fearfulness, frustration, and shyness loaded on the third component (emotionality).
Test–retest Stability and Parent–child Agreement
Paired t-tests indicated that none of the EATQ-R scale scores changed significantly during the 8-week period. Intra-class correlation coefficients (N = 101) were all significant and ranged between 0.55 (perceptual sensitivity) and 0.85 (frustration), indicating modest to good test–retest stability (see Table 4).
Table 4
Test–retest and parent–child correlations for EATQ-R temperament scales
Test–retest stabilitya
| Parent–child agreementb
| |
|---|---|---|
EATQ-R | ||
Activation control | 0.76 | 0.45 |
Activity level | 0.72 | 0.59 |
Affiliation | 0.80 | 0.33 |
Attention | 0.70 | 0.48 |
Fearfulness | 0.73 | 0.42 |
Frustration | 0.85 | 0.33 |
High intensity pleasure | 0.69 | 0.58 |
Inhibitory control | 0.78 | 0.42 |
Perceptual sensitivity | 0.55 | 0.33 |
Pleasure sensitivity | 0.73 | 0.40 |
Shyness | 0.73 | 0.40 |
Correlations between the child and parent version (N = 390) varied between 0.33 (affiliation, frustration, and perceptual sensitivity) and 0.59 (activity level), suggesting that the parent–child agreement of various EATQ-R scales was low to moderate (Table 4).
Validity I: Correlations with Personality Scales
As shown in Table 5, BIS scores were positively correlated with EATQ-R fearfulness, frustration, shyness, and pleasure sensitivity (rs between 0.24 and 0.58, ps < 0.001), whereas significant negative correlations were found with attention and inhibitory control (rs being -.26 and −0.31, respectively, ps < 0.001). As expected, BAS scores were positively related to frustration and high intensity pleasure (rs being 0.52 and 0.29, ps < 0.001) and negatively linked to attention and inhibitory control (rs being −0.25 and −0.53, ps < 0.001). Surprisingly, BAS scores were also positively associated with fearfulness, although this correlation was significantly smaller than that between BIS scores and fearfulness (Z = 5.28, p < 0.001) and clearly disappeared when controlling for the shared variance between BIS and BAS scores (r = 0.07).
Table 5
Correlations (corrected for gender) between EATQ-R scales and other personality/temperament scales
BIS | BAS | Behavioral inhibition | |
|---|---|---|---|
EATQ-R | |||
Activation control | −0.12 | −0.16 | −0.02 |
Activity level | −0.03 | 0.13 | −0.16 |
Affiliation | 0.20 | 0.22 | −0.11 |
Attention | −0.26* | −0.25* | −0.03 |
Fearfulness | 0.58* | 0.25* | 0.02 |
Frustration | 0.56* | 0.52* | −0.03 |
High intensity pleasure | −0.13 | 0.29* | −0.32* |
Inhibitory control | −0.31* | −0.53* | 0.18 |
Perceptual sensitivity | 0.11 | 0.08 | −0.07 |
Pleasure sensitivity | 0.24* | 0.05 | −0.03 |
Shyness | 0.39* | 0.03 | 0.45* |
Kagan’s temperamental construct of behavioral inhibition was positively related to EATQ-R shyness (r = 0.45, p < 0.001) and negatively linked to high intensity pleasure (r = −0.32, p < 0.001).
Validity II: Correlations with Psychopathological Symptoms
Correlations between EATQ-R temperament scales and various psychopathology measures are displayed in Table 6. As can be seen, the expected pattern of findings emerged. That is, negative correlations were found between various types of psychopathological symptoms and EATQ-R scales reflecting effortful control (i.e., activation control, attention, and inhibitory control). Not surprisingly, the most substantial correlations were found with SDQ hyperactivity/inattention problems (rs between −0.44 and −0.58, ps < 0.001), whereas links with other symptoms were more modest (rs between −0.16 and −0.49). Temperament scales referring to aspects of emotionality (i.e., fearfulness and frustration) were positively linked to symptom scores. The most convincing correlations emerged between fearfulness and RCADS anxiety and SDQ emotional symptoms (rs being 0.66 and 0.50, respectively, ps < 0.001), and between frustration and CRA aggression (r = 0.51, p < 0.001). Furthermore, prosocial behavior as indexed by the SDQ was positively associated with aspects of effortful control and affiliation (rs between 0.22 and 0.39, ps < 0.001). Finally, positive correlations were observed between shyness and internalizing symptoms (RCADS anxiety/depression and SDQ emotional symptoms (rs between 0.25 and 0.34, ps < 0.001) and between perceptual/pleasure sensitivity and RCADS anxiety (rs being 0.21 and 0.24, respectively, ps < 0.001), whereas negative correlations emerged between activity level and RCADS depression and SDQ peer relationship problems (rs being −0.26 and −0.23, respectively, ps < 0.001).
Table 6
Correlations (corrected for gender) between EATQ-R temperament scales and psychopathology questionnaires
RCADS anxiety | RCADS depression | CRA aggression | SDQ conduct | SDQ hyperactive | SDQ peer | SDQ emotional | SDQ prosocial | |
|---|---|---|---|---|---|---|---|---|
EATQ-R | ||||||||
Activation control | −0.34* | −0.29* | −0.39* | −0.42* | −0.52* | −0.26* | −0.31* | 0.34* |
Activity level | −0.05 | −0.26* | −0.06 | −0.11 | −0.01 | −0.23* | −0.16 | 0.18 |
Affiliation | 0.05 | −0.11 | −0.14 | −0.14 | −0.01 | −0.14 | 0.06 | 0.39* |
Attention | −0.42* | −0.37* | −0.41* | −0.40* | −0.58* | −0.32* | −0.40* | 0.32* |
Fearfulness | 0.66* | 0.31* | 0.17 | 0.26* | 0.21* | 0.34* | 0.50* | −0.03 |
Frustration | 0.43* | 0.22* | 0.51* | 0.33* | 0.38* | 0.17 | 0.31* | −0.14 |
High intensity pleasure | −0.16 | −0.12 | 0.08 | 0.06 | 0.06 | −0.13 | −0.18 | 0.03 |
Inhibitory control | −0.38* | −0.22* | −0.49* | −0.31* | −0.44* | −0.16 | −0.29* | 0.22* |
Perceptual sensitivity | 0.21* | 0.08 | 0.12 | 0.04 | 0.06 | −0.00 | 0.07 | 0.04 |
Pleasure sensitivity | 0.24* | 0.09 | 0.01 | −0.11 | −0.07 | 0.11 | 0.08 | 0.16 |
Shyness | 0.34* | 0.25* | 0.17 | 0.06 | 0.15 | 0.17 | 0.34* | −0.13 |
Discussion
The present study investigated the reliability and validity of the self-report version of the EATQ-R in children and adolescents. Altogether, it can be concluded that the psychometric properties of the scale are acceptable but certainly liable to improvement. In particular, the internal consistency of various scales needs to be ameliorated, and this could be achieved in two ways. First, some temperament scales are only composed of a restricted set of items, and so it may be useful to add new items in order to more fully cover the characteristics of the pertinent traits. Another possibility is to remove and/or reformulate reversed items. Although such items are included to tackle response tendencies, there is also evidence suggesting that children and young adolescents have difficulties with reversed items (because of double negation; e.g., Muris et al. 2001a). Indeed, closer inspection of the ‘bad’ items of the EATQ-R revealed a relatively high percentage of reversed items (25.8%) that had to be removed from the questionnaire, whereas the percentage of discarded normal items was only 10.8%. Of course, one could also argue that the psychometrics of the EATQ-R were less optimal because items were translated into the Dutch language (see also Veenstra et al. 2006). This argument can be countered by pointing at the careful translation/back-translation procedure that was followed and by noting that the obtained psychometrics did not deviate substantially from those reported for the English version of the scale (Ellis and Rothbart 2001).
The results of the principal components analyses justify the conclusion that the structure underlying the self-report version of the EATQ-R was not completely as hypothesized. This may have to do with the above mentioned point that some items of the questionnaire are less optimal and as a consequence certain temperament traits are not expressed very well. Further, the EATQ-R includes a number of scales that seem to be less clear-cut indicators of the main temperament traits of emotionality, extraversion, and effortful control. For example, a trait such as perceptual sensitivity would be indicative of effortful control (Rothbart 2007), but the link between the “detection or perceptual awareness of low-intensity stimulation” (i.e., perceptual sensitivity) and children’s regulation of emotions and behavior (which seems to be the central feature of effortful control) is not immediately clear. It may well be that with the inclusion of such ambiguous traits, the questionnaire has become too complex thereby hindering the emergence of a clear-cut factor structure. Note that some support was found for this idea as an additional analysis conducted on the more straightforward emotionality, extraversion, and effortful control scales of the EATQ-R clearly revealed support for the hypothesized three-factor model (see also Kim et al. 2003).
The test–retest stability of the EATQ-R was acceptable. Scores on the EATQ-R remained unchanged over the 8-weeks period, and most correlations between temperament scores on occasion 1 and 2 were found to be moderate to good. Previous research by Rothbart et al. (2001) has indicated that parent reports of these temperament traits in younger children (as indexed with the Children’s Behavior Questionnaire) remain fairly stable over a 2-year period (with test–retest rs between 0.50 and 0.79), and this seems to indicate that they reflect enduring characteristics in youths. The parent–child agreement was fairly low and comparable to that reported by Ellis and Rothbart (2001). Two possibilities suggest themselves to account for this finding. First, it may well be the case that children and parents conceive EATQ-R items in different ways. Second, it is also possible that parents have too little insight in the hidden elements of their child’s temperament (Achenbach et al. 1987; De Los Reyes and Kazdin 2005). At the very least, this implies that when assessing youths’ temperament, it seems important to employ a multi-informant approach.
With regard to the personality and psychopathology correlates of the EATQ-R a number of remarks are in order. To begin with, EATQ-R temperament scales were in a meaningful way related to Gray’s (1991) BIS/BAS dimensions and Kagan’s (1994) construct of behavioral inhibition. That is, the EATQ-R emotionality scales of fear and frustration were positively associated with BIS, extraversion/surgency scales were particularly associated with BAS, while EATQ-R shyness was significantly linked to behavioral inhibition. Further, relations between the EATQ-R and psychopathological symptoms were also as anticipated. That is, emotionality-related temperament traits were positively connected to internalizing and externalizing symptoms, whereas effortful control-based traits were negatively related to such symptoms (e.g., Eisenberg et al. 1996, 2001; Oldehinkel et al. 2004, 2006; Valiente et al. 2003). Some indications were found for the specificity of the links between temperament traits and psychopathological symptoms: for example, fearfulness was most convincingly linked to anxiety symptoms, whereas frustration was most clearly connected to aggression (see also Muris et al. 2007). In addition, effortful control-based scales and affiliation were found to be positively associated with children’s prosocial behavior, which of course supports the idea that high levels of regulation and striving for warm closeness to others are accompanied by high levels of positive social behavior. Finally, a number of correlations were found that were not directly anticipated. That is, BIS and anxiety scores were positively related to pleasure sensitivity, which nevertheless makes sense as youths with high levels of BIS and anxiety symptoms may have a preference for ‘safe’ activities and stimuli which are characterized by low intensity, complexity, and novelty. Anxiety scores were also positively linked to perceptual sensitivity, which is in keeping with the notion that high-anxious individuals display increased vigilance to environmental stimuli as they might signal impending danger (Vasey and MacLeod 2001). Altogether, these results on the personality and psychopathology correlates of the EATQ-R provide support for the validity of the scale.
Admittedly, the present study suffered from various shortcomings. First, this study only included non-clinical youth. It would be interesting to employ the EATQ-R for measuring reactive and regulative temperament characteristics in clinically referred youths. Second, while the EATQ-R is originally designed for children and adolescents aged 9 to 15 years, most participants in the present study were 10 to 12 years old (i.e., 86.7%). It is possible that the psychometrics of the questionnaire would have been better if the sample had included more older youths who generally possess better reading skills. However, during the administration of the EATQ-R, youths asked very few questions, which suggests that they understood the items of this measure rather well. Third, it can be argued that the correlations between temperament and psychopathology scales are largely the result of item overlap. However, recent studies (Lemery et al. 2002; Lengua et al. 1998) have demonstrated that even after eliminating such measurement confounding, temperament traits are still significantly related to children’s symptom levels. Fourth, EATQ-R scores were mainly correlated to other self-report scales of personality and psychopathology. Although this is a legitimate approach to investigate the validity of a self-report scale, the results would have been more compelling if data from parents and teachers had been collected. Finally, several scales were administered to assess various types of symptoms in youths, but only one questionnaire was included to measure the more positive features of youths (i.e., the SDQ prosocial behavior scale). The inclusion of scales measuring self-esteem, emotion regulation, and emotional intelligence would certainly have yielded more information on the validity of EATQ-R scales measuring regulative temperament traits. Despite these limitations, it can be concluded that the self-report version of the EATQ-R seems to be a useful scale for measuring reactive and regulative temperament in children and adolescents aged 9 years and above. Admittedly, there seems to be room for improving the psychometric qualities of the measure, but acknowledging the fact that it is important to assess temperament from youths’ own point-of-view, this seems to be a worthwhile scientific endeavor.
Open Access
This article is distributed under the terms of the Creative Commons Attribution Noncommercial License which permits any noncommercial use, distribution, and reproduction in any medium, provided the original author(s) and source are credited.
Open AccessThis is an open access article distributed under the terms of the Creative Commons Attribution Noncommercial License (https://creativecommons.org/licenses/by-nc/2.0), which permits any noncommercial use, distribution, and reproduction in any medium, provided the original author(s) and source are credited.