Measuring Test Anxiety in Primary and Middle School Children
Psychometric Evaluation of the Test Anxiety Questionnaire for Children (TAQ-C)
Abstract
Abstract. The increasing use of tests to assess academic competences has been associated with higher levels of test anxiety (TA) in children, underlining the importance of identifying this emotional problem and sustain academic achievement. This study aimed to contribute to the extant literature on the assessment of TA by examining the psychometric properties of the Test Anxiety Questionnaire for Children (TAQ-C), in primary and middle school children. In Study 1 (N = 123), we selected 24 items from a wider initial pool, dividing them into scales measuring Thoughts, Autonomic Reactions, Off-Task Behaviors, and Social Derogation, to develop the TAQ-C. In Study 2 (N = 899), the psychometric properties of this set of scales were assessed in students attending primary and middle school. Analyses supported the bifactor latent structure of the TAQ-C, invariance across educational levels and gender, concurrent and convergent validity, and test–retest reliability. Overall, the TAQ-C is a promising tool for assessing TA in primary and middle school students. Implications and directions for future research are discussed.
References
1995).
(Measurement of test anxiety: An overview . In C. D. SpielbergerP. R. VaagEds., Test anxiety: Theory, assessment, and treatment (pp. 15–33). Washington, DC: Taylor & Francis.2017). Social and dimensional comparisons in math and verbal test anxiety: Within- and cross-domain relations with achievement and the mediating role of academic self-concept. Contemporary Educational Psychology, 51, 240–252. https://doi.org/10.1016/j.cedpsych.2017.08.005
(1995). Effects of math self-concept, perceived self-efficacy, and attributions for failure and success on test anxiety. Journal of Educational Psychology, 87, 611–623. https://doi.org/10.1037/0022-0663.87.4.611
(2005). Test anxiety: A cross-cultural perspective. Clinical Child and Family Psychology Review, 8, 65–88. https://doi.org/10.1007/s10567-005-2342-x
(2015). When are multidimensional data unidimensional enough for structural equation modeling? An evaluation of the DETECT multidimensionality index. Structural Equation Modeling, 22, 504–516. https://doi.org/10.1080/10705511.2014.938596
(2003). Response quality in survey research with children and adolescents: The effect of labeled response options and vague quantifiers. International Journal of Public Opinion Research, 15, 83–94. https://doi.org/10.1093/ijpor/15.1.83
(2003). TMA – Test di valutazione multidimensionale dell’autostima
([Multidimensional Self Concept Scale] . Trento, Italy: Erickson.2017). Differentiating anxiety forms and their role in academic performance from primary to secondary school. PLoS One, 12, e0174418. https://doi.org/10.1371/journal.pone.0174418
(1981). Misurare l’intelligenza con i test “Culture Fair”
([Cattell Culture Fair Test] . Florence, Italy: Giunti OS.2017). Psychometric properties of the Abbreviated Math Anxiety Scale (AMAS) in Italian primary-school children. Learning and Individual Differences, 55, 174–182. https://doi.org/10.1016/j.lindif.2017.03.006
(2007). Sensitivity of goodness of fit indexes to lack of measurement invariance. Structural Equation Modeling, 14, 464–504. https://doi.org/10.1080/10705510701301834
(2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling, 9, 233–255. https://doi.org/10.1207/S15328007SEM0902_5
(2012). Gender differences in mathematics anxiety and the relation to mathematics performance while controlling for test anxiety. Behavioral and Brain Functions, 8, 1–9. https://doi.org/10.1186/1744-9081-8-33
(2016). The utility of the bifactor model in understanding unique components of anxiety sensitivity in a South Korean sample. Asian Journal of Psychiatry, 22, 116–123. https://doi.org/10.1016/j.ajp.2016.06.005
(2004).
(Program assessment and evaluation . In B. T. ErfordEd., Professional school counseling: A handbook of theories, programs & practices (pp. 303–309). Austin, TX: CAPS Press.2003). Effective interventions on test anxiety reduction: A meta-analysis. School Psychology International, 24, 313–328. https://doi.org/10.1177/01430343030243004
(2004). An empirical evaluation of alternative methods of estimation for confirmatory factor analysis with ordinal data. Psychological Methods, 9, 466–491. https://doi.org/10.1037/1082-989X.9.4.466
(1997). Measuring perceived test anxiety in adolescents: A self-report scale. Educational and Psychological Measurement, 57, 1035–1046. https://doi.org/10.1177/0013164497057006012
(1986). Response bias, social desirability and dissimulation. Personality and individual differences, 7, 385–400. https://doi.org/10.1016/0191-8869(86)90014-0
(1988). Correlates, causes, effects, and treatment of test anxiety. Review of Educational Research, 58, 47–77. https://doi.org/10.2307/1170348
(1990). The nature, effects, and relief of mathematics anxiety. Journal for Research in Mathematics Education, 21, 33–46. https://doi.org/10.2307/749455
(2004). Social desirability and self-reports: Testing models of socially desirable responding. Personality and Social Psychology Bulletin, 30, 161–172. https://doi.org/10.1177/0146167203259930
(2003). The Abbreviated Math Anxiety Scale (AMAS) construction, validity, and reliability. Assessment, 10, 178–182. https://doi.org/10.1177/1073191103252351
(2001). Measuring resiliency in youth: The resiliency attitudes and skills profile. Therapeutic Recreation Journal, 35, 333–347.
(2012). Pairwise likelihood estimation for factor analysis models with ordinal data. Computational Statistics & Data Analysis, 56, 4243–4258. https://doi.org/10.1016/j.csda.2012.04.010
(1999). Survey research. Annual Review of Psychology, 50, 537–567. https://doi.org/10.1146/annurev.psych.50.1.537
(2010). Priming competence diminishes the link between cognitive test anxiety and test performance: Implications for the interpretation of test scores. Psychological Science, 21, 811–819. https://doi.org/10.1177/0956797610369492
(2010). Reducing test anxiety among third-grade students through the implementation of relaxation techniques. Journal of School Counseling, 8, 1–19.
(2018). Factorial validity of the Anxiety Questionnaire for Students (AFS): Bifactor modeling and measurement invariance. Journal of Psychoeducational Assessment, 37, 770–781. https://doi.org/10.1177/0734282918794834
(2014). The Test Anxiety Measure for Adolescents (TAMA) examination of the reliability and validity of the scores of a new multidimensional measure of test anxiety for middle and high school students. Journal of Psychoeducational Assessment, 32, 404–416. https://doi.org/10.1177/0734282913520595
(2011). Examination of the psychometric properties of the Test Anxiety Scale for Elementary Students (TAS-E) scores. Journal of Psychoeducational Assessment, 29, 503–514. https://doi.org/10.1177/0734282910395894
(2008). The Test Anxiety Inventory for Children and Adolescents (TAICA) examination of the psychometric properties of a new multidimensional measure of test anxiety among elementary and secondary school students. Journal of Psychoeducational Assessment, 26, 215–230. https://doi.org/10.1177/0734282907303760
(2018). Anxiety profiles and protective factors: A latent profile analysis in children. Personality and Individual Differences, 124, 201–208. https://doi.org/10.1016/j.paid.2017.12.017
(2016). Anxiety and depression in children with nonverbal learning disabilities, reading disabilities, or typical development. Journal of Learning Disabilities, 49, 130–139. https://doi.org/10.1177/0022219414529336
(2006). Academic resilience and its psychological and educational correlates: A construct validity approach. Psychology in the Schools, 43, 267–281. https://doi.org/10.1002/pits.20149
(2001). The prevalence and effects of test anxiety in school children. Educational Psychology, 21, 89–101. https://doi.org/10.1080/01443410020019867
(2013). Anxiety disorders. European Child & Adolescent Psychiatry, 22, 17–22. https://doi.org/10.1007/s00787-012-0356-8
(2009). Internalizing correlates of dyslexia. World Journal of Pediatrics, 5, 255–264. https://doi.org/10.1007/s12519-009-0049-7
(2010). Mplus user’s guide (4th ed.). Los Angeles, CA: Muthén & Muthén.
(2011). Learning disabilities and anxiety: A meta-analysis. Journal of Learning Disabilities, 44, 3–17. https://doi.org/10.1177/0022219409359939
(2015). Cultural and gender differences in experiences and expression of test anxiety among Chinese, Finnish, and Swedish grade 3 pupils. International Journal of School & Educational Psychology, 3, 37–48. https://doi.org/10.1080/21683603.2014.915773
(2008). Deconstructing test anxiety. Emotional and Behavioural Difficulties, 13, 141–155. https://doi.org/10.1080/13632750802027713
(2013). Resilient children are less test anxious and perform better in tests at the end of primary schooling. Learning and Individual Differences, 28, 41–46. https://doi.org/10.1016/j.lindif.2013.09.010
(2017). R: A language and environment for statistical computing. Vienna, Austria: R Foundation for Statistical Computing. Retrieved from https://www.r-project.org/
. (2016). Self-perceived competence and test anxiety. Journal of Individual Differences, 37, 159–167. https://doi.org/10.1027/1614-0001/a000202
(2018).
(Bifactor modelling and the evaluation of scale scores . In P. IrwingT. BoothD. J. HughesEds., The Wiley handbook of psychometric testing: A multidisciplinary reference on survey, scale and test development (pp. 675–707). Hoboken, NJ: Wiley-Blackwell.2010). Bifactor models and rotations: Exploring the extent to which multidimensional data yield univocal scale scores. Journal of Personality Assessment, 92, 544–559. https://doi.org/10.1080/00223891.2010.496477
(2013). Multidimensionality and structural coefficient bias in structural equation modeling: A bifactor perspective. Educational and Psychological Measurement, 73, 5–26. https://doi.org/10.1177/0013164412449831
(2012). RCMAS-2 Revised Children’s Manifest Anxiety Scale (2nd ed.). Florence, Italy: Giunti O.S.
(2016). Applying bifactor statistical indices in the evaluation of psychological measures. Journal of Personality Assessment, 98, 223–237. https://doi.org/10.1080/00223891.2015.1089249
(2012). lavaan: An R package for structural equation modeling. Journal of Statistical Software, 48, 1–36. https://doi.org/10.1080/10705519909540118
(1960). Anxiety in elementary school children. New York, NY: Wiley.
(1952). Some correlates of test anxiety. The Journal of Abnormal and Social Psychology, 47, 810–817.
(2003). Evaluating the fit of structural equation models: Tests of significance and descriptive goodness-of-fit measures. Methods of Psychological Research Online, 8, 23–74.
(2013). Heightened test anxiety among young children: Elementary school students’ anxious responses to high-stakes testing. Psychology in the Schools, 50, 57–71. https://doi.org/10.1002/pits.21689
(2004). The utility of measures of child and adolescent anxiety: A meta-analytic review of the Revised Children’s Manifest Anxiety Scale, the State-Trait Anxiety Inventory for Children, and the Child Behavior Checklist. Journal of Clinical Child and Adolescent Psychology, 33, 557–565. https://doi.org/10.1207/s15374424jccp3303_13
(2018). Assessing anxiety disorders in children and adolescents. Child and Adolescent Mental Health, 23, 266–282. https://doi.org/10.1111/camh.12251
(2008). Faking it: Social desirability response bias in self-report research. Australian Journal of Advanced Nursing, 25, 40–48.
(2012). A checklist for testing measurement invariance. European Journal of Developmental Psychology, 9, 486–492. https://doi.org/10.1080/17405629.2012.686740
(2013). Test anxiety interventions for children and adolescents: A systematic review of treatment studies from 2000–2010. Psychology in the Schools, 50, 57–71. https://doi.org/10.1002/pits.21660
(2012). Test anxiety and high-stakes test performance between school settings: Implications for educators. Preventing School Failure: Alternative Education for Children and Youth, 56, 180–187. https://doi.org/10.1080/1045988X.2011.633285
(2018). Test anxiety effects, predictors, and correlates: A 30-year meta-analytic review. Journal of Affective Disorders, 227, 483–493. https://doi.org/10.1016/j.jad.2017.11.048
(2014). High-stakes accountability: Student anxiety and large-scale testing. Journal of Applied School Psychology, 30, 132–156. https://doi.org/10.1080/15377903.2014.888529
(2010). Test anxiety prevention and intervention programs in schools: Program development and rationale. School Mental Health, 2, 62–71. https://doi.org/10.1007/s12310-010-9032-7
(2005). Physiological response and childhood anxiety: Association with symptoms of anxiety disorders and cognitive bias. Journal of Clinical Child and Adolescent Psychology, 34, 712–723. https://doi.org/10.1207/s15374424jccp3404_13
(2004). Measuring test anxiety in children: Scale development and internal construct validation. Anxiety, Stress & Coping, 17, 227–240. https://doi.org/10.1080/10615800412331292606
(1998). Test anxiety: The state of the art. New York, NY: Plenum Press.
(