Skip to main content
Search
Search
    Quick Search anywhere
    Quick search in Citations
Advanced Search
Skip main navigationClose Drawer MenuOpen Drawer Menu
Previous article
Next article
Multistudy Report

The Development and Validation of a New Multidimensional Test Anxiety Scale (MTAS)

Published Online:September 07, 2020https://doi.org/10.1027/1015-5759/a000604

Abstract

Abstract. Although test anxiety has a long history in the educational and psychological literature there is a lack of census over its dimensionality. The aim of the present study was to clarify the dimensionality of test anxiety and develop a new instrument to reflect this dimensionality. Across two empirical studies we tested and refined a new multidimensional instrument comprising of two cognitive dimensions (Worry and Cognitive Interference) and two affective-physiological dimensions (Tension and Physiological Indicators). In both studies, four-correlated-factors and higher order models showed a good fit to the data. Test anxiety was positively related to an existing test anxiety measure (the Test Anxiety Inventory) and an elevated risk of mental health problems, and negatively related to school well-being and examination performance. This new instrument will prove a welcome addition for practitioners, to assist in the identification of highly test anxious students who may require support or intervention, and test anxiety researchers.

References

  • Benson, J., Moulin-Julian, M., Schwarzer, C., Seipp, B., & El-Zahhar, N. (1992). Cross validation of a revised test anxiety scale using multi-national samples. In K. A. HagvetT. B. JohnsenEds., Advances in test anxiety research (Vol. 7, pp. 62–83). Lisse, The Netherlands: Swets & Zeitlinger. First citation in articleGoogle Scholar

  • Bertrams, A., Englert, C., & Dickhäuser, O. (2010). Self-control strength in the relation between trait test anxiety and state anxiety. Journal of Research in Personality, 44, 738–741. https://doi.org/10.1016/j.jrp.2010.09.005 First citation in articleCrossref, Google Scholar

  • Blascovich, J., & Mendes, W. B. (2010). Social psychophysiology and embodiment. In S. T. FiskeD. T. GilbertEds., Handbook of social psychology (5th ed., pp. 194–227). New York, NY: Wiley. First citation in articleGoogle Scholar

  • Cassady, J. C., & Johnson, R. E. (2002). Cognitive test anxiety and academic performance. Contemporary Educational Psychology, 27, 270–295. https://doi.org/10.1006/ceps.2001.1094 First citation in articleCrossref, Google Scholar

  • Cole, D. A., Ciesla, J. A., & Steiger, J. H. (2007). The insidious effects of failing to include design-driven correlated residuals in latent-variable covariance structure analysis. Psychological Methods, 12, 381–398. https://doi.org/10.1037/1082-989X.12.4.381 First citation in articleCrossref, Google Scholar

  • Donolato, E., Marci, T., Altoè, G., & Mammarella, I. C. (2019). Measuring test anxiety in primary and middle school children. European Journal of Psychological Assessment. Advance online publication. https://doi.org/10.1027/1015–5759/a000556 First citation in articleLink, Google Scholar

  • Elliot, A. J., & Thrash, T. M. (2010). Approach and avoidance as basic dimensions of personality. Journal of Personality, 78, 865–906. https://doi.org/10.1111/j.1467-6494.2010.00636.x First citation in articleCrossref, Google Scholar

  • Endler, N. S., & Kocovski, N. L. (2001). State and trait anxiety revisited. Journal of Anxiety Disorders, 15, 231–245. https://doi.org/10.1016/S0887-6185(01)00060-3 First citation in articleCrossref, Google Scholar

  • Friedman, I. A., & Bendas-Jacob, O. (1997). Measuring perceived test anxiety in adolescents: A self-report scale. Educational and Psychological Measurement, 57, 1035–1046. https://doi.org/10.1177/0013164497057006012 First citation in articleCrossref, Google Scholar

  • Gill, P., & Remedios, R. (2013). How should researchers in Education operationalise on-task behaviours? Cambridge Journal of Education, 43, 199–222. https://doi.org/10.1080/0305764X.2013.767878 First citation in articleCrossref, Google Scholar

  • Hagtvet, K. A., & Benson, J. (1997). The motive to avoid failure and test anxiety responses: Empirical support for integration of two research traditions. Anxiety, Stress and Coping, 10, 35–37. https://doi.org/10.1080/10615809708249294 First citation in articleCrossref, Google Scholar

  • Haynes, S. N., Richard, D. C. S., & Kubany, E. S. (1995). Content validity in psychological assessment: A functional approach to concepts and methods. Psychological Assessment, 7, 238–247. https://doi.org/10.1037/1040-3590.7.3.238 First citation in articleCrossref, Google Scholar

  • Heeren, A., & McNally, R. J. (2018). Social anxiety disorder as a densely interconnected network of fear and avoidance for social situations. Cognitive Therapy and Research, 42, 101–113. https://doi.org/10.1007/s10608-017-9876-3 First citation in articleGoogle Scholar

  • Hembree, R. (1988). Correlates, causes, effects and treatment of test anxiety. Review of Educational Research, 58(1), 47–77. https://doi.org/10.3102/00346543058001047 First citation in articleCrossref, Google Scholar

  • Herzer, F., Wendt, J., & Hamm, A. O. (2014). Discriminating clinical from nonclinical manifestations of test anxiety: A validation study. Behavior Therapy, 45, 222–231. https://doi.org/10.1016/j.beth.2013.11.001 First citation in articleCrossref, Google Scholar

  • Hodapp, V. (1996). The TAI-G: A multidimensional approach to the assessment of test anxiety. In C. SchwarzerM. ZeidnerEds., Stress, anxiety and coping in academic settings (pp. 95–130). Tübingen, Germany/Basel, Switzerland: Francke. First citation in articleGoogle Scholar

  • Kelley, T. L. (1927). Interpretation of educational measurements. Oxford, UK: World Book. First citation in articleGoogle Scholar

  • Kessler, R. C., Berglund, P., Demler, O., Jin, R., Merikangas, K. R., & Walters, E. E. (2005). Lifetime prevalence and age-of-onset distributions of DSM-IV disorders in the National Comorbidity Survey Replication. Archive of General Psychiatry, 62, 184–189. https://doi.org/10.1001/archpsyc.62.6.593 First citation in articleGoogle Scholar

  • Kilgus, S. P., Eklund, K., von der Embse, N. P., Taylor, C., & Sims, W. A. (2016). Psychometric defensibility of the Social, Academic, and Emotional Behavior Risk Screener (SAEBRS) teacher rating scale and multiple gating procedure within elementary and middle school samples. Journal of School Psychology, 58, 21–39. https://doi.org/10.1016/j.jsp.2016.07.001 First citation in articleCrossref, Google Scholar

  • Lambie, G. W., Blount, A. J., & Mullen, P. R. (2017). Establishing content-oriented for psychological assessments. Measurement and Evaluation in Counseling & Development, 50, 210–216. https://doi.org/g/10.1080/07481756.2017.1336930 First citation in articleCrossref, Google Scholar

  • Landis, R. S., Edwards, B. D., & Cortina, J. M. (2009). On the practice of allowing correlated residuals among indicators in structural equation models. In C. E. LanceR. J. VandenbergEds., Statistical and methodological myths and urban legends: Doctrine, verity and fable in the organizational and social sciences (pp. 195–214). New York, NY: Routledge. First citation in articleGoogle Scholar

  • Liebert, R. M., & Morris, L. W. (1967). Cognitive and emotional components of test anxiety: A distinction and some initial data. Psychological Reports, 20, 975–978. https://doi.org/10.2466/pr0.1967.20.3.975 First citation in articleCrossref, Google Scholar

  • Loderer, K., Vogl, E., & Pekrun, R. (2016, August). Students’ well-being at school revisited: Development and initial validation of a unidimensional self-report scale. Paper presented at the International Conference on Motivation (ICM), Thessaloniki, Greece. First citation in articleGoogle Scholar

  • Lowe, P. A., Lee, S. W., Witteborg, K. M., Prichard, K. W., Luhr, M. E., Cullinan, C. M., … Janik, M. (2008). The Test Anxiety Inventory for Children and Adolescents (TAICA): Examination of the properties of a new multidimensional measure of test anxiety among elementary and secondary school students. Journal of Psychoeducational Assessment, 26, 215–230. https://doi.org/10.1177/0734282907303760 First citation in articleCrossref, Google Scholar

  • Mandler, G., & Sarason, S. B. (1952). A study of anxiety and learning. Journal of Abnormal and Social Psychology, 47, 166–173. https://doi.org/10.1037/h0062855 First citation in articleCrossref, Google Scholar

  • Marsh, H. W., Hau, K.-T., & Grayson, D. (2005). Goodness of fit evaluation in structural equation modelling. In A. Maydeu-OlivaresJ. McArdleEds., Contemporary psychometrics. A Festschrift for Roderick P. McDonald (pp. 275–340). Mahwah, NJ: Erlbaum. First citation in articleGoogle Scholar

  • Muthén, L. K., & Muthén, B. O. (2017). Mplus user’s guide (8th ed.). Los Angeles, CA: Muthén & Muthén. First citation in articleGoogle Scholar

  • O’Connor, B. P. (2000). SPSS and SAS programs for determining the number of components using parallel analysis and Velicer’s MAP test. Behavior Research Methods, Instrumentation, and Computers, 32, 396–402. https://doi.org/10.3758/BF03200807 First citation in articleCrossref, Google Scholar

  • Pekrun, R., Goetz, T., Perry, R. P., Kramer, K., & Hochstadt, M. (2004). Beyond test anxiety: Development and validation of the Test Emotions Questionnaire (TEQ). Anxiety, Stress and Coping, 17, 287–316. https://doi.org/10.1080/10615800412331303847 First citation in articleCrossref, Google Scholar

  • Putwain, D. W. (2009). Assessment and examination stress in Key Stage 4. British Educational Research Journal, 35, 391–411. https://doi.org/10.1080/01411920802044404 First citation in articleCrossref, Google Scholar

  • Putwain, D. W., & Daly, A. L. (2014). Test anxiety prevalence and gender differences in a sample of English secondary school students. Educational Studies, 40, 554–570. https://doi.org/10.1080/03055698.2014.953914 First citation in articleCrossref, Google Scholar

  • Putwain, D. W., Loderer, K., Gallard, D., & Beaumont, J. (2020). School-related subjective well-being promotes subsequent adaptability, achievement and positive behavioural conduct. British Journal of Educational Psychology, 90, 92–108. https://doi.org/10.1111/bjep.12266 First citation in articleCrossref, Google Scholar

  • Sarason, I. G. (1984). Stress, anxiety and cognitive interference: Reactions to tests. Journal of Personality and Social Psychology, 46, 929–938. https://doi.org/10.1037/0022-3514.46.4.929 First citation in articleCrossref, Google Scholar

  • Segool, N., von der Embse, N., Mata, A., & Gallant, J. (2014). Cognitive behavioral model of test anxiety in a high-stakes context: An exploratory study. School Mental Health, 6, 50–61. https://doi.org/10.1007/s12310-013-9111-7 First citation in articleCrossref, Google Scholar

  • Spielberger, C. D. (1980). Preliminary professional manual for the Test Anxiety Inventory. Palo Alto, CA: Consulting Psychologists Press. First citation in articleGoogle Scholar

  • Spielberger, C. D., & Vagg, R. P. (1995). Test anxiety: A transactional process model. In C. D. SpeilbergerP. R. VaggEds., Test anxiety: Theory, assessment and treatment (pp. 3–14). Bristol, UK: Taylor & Francis. First citation in articleGoogle Scholar

  • Szafranski, D. D., Barrera, T. L., & Norton, P. J. (2012). Test Anxiety Inventory: 30 years later. Anxiety, Stress & Coping, 25, 667–677. https://doi.org/10.1080/10615806.2012.663490 First citation in articleCrossref, Google Scholar

  • Thomas, C. L., Cassady, J. C., & Finch, W. H. (2018). Identifying severity standards on the Cognitive Test Anxiety Scale: Cut score determination using latent class and cluster analysis. Journal of Psychoeducational Assessment, 36, 492–508. https://doi.org/10.1177/0734282916686004 First citation in articleCrossref, Google Scholar

  • von der Embse, N., Barterian, J., & Segool, N. (2013). Test anxiety interventions for children and adolescents: A systematic review of treatment studies from 2000–2010. Psychology in the Schools, 50, 57–71. https://doi.org/10.1002/pits.21660 First citation in articleCrossref, Google Scholar

  • von der Embse, N. P., Iaccarino, S., Mankin, A., Kilgus, S. P., & Magen, E. (2017). Development and validation of the social, academic, and emotional behavior risk screener–student rating scale. Assessment for Effective Intervention, 42, 186–192. https://doi.org/10.1177/1534508416679410 First citation in articleCrossref, Google Scholar

  • von der Embse, N. P., Jester, D., Roy, D., & Post, J. (2018). Test anxiety effects, predictors, and correlates: A 30-year meta-analytic review. Journal of Affective Disorders, 227, 483–493. https://doi.org/10.1016/j.jad.2017.11.048 First citation in articleCrossref, Google Scholar

  • von der Embse, N. P., Kilgus, S. P., Iaccarino, S., & Levi-Nielsen, S. (2017). Screening for student mental health risk: Diagnostic accuracy, measurement invariance, and predictive validity of the Social, Academic, and Emotional Behavior Risk Screener-Student Rating Scale (SAEBRS-SRS). School Mental Health, 9, 273–283. https://doi.org/10.1007/s12310-017-9214-7 First citation in articleCrossref, Google Scholar

  • Warren, M. K., Ollendick, T. H., & King, N. J. (1996). Test anxiety in girls and boys: A clinical-developmental analysis. Behaviour Change, 13, 157–170. https://doi.org/10.1017/S0813483900004939 First citation in articleCrossref, Google Scholar

  • Wren, D., & Benson, J. (2004). Measuring test anxiety in children: Scale development and internal construct validation. Anxiety Stress & Coping, 17, 227–240. https://doi.org/10.1080/10615800412331292606 First citation in articleCrossref, Google Scholar

  • Zeidner, M., & Matthews, G. (2005). Evaluation anxiety. In A. J. ElliotC. S. DweckEds., Handbook of competence and motivation (pp. 141–163). London, UK: Guilford Press. First citation in articleGoogle Scholar