Skip to main content
Search
Search
    Quick Search anywhere
    Quick search in Citations
Advanced Search
Skip main navigationClose Drawer MenuOpen Drawer Menu
Previous article
Next article
Original Article

Situational Judgment Tests as an Alternative Measure for Personality Assessment

Published Online:August 03, 2016https://doi.org/10.1027/1015-5759/a000346

Abstract

Abstract. Across many domains of applied psychology, personality traits are related to important outcomes such as well-being, psychological disorders, work performance, and academic achievement. However, self-reports, the most common approach to personality assessment, have certain limitations and disadvantages, such as being prone to faking. We investigated whether situational judgment tests, an established assessment technique to predict job performance, might serve as an alternative measure for the assessment of personality. Our results show that a situational judgment test specifically developed to assess narrow personality traits may possess high levels of construct validity. Additionally, our results indicate that the situational judgment was equivalent to a self-report personality measure with regard to predicting a number of theoretically related criteria. We conclude that situational judgment tests may serve as an alternative method for the assessment of personality and discuss potential theoretical and applied drawbacks.

References

  • Alarcon, G., Eschleman, K. J. & Bowling, N. A. (2009). Relationships between personality variables and burnout: A meta-analysis. Work & Stress, 23, 244–263. doi: 10.1080/02678370903282600 First citation in articleCrossref, Google Scholar

  • Allport, G. W. (1937). Personality: A psychological interpretation. New York, NY: Holt, Rinehart, & Winston. First citation in articleGoogle Scholar

  • Barrick, M. R., Mount, M. K. & Judge, T. A. (2001). Personality and performance at the beginning of the new millennium: What do we know and where do we go next? International Journal of Selection and Assessment, 9, 9–30. doi: 10.1111/1468-2389.00160 First citation in articleCrossref, Google Scholar

  • Borkenau, P. & Ostendorf, F. (1993). NEO-Fünf-Faktoren-Inventar (NEO-FFI) nach Costa und McCrae. Handanweisung [NEO Five Factor Inventory NEO-FFI]. Göttingen, Germany: Hogrefe. First citation in articleGoogle Scholar

  • Campion, M. A. & Ployhart, R. E. (2013). Assessing personality with situational judgment measures: Interactionist psychology operationalized. In N. D. ChristiansenR. P. TettEds., Handbook of personality at work (pp. 439–456). New York, NY: Routledge. First citation in articleGoogle Scholar

  • Campion, M. C., Ployhart, R. E. & MacKenzie, W. I. Jr. (2014). The state of research on situational judgment tests: A content analysis and directions for future research. Human Performance, 27, 283–310. doi: 10.1080/08959285.2014.929693 First citation in articleCrossref, Google Scholar

  • Christian, M. S., Edwards, B. D. & Bradley, J. C. (2010). Situational judgment tests: Constructs assessed and a meta-analysis of their criterion-related validities. Personnel Psychology, 63, 83–117. doi: 10.1111/j.1744-6570.2009.01163.x First citation in articleCrossref, Google Scholar

  • Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Erlbaum. First citation in articleGoogle Scholar

  • Connelly, B. S. & Ones, D. S. (2010). An other perspective on personality: Meta-analytic integration of observers’ accuracy and predictive validity. Psychological Bulletin, 136, 1092–1122. doi: 10.1037/a0021212 First citation in articleCrossref, Google Scholar

  • Connolly, J. J., Kavanagh, E. J. & Viswesvaran, C. (2007). The convergent validity between self and observer ratings of personality: A meta-analytic review. International Journal of Selection and Assessment, 15, 110–117. doi: 10.1111/j.1468-2389.2007.00371.x First citation in articleCrossref, Google Scholar

  • Cronbach, L. J. (1970). Essentials of psychological testing. New York, NY: Harper & Row. First citation in articleGoogle Scholar

  • DeNeve, K. M. & Cooper, H. (1998). The happy personality: A meta-analysis of 137 personality traits and subjective well-being. Psychological Bulletin, 124, 197–229. doi: 10.1037/0033-2909.124.2.197 First citation in articleCrossref, Google Scholar

  • Ekehammar, B. (1974). Interactionism in personality from a historical perspective. Psychological Bulletin, 81, 1026–1048. doi: 10.1037/h0037457 First citation in articleCrossref, Google Scholar

  • Görlich, Y. & Schuler, H. (2007). Azubi-TH. Arbeitsprobe zur berufsbezogenen Intelligenz [Azubi-TH. Work sample for measuring occupational intelligence]. Göttingen, Germany: Hogrefe. First citation in articleGoogle Scholar

  • Griffith, R. L. & Robie, C. (2013). Personality testing and the “F-Word”: Revisiting seven questions about faking. In N. D. ChristiansenR. P. TettEds., Handbook of personality at work (pp. 251–280). New York, NY: Routledge. First citation in articleGoogle Scholar

  • Hooper, A. C., Cullen, M. J. & Sackett, P. R. (2006). Operational threats to the use of SJTs: Faking, coaching and retesting Issues. In J. A. WeekleyR. E. PloyhartEds., Situational judgment tests. Theory, measurement, and application (pp. 205–232). Mahwah, NJ: Erlbaum. First citation in articleGoogle Scholar

  • Hunter, J. E. & Schmidt, F. L. (2004). Methods of meta-analysis: Correcting error and bias in research findings. Newbury Park, CA: Sage. First citation in articleCrossref, Google Scholar

  • Kotov, R., Gamez, W., Schmidt, F. & Watson, D. (2010). Linking “big” personality traits to anxiety, depressive, and substance use disorders: A meta-analysis. Psychological Bulletin, 136, 768–821. doi: 10.1037/a0020327 First citation in articleCrossref, Google Scholar

  • Krumm, S., Lievens, F., Hüffmeier, J., Lipnevich, A. A., Bendels, H. & Hertel, G. (2015). How “situational” is judgment in situational judgment tests? Journal of Applied Psychology, 100(2), 399–416. doi: 10.1037/a0037674 First citation in articleCrossref, Google Scholar

  • Marsh, H. W. (1989). Confirmatory factor analyses of multitrait-multimethod data: Many problems and a few solutions. Applied Psychological Measurement, 13, 335–361. doi: 10.1177/014662168901300402 First citation in articleCrossref, Google Scholar

  • McAbee, S. T. & Oswald, F. L. (2013). The criterion-related validity of personality measures for predicting GPA: A meta-analytic validity competition. Psychological Assessment, 25, 532–544. doi: 10.1037/a0031748 First citation in articleCrossref, Google Scholar

  • McDaniel, M. A., Hartman, N. S., Whetzel, D. L. & Grubb, W. L. (2007). Situational judgment tests, response instructions, and validity: A meta-analysis. Personnel Psychology, 60, 63–91. doi: 10.1111/j.1744-6570.2007.00065.x First citation in articleCrossref, Google Scholar

  • Mussel, P. (2013a). Intellect: A theoretical framework for personality traits related to intellectual achievements. Journal of Personality and Social Psychology, 104, 885–906. doi: 10.1037/a0031918 First citation in articleCrossref, Google Scholar

  • Mussel, P. (2013b). Introducing the construct curiosity for predicting job performance. Journal of Organizational Behavior, 34, 453–472. doi: 10.1002/job.1809 First citation in articleCrossref, Google Scholar

  • Mussel, P. & Spengler, M. (2015). Investigating intellect from a trait activation perspective: Identification of situational moderators for the correlation with work-related criteria. Journal of Research in Personality, 55, 51–60. First citation in articleCrossref, Google Scholar

  • Motowidlo, S. J., Hooper, A. C. & Jackson, H. L. (2006). Implicit policies about relations between personality traits and behavioral effectiveness in situational judgment items. Journal of Applied Psychology, 91, 749–761. doi: 10.1037/0021-9010.91.4.749 First citation in articleCrossref, Google Scholar

  • Ortner, T. M. & Schmitt, M. (2014). Advances and continuing challenges in objective personality testing. European Journal of Psychological Assessment, 30, 163–168. doi: 10.1027/1015-5759/a000213 First citation in articleLink, Google Scholar

  • Paulhus, D. L. & Vazire, S. (2007). The self-report method. In R. W. RobinsR. C. FraleyR. F. KruegerEds., Handbook of research methods in personality psychology (pp. 224–239). New York, NY: Guilford Press. First citation in articleGoogle Scholar

  • Schmitt, N. & Chan, D. (2006). Situational judgment tests: Method or construct? In J. A. WeekleyR. E. PloyhartEds., Situational judgment tests. Theory, measurement, and application (pp. 135–155). Mahwah, NJ: Erlbaum. First citation in articleGoogle Scholar

  • Schweizer, K. (2010). Some guidelines concerning the modeling of traits and abilities in test construction. European Journal of Psychological Assessment, 26, 1–2. First citation in articleLink, Google Scholar

  • Vedel, A. (2014). The Big Five and tertiary academic performance: A systematic review and meta-analysis. Personality and Individual Differences, 71, 66–76. doi: 10.1016/j.paid.2014.07.011 First citation in articleCrossref, Google Scholar

  • von Stumm, S., Hell, B. & Chamorro-Premuzic, T. (2011). Curiosity predicts academic performance. The hungry mind: Intellectual curiosity as third pillar of academic performance. Perspectives on Psychological Science, 6, 574–588. doi: 10.1177/1745691611421204 First citation in articleCrossref, Google Scholar

  • Watson, D. & Clark, L. A. (1994). The PANAS-X: Manual for the Positive Affect and Negative Affect Schedule – Expanded Form. Cedar Rapids, IA: University of Iowa. First citation in articleGoogle Scholar

  • Watson, D., Clark, L. A. & Tellegen, A. (1988). Development and validation of brief measures of positive and negative affect: The PANAS scales. Journal of Personality and Social Psychology, 54, 1063–1070. doi: 10.1037/0022-3514.54.6.1063 First citation in articleCrossref, Google Scholar

  • Weekley, J. A., Ployhart, R. E. & Holtz, B. C. (2006). On the development of situational judgment tests: Issues in item development, scaling, and scoring. In J. A. WeekleyR. E. PloyhartEds., Situational judgment tests. Theory, measurement, and application (pp. 157–182). Mahwah, NJ: Erlbaum. First citation in articleGoogle Scholar

  • Whetzel, D. L. & McDaniel, M. A. (2009). Situational judgment tests: An overview of current research. Human Resource Management Review, 19, 188–202. doi: 10.1016/j.hrmr.2009.03.007 First citation in articleCrossref, Google Scholar

  • Whetzel, D. L., McDaniel, M. A. & Nguyen, N. T. (2008). Subgroup differences in situational judgment test performance: A meta-analysis. Human Performance, 21, 291–309. doi: 10.1080/08959280802137820 First citation in articleCrossref, Google Scholar

  • Ziegler, M., Schmukle, S., Egloff, B. & Bühner, M. (2010). Investigating measures of achievement motivation(s). Journal of Individual Differences, 31, 15–21. doi: 10.1027/1614-0001/a000002 First citation in articleLink, Google Scholar