Abstract
The picture story exercise (PSE), in which participants write imaginative stories in response to motivationally-arousing images, is the most commonly-used tool for the assessment of implicit motives. Despite decades of research into the qualities of effective individual picture cues, much less is known about the desirable properties of overall picture sets. The present research highlights a previously undocumented methodological consideration—set ambiguity—which has important implications for the reliability and validity of the PSE. In a four-part study of 74 undergraduates, motive scores derived from an ambiguous picture set comprising cues that vary in motivational focus displayed greater test–retest reliability, convergent validity, and predictive validity than those derived from an unambiguous picture set. Researchers are therefore advised to consider set ambiguity when selecting images for use in PSE research.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Atkinson, J. W. (1958). Motives in fantasy, action, and society: A method of assessment and study. Oxford, UK: Van Nostrand.
Atkinson, J. W. (1992). Motivational determinants of thematic apperception. In C. P. Smith (Ed.), Motivation and personality: handbook of thematic content analysis (pp. 21–48). New York, NY: Cambridge University Press.
Atkinson, J. W., & Birch, D. (1970). The dynamics of action. Oxford, UK: Wiley.
Brunstein, J. C., & Schmitt, C. H. (2004). Assessing individual differences in achievement motivation with the Implicit Association Test. Journal of Research in Personality, 38(6), 536–555. doi:10.1016/j.jrp.2004.01.003.
de Charms, R., & Carpenter, V. (1968). Measuring motivation in culturally disadvantaged children. In H. Klausmeirer & G. O’Hearn (Eds.), Research and development toward the improvement of education. Madison, WI: Educational Research Services.
Eron, L. D. (1950). A normative study of the Thematic Apperception Test. Psychological Monographs: General and Applied, 64(9), 1–48. doi:10.1037/h0093627.
Eron, L. D. (1953). Responses of women to the Thematic Apperception Test. Journal of Consulting Psychology, 17(4), 269–282. doi:10.1037/h006282.
Grant, D. A., & Berg, E. (1948). A behavioral analysis of degree of reinforcement and ease of shifting to new responses in a Weigl-type card-sorting problem. Journal of Experimental Psychology, 38(4), 404. doi:10.1037/h0059831.
Haber, R. N., & Alpert, R. (1958). The role of situation and picture cues in projective measurement of the achievement motive. In J. W. Atkinson (Ed.), Motives in fantasy, action, and society (pp. 644–663). New York, NY: Van Nostrand.
Heckhausen, H. (1963). Hoffnung und furcht in der leistungsmotivation. Meisenheim, Germany: Anton Hain.
Heckhausen, H. (1968). Achievement motive research: Current problems and some contributions towards a general theory of motivation. In W. J. Arnold (Ed.), Nebraska symposium on motivation (Vol. 16). Lincoln, NE: University of Nebraska Press.
Heckhausen, H. (1980). Motivation und handeln. New York, NY: Springer.
Jackson, D. (1974). Personality research form manual. Goshen, NY: Research Psychologists Press.
Koestner, R., Weinberger, D. R., McClelland, D. C., & Healy, J. (1988). How motives and values interact with task and social incentives to affect performance. Unpublished manuscript, Department of Psychology, Boston University. Boston.
Lejuez, C., Aklin, W. M., Jones, H. A., Richards, J. B., Strong, D. R., Kahler, C. W., et al. (2003). The balloon analogue risk task (BART) differentiates smokers and nonsmokers. Experimental and Clinical Psychopharmacology, 11(1), 26. doi:10.1037/1064-1297.11.1.26.
Lejuez, C., Read, J. P., Kahler, C. W., Richards, J. B., Ramsey, S. E., Stuart, G. L., et al. (2002). Evaluation of a behavioral measure of risk taking: The Balloon Analogue Risk Task (BART). Journal of Experimental Psychology: Applied, 8(2), 75. doi:10.1037/1076-898X.8.2.75.
McAdams, D. P. (1980). A thematic coding system for the intimacy motive. Journal of Research in Personality, 14(4), 413–432.
McClelland, D. C. (1987). Human motivation. New York, NY: Cambridge University Press.
McClelland, D. C., Atkinson, J. W., Clark, R. A., & Lowell, E. L. (1953). The achievement motive. New York, NY: Appleton-Century-Crofts.
McClelland, D. C., Clark, R. A., Roby, T. B., & Atkinson, J. W. (1949). The projective expression of needs. IV: The effect of the need for achievement on thematic apperception. Journal of Experimental Psychology, 39, 242–255.
McClelland, D. C., Koestner, R., & Weinberger, J. (1989). How do self-attributed and implicit motives differ? Psychological Review, 96(4), 690–702. doi:10.1037/0033-295X.96.4.690.
McClelland, D. C., & Pilon, D. A. (1983). Sources of adult motives in patterns of parent behavior in early childhood. Journal of Personality and Social Psychology, 44(3), 564. doi:10.1037/0022-3514.44.3.564.
Morgan, C. D., & Murray, H. A. (1935). A method for examining fantasies: The Thematic Apperception Test. Archives of Neurology and Psychiatry, 34, 289–306.
Murray, H. A. (1938). Explorations in personality: A clinical and experimental study of fifty men of college age. New York, NY: Oxford University Press.
Murstein, B. I. (1965). Projection of hostility on the TAT as a function of stimulus, background, and personality variables. Journal of Consulting Psychology, 29(1), 43.
Pang, J. S. (2010a). Content coding methods in implicit motive assessment: Standards of measurement and best practices for the Picture Story Exercise. In O. Schultheiss & J. Brunstein (Eds.), Implicit motives (Vol. 1, pp. 119–151). New York, NY: Oxford University Press.
Pang, J. S. (2010b). The achievement motive: A review of theory and assessment of n achievement, hope of success, and fear of failure. In O. Schultheiss & J. Brunstein (Eds.), Implicit motives (Vol. 1, pp. 30–71). New York, NY: Oxford University Press.
Pang, J. S., & Schultheiss, O. C. (2005). Assessing implicit motives in US college students: Effects of picture type and position, gender and ethnicity, and cross-cultural comparisons. Journal of Personality Assessment, 85(3), 280–294.
Pang, J. S., Villacorta, M. A., Chin, Y. S., & Morrison, F. J. (2009). Achievement motivation in the social context: Implicit and explicit hope of success and fear of failure predict memory for and liking of successful and unsuccessful peers. Journal of Research in Personality, 43(6), 1040–1052.
Ramsay, J. E. (2011). Refining the picture story exercise: Towards a better understanding of hope, fear and the achievement motive. Unpublished manuscript, Nanyang Technological University, Division of Psychology, Singapore.
Reitman, W. R., & Atkinson, J. W. (1958). Some methodological problems in the use of thematic apperceptive measures of human motives. In J. W. Atkinson (Ed.), Motives in fantasy, action, and society (pp. 664–683). Princeton, NJ: Van Nostrand.
Schultheiss, O. (2001). Manual for the assessment of hope of success and fear of failure (English translation of Heckhausen’s need Achievement measure). Unpublished manuscript, University of Michigan. Ann Arbor, MI.
Schultheiss, O., & Brunstein, J. (2001). Assessment of implicit motives with a research version of the TAT: Picture profiles, gender differences, and relations to other personality measures. Journal of Personality Assessment, 77(1), 71–86. doi:10.1207/S15327752JPA7701_05.
Schultheiss, O. C., & Brunstein, J. C. (2005). An implicit motive perspective on competence. In A. J. Elliot & C. Dweck (Eds.), Handbook of competence and motivation (pp. 31–51). New York: Guilford.
Schultheiss, O., & Murray, T. (2002). Hope of success/fear of failure questionnaire. Unpublished manuscript, University of Michigan. Ann Arbor, MI.
Schultheiss, O., & Pang, J. (2007). Measuring implicit motives. In R. Robins, R. Fraley, & R. Krueger (Eds.), Handbook of research methods in personality psychology (pp. 322–344). New York: The Guildford Press.
Schultheiss, O. C., & Rohde, W. (2002). Implicit power motivation predicts men’s testosterone changes and implicit learning in a contest situation. Hormones and Behavior, 41(2), 195–202. doi:10.1006/hbeh.2001.1745.
Smith, C. P. (1992). Motivation and personality: Handbook of thematic content analysis. New York, NY: Cambridge University Press.
Smith, C. P., Feld, S., & Franz, C. (1992). Methodological considerations: Steps in research employing content analysis systems. In C. P. Smith (Ed.), Motivation and personality: Handbook of thematic content analysis (pp. 515–536). New York, NY: Cambridge University Press.
Thrash, T. M., Elliot, A. J., & Schultheiss, O. C. (2007). Methodological and dispositional predictors of congruence between implicit and explicit need for achievement. Personality and Social Psychology Bulletin, 33(7), 961–974. doi:10.1177/0146167207301018.
Veroff, J., Atkinson, J. W., Feld, S. C., & Gurin, G. (1960). The use of thematic apperception to assess motivation in a nationwide interview study. Psychological Monographs: General and Applied, 74(12), 1.
Winter, D. G. (1973). The power motive. New York, NY: The Free Press.
Winter, D. G. (1989). Technical note on measuring motivation. Unpublished manuscript, University of Michigan, Department of Psychology. Ann Arbor, MI.
Winter, D.G. (1994). Manual for scoring motive imagery in running text. Unpublished manuscript, University of Michigan, Department of Psychology. Ann Arbor, MI.
Author information
Authors and Affiliations
Corresponding author
Appendices
Appendix 1
Appendix 2
Rights and permissions
About this article
Cite this article
Ramsay, J.E., Pang, J.S. Set ambiguity: A key determinant of reliability and validity in the picture story exercise. Motiv Emot 37, 661–674 (2013). https://doi.org/10.1007/s11031-012-9339-9
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11031-012-9339-9