Skip to main content
Search
Search
    Quick Search anywhere
    Quick search in Citations
Advanced Search
Skip main navigationClose Drawer MenuOpen Drawer Menu
Previous article
Next article
Original Articles and Reviews

Pictorial Scales in Research and Practice

A Review

Published Online:September 30, 2020https://doi.org/10.1027/1016-9040/a000405

Abstract

Abstract. The present article is concerned with the theoretical foundations and practical aspects of developing pictorial scales. It aims to assess the potential of pictorial scales compared to verbal scales. The article provides a review of existing pictorial scales with a view to identifying suitable methodological approaches for developing such scales. The review showed that the development and especially validation of many pictorial scales did not follow a stringent methodological approach. A category system is proposed, which allows the classification of different types of pictorial scales. Finally, we present a first draft of a theoretical framework, which can provide guidance for the future development of pictorial scales. The present work carries the implication that a specific methodological approach is needed, which focuses more strongly on the particular needs of designing pictorial scales (e.g., testing the comprehensibility of pictures).

References

  • Aron, A., Aron, E. N., & Smollan, D. (1992). Inclusion of other in the self scale and the structure of interpersonal closeness. Journal of Personality and Social Psychology, 63(4), 596–612. https://doi.org/10.1037/0022-3514.63.4.596 First citation in articleCrossref, Google Scholar

  • Bago, J., Sanchez-Raya, J., Perez-Grueso, F. J. S., & Climent, J. M. (2010). The Trunk Appearance Perception Scale (TAPS): A new tool to evaluate subjective impression of trunk deformity in patients with idiopathic scoliosis. Scoliosis, 5, 6. https://doi.org/10.1186/1748-7161-5-6 First citation in articleCrossref, Google Scholar

  • Baumgartner, J., Frei, N., Kleinke, M., Sauer, J., & Sonderegger, A. (2019, May). Pictorial System Usability Scale (P-SUS): Developing an instrument for measuring perceived usability. Paper presented at the CHI Conference 2019, Glasgow, UK. First citation in articleGoogle Scholar

  • Baumgartner, J., Ruettgers, N., Hasler, A., Sonderegger, A., & Sauer, J. (2020). What you see is what you rate: Developing pictorial instruments for measuring perceived usability. Manuscript in preparation. First citation in articleGoogle Scholar

  • Baumgartner, J., Sonderegger, A., & Sauer, J. (2019). No need to read: Developing a pictorial single-item scale for measuring perceived usability. International Journal of Human-Computer Studies, 122, 78–89. https://doi.org/10.1016/j.ijhcs.2018.08.008 First citation in articleCrossref, Google Scholar

  • Baxter, A. L., Watcha, M. F., Baxter, W. V., Leong, T., & Wyatt, M. M. (2011). Development and validation of a pictorial nausea rating scale for children. Pediatrics, 127, e1542–e1549. https://doi.org/10.1542/peds.2010-1410 First citation in articleCrossref, Google Scholar

  • Beasley, J. M., Davis, A., & Riley, W. T. (2009). Evaluation of a web-based, pictorial diet history questionnaire. Public Health Nutrition, 12, 651–659. https://doi.org/10.1017/S1368980008002668 First citation in articleCrossref, Google Scholar

  • Bennett, K. B., & Walters, B. (2001). Configural display design techniques considered at multiple levels of evaluation. Human Factors, 43, 415–434. https://doi.org/10.1518/001872001775898304 First citation in articleCrossref, Google Scholar

  • Betella, A., & Verschure, P. F. M. J. (2016). The affective slider: A digital self-assessment scale for the measurement of human emotions. PLoS One, 11, e0148037. https://doi.org/10.1371/journal.pone.0148037 First citation in articleCrossref, Google Scholar

  • Bieri, D., Reeve, R. A., Champion, G. D., Addicoat, L., & Ziegler, J. B. (1990). The Faces Pain Scale for the self-assessment of the severity of pain experienced by children: Development, initial validation, and preliminary investigation for ratio scale properties. Pain, 41, 139–150. First citation in articleCrossref, Google Scholar

  • Boer, D., Hanke, K., & He, J. (2018). On detecting systematic measurement error in cross-cultural research: A review and critical reflection on equivalence and invariance tests. Journal of Cross-Cultural Psychology, 49, 713–734. https://doi.org/10.1177/002202211774904042 First citation in articleCrossref, Google Scholar

  • Bradley, M. M., & Lang, P. J. (1994). Measuring emotion: The self-assessment manikin and the semantic differential. Journal of Behavior Therapy and Experimental Psychiatry, 25, 49–59. https://doi.org/10.1016/0005-7916(94)90063-9 First citation in articleCrossref, Google Scholar

  • Broekens, J., & Brinkman, W.-P. (2013). AffectButton: A method for reliable and valid affective self-report. International Journal of Human-Computer Studies, 71, 641–667. https://doi.org/10.1016/j.ijhcs.2013.02.003 First citation in articleCrossref, Google Scholar

  • Brumfitt, S. M., & Sheeran, P. (1999). The development and validation of the Visual Analogue Self-Esteem Scale (VASES). The British Journal of Clinical Psychology, 38, 387–400. https://doi.org/10.1348/014466599162980 First citation in articleCrossref, Google Scholar

  • Buchanan, H., & Niven, N. (2002). Validation of a Facial Image Scale to assess child dental anxiety. International Journal of Paediatric Dentistry, 12, 47–52. https://doi.org/10.1046/j.0960-7439.2001.00322.x First citation in articleGoogle Scholar

  • Büchi, S., & Sensky, T. (1999). PRISM: Pictorial Representation of Illness and Self Measure. A brief nonverbal measure of illness impact and therapeutic aid in psychosomatic medicine. Psychosomatics, 40, 314–320. https://doi.org/10.1016/S0033-3182(99)71225-9 First citation in articleCrossref, Google Scholar

  • Cecil, C. A. M., McCrory, E. J., Viding, E., Holden, G. W., & Barker, E. D. (2016). Initial validation of a brief pictorial measure of caregiver aggression: The family aggression screening tool. Assessment, 23, 307–320. https://doi.org/10.1177/1073191115587552 First citation in articleCrossref, Google Scholar

  • Choi, B. C. K., & Pak, A. W. P. (2005). A catalog of biases in questionnaires. Preventing Chronic Disease, 2, 1–13. First citation in articleGoogle Scholar

  • Coolican, H. (2017). Research methods and statistics in psychology. London, UK: Hodder & Stoughton. First citation in articleCrossref, Google Scholar

  • Cowie, R., Douglas-Cowie, E., Savvidou, S., & McMahon, E. (2000, September). FEELTRACE: an instrument for recording perceived emotion in real time. Paper presented at Speech and Emotion: Proceedings of the ISCA Workshop, Newcastle, UK. First citation in articleGoogle Scholar

  • Desmet, P. (2003). Measuring emotion: Development and application of an instrument to measure emotional responses to products. In M. A. BlytheA. F. MonkK. OverbeekeP. C. WrightEds., Funology (pp. 111–123). Dordrecht, The Netherlands: Springer. https://doi.org/10.1007/1-4020-2967-5_12 First citation in articleGoogle Scholar

  • Desmet, P., Overbeeke, K., & Tax, S. (2001). Designing products with added emotional value: Development and application of an approach for research through design. The Design Journal, 4, 32–47. https://doi.org/10.2752/146069201789378496 First citation in articleCrossref, Google Scholar

  • Desmet, P., Vastenburg, M. H., & Romero, N. (2016). Mood measurement with Pick-A-Mood: Review of current methods and design of a pictorial self-report scale. Journal of Design Research, 14, 241–279. https://doi.org/10.1504/JDR.2016.10000563 First citation in articleCrossref, Google Scholar

  • Döring, A. K., Blauensteiner, A., Aryus, K., Drögekamp, L., & Bilsky, W. (2010). Assessing values at an early age: The picture-based value survey for children (PBVS-C). Journal of Personality Assessment, 92, 439–448. https://doi.org/10.1080/00223891.2010.497423 First citation in articleCrossref, Google Scholar

  • Dubi, K., & Schneider, S. (2009). The Picture Anxiety Test (PAT): A new pictorial assessment of anxiety symptoms in young children. Journal of Anxiety Disorders, 23, 1148–1157. https://doi.org/10.1016/j.janxdis.2009.07.020 First citation in articleCrossref, Google Scholar

  • Dunham, R. B., & Herman, J. B. (1975). Development of a female Faces Scale for measuring job satisfaction. Journal of Applied Psychology, 60(5), 629–631. https://doi.org/10.1037/0021-9010.60.5.629 First citation in articleCrossref, Google Scholar

  • Frank, A. J. M., Moll, J. M. H., & Hort, J. F. (1982). A comparison of three ways of measuring pain. Rheumatology, 21, 211–217. https://doi.org/10.1093/rheumatology/21.4.211 First citation in articleCrossref, Google Scholar

  • Fox, N. A., & Leavitt, L. A. (1995). The Violence Exposure Scale for Children (VEX). College Park, MD: University of Maryland. First citation in articleGoogle Scholar

  • Gardner, D. G., Cummings, L. L., Dunham, R. B., & Pierce, J. L. (1998). Single-item versus multiple-item measurement scales: An empirical comparison. Educational and Psychological Measurement, 58, 898–915. First citation in articleCrossref, Google Scholar

  • Ghiassi, R., Murphy, K., Cummin, A. R., & Partridge, M. R. (2011). Developing a pictorial Epworth Sleepiness Scale. Thorax, 66, 97–100. https://doi.org/10.1136/thx.2010.136879 First citation in articleCrossref, Google Scholar

  • Girard, S., & Johnson, H. (2009). Developing affective educational software products: Sorémo, a new method for capturing emotional states. Journal of Engineering Design, 20, 493–510. https://doi.org/10.1080/09544820903158827 First citation in articleCrossref, Google Scholar

  • Gueldner, S. H., Michel, Y., Bramlett, M. H., Liu, C.-F., Johnston, L. W., Endo, E., … Carlyle, M. S. (2005). The well-being picture scale: A revision of the index of field energy. Nursing Science Quarterly, 18, 42–50. https://doi.org/10.1177/0894318404272107 First citation in articleCrossref, Google Scholar

  • Haddad, S., King, S., Osmond, P., & Heidari, S. (2012, November). Questionnaire design to determine children’s thermal sensation, preference and acceptability in the classroom. In Proceedings of the 28th International PLEA Conference on Sustainable Architecture+ Urban Design: Opportunities, Limits and Needs-Towards an Environmentally Responsible Architecture, Lima, Peru. First citation in articleGoogle Scholar

  • Harter, S., & Pike, R. (1984). The pictorial scale of perceived competence and social acceptance for young children. Child Development, 55, 1969–1982. https://doi.org/10.2307/1129772 First citation in articleCrossref, Google Scholar

  • Hinkin, T. R. (1995). A review of scale development practices in the study of organizations. Journal of Management, 21, 967–988. https://doi.org/10.1177/014920639502100509 First citation in articleCrossref, Google Scholar

  • Hirschfeld, G., & Thielsch, M. T. (2015). Establishing meaningful cut points for online user ratings. Ergonomics, 58, 310–320. https://doi.org/10.1080/00140139.2014.965228 First citation in articleCrossref, Google Scholar

  • Hofstede, G. (1991). Cultures and Organizations: Software of the Mind. London, UK: McGraw. First citation in articleGoogle Scholar

  • Howard, M. C. (2018). Scale pretesting. Practical Assessment, Research & Evaluation, 23, 1–15. https://scholarworks.umass.edu/pare/vol23/iss1/5 First citation in articleGoogle Scholar

  • Huisman, G., Van Hout, M., van Dijk, E., Geest, T., & Heylen, D. (2013). LEMtool – Measuring emotions in visual interfaces. In Conference on Human Factors in Computing Systems – Proceedings (pp. 351–360). Paris, France. https://doi.org/10.1145/2470654.2470706 First citation in articleGoogle Scholar

  • Jäger, R. (2004). Konstruktion einer Ratingskala mit Smilies als symbolische Marken [Construction of a rating scale with smilies as symbolic labels]. Diagnostica, 50, 31–38. https://doi.org/10.1026/0012-1924.50.1.31 First citation in articleLink, Google Scholar

  • King, J. A., Solomon, P., & Ford, J. D. (2017). The Cameron Complex Trauma Interview (CCTI): Development, psychometric properties, and clinical utility. Psychological Trauma: Theory, Research, Practice, and Policy, 9(1), 18–22. https://doi.org/10.1037/tra0000138 First citation in articleCrossref, Google Scholar

  • Kunin, T. (1955). The construction of a new type of attitude measure. Personnel Psychology, 8, 65–77. https://doi.org/10.1111/j.1744-6570.1955.tb01189.x First citation in articleCrossref, Google Scholar

  • Lorish, C. D., & Maisiak, R. (1986). The Face Scale: A brief, nonverbal method for assessing patient mood. Arthritis and Rheumatism, 29, 906–909. First citation in articleCrossref, Google Scholar

  • Maćkiewicz, M., & Cieciuch, J. (2016). Pictorial Personality Traits Questionnaire for Children (PPTQ-C) – A new measure of children’s personality traits. Frontiers in Psychology, 7, 498. https://doi.org/10.3389/fpsyg.2016.00498 First citation in articleCrossref, Google Scholar

  • Maldonado, C. C., Bentley, A. J., & Mitchell, D. (2004). A pictorial sleepiness scale based on cartoon faces. Sleep, 27, 541–548. https://doi.org/10.1093/sleep/27.3.541 First citation in articleCrossref, Google Scholar

  • Manassis, K., Mendlowitz, S., Kreindler, D., Lumsden, C., Sharpe, J., Simon, M. D., … Adler-Nevo, G. (2009). Mood assessment via animated characters: A novel instrument to evaluate feelings in young children with anxiety disorders. Journal of Clinical Child & Adolescent Psychology, 38, 380–389. https://doi.org/10.1080/15374410902851655 First citation in articleCrossref, Google Scholar

  • McGrath, P. J., Pianosi, P. T., Unruh, A. M., & Buckley, C. P. (2005). Dalhousie dyspnea scales: Construct and content validity of pictorial scales for measuring dyspnea. BMC Pediatrics, 5, 33. https://doi.org/10.1186/1471-2431-5-33 First citation in articleCrossref, Google Scholar

  • McGrath, P. A., Seifert, C. E., Speechley, K. N., Booth, J. C., Stitt, L., & Gibson, M. C. (1996). A new analogue scale for assessing children’s pain: An initial validation study. Pain, 64, 435–443. First citation in articleCrossref, Google Scholar

  • Müller, C. (2014). Ring-gestures across cultures and times: Dimensions of variation. In C. MüllerA. CienkiE. FrickeS. H. LadewigD. McNeillJ. BressemEds., Body–language–communication: An international handbook on multimodality in human interaction (Vol. 2, pp. 1511–1522). New York, NY: De Gruyter Mouton. First citation in articleGoogle Scholar

  • Muris, P., Meesters, C., Mayer, B., Bogie, N., Luijten, M., Geebelen, E., … Smit, C. (2003). The Koala Fear Questionnaire: A standardized self-report scale for assessing fears and fearfulness in pre-school and primary school children. Behaviour Research and Therapy, 41, 597–617. https://doi.org/10.1016/S0005-7967(02)00098-0 First citation in articleCrossref, Google Scholar

  • Neugebauer, R., Wasserman, G. A., Fisher, P. W., Kline, J., Geller, P. A., & Miller, L. S. (1999). Darryl, a cartoon-based measure of cardinal posttraumatic stress symptoms in school-age children. American Journal of Public Health, 89(5), 758–761. https://doi.org/10.2105/AJPH.89.5.758 First citation in articleCrossref, Google Scholar

  • Nielsen, J. (1994). Estimating the number of subjects needed for a thinking aloud test. International Journal of Human-Computer Studies, 41, 385–397. First citation in articleCrossref, Google Scholar

  • Okoli, C., & Pawlowski, S. D. (2004). The Delphi method as a research tool: An example, design considerations and applications. Information & Management, 42, 15–29. https://doi.org/10.1016/j.im.2003.11.002 First citation in articleCrossref, Google Scholar

  • Paunonen, S. V., Ashton, M. C., & Jackson, D. N. (2001). Nonverbal assessment of the Big Five personality factors. European Journal of Personality, 15, 3–18. https://doi.org/10.1002/per.385 First citation in articleCrossref, Google Scholar

  • Paunonen, S. V., Jackson, D. N., & Keinonen, M. (1990). The Structured nonverbal assessment of personality. Journal of Personality, 58, 481–502. https://doi.org/10.1111/j.1467-6494.1990.tb00239.x First citation in articleCrossref, Google Scholar

  • Read, J. (2008). Validating the Fun Toolkit: An instrument for measuring children’s opinions of technology. Cognition, Technology & Work, 10, 119–128. https://doi.org/10.1007/s10111-007-0069-9 First citation in articleCrossref, Google Scholar

  • Rebok, G., Riley, A., Forrest, C., Starfield, B., Green, B., Robertson, J., & Tambor, E. (2001). Elementary school-aged children’s reports of their health: A cognitive interviewing study. Quality of Life Research, 10(1), 59–70. First citation in articleCrossref, Google Scholar

  • Reynolds-Keefer, L., & Johnson, R. (2011). Is a picture is worth a thousand words? Creating effective questionnaires with pictures. Practical Assessment, Research and Evaluation, 16, 1–7. https://doi.org/10.7275/bgpe-a067 First citation in articleGoogle Scholar

  • Richters, J. E., Martinez, P., & Valla, J. P. (1990). Levonn: A cartoon-based structured interview for assessing young children’s distress symptoms. Washington, DC: National Institute of Mental Health. First citation in articleGoogle Scholar

  • Russell, J. A., Weiss, A., & Mendelsohn, G. A. (1989). Affect Grid: A single-item scale of pleasure and arousal. Journal of Personality and Social Psychology, 57, 493–502. https://doi.org/10.1037/0022-3514.57.3.493 First citation in articleCrossref, Google Scholar

  • Sánchez, J. A., Hernández, N. P., Penagos, J. C., & Ostróvskaya, Y. (2006). Conveying mood and emotion in instant messaging by using a two-dimensional model for affective states. In R. O. PratesEd., Proceedings of VII Brazilian Symposium on Human Factors in Computing Systems (pp. 66–72). New York, NY: ACM. https://doi.org/10.1145/1298023.1298033 First citation in articleGoogle Scholar

  • Sanders, J. O., Harrast, J. J., Kuklo, T. R., Polly, D. W., Bridwell, K. H., Diab, M., Dormans, J. P., Drummond, D. S., Emans, J. B., Johnston, C. E. 2nd, Lenke, L. E., McCarthy, R. E., Newton, P. O., Richards, B. S., Sucato, D. J., & Spinal Deformity Study Group. (2007). The Spinal Appearance Questionnaire: Results of reliability, validity, and responsiveness testing in patients with idiopathic scoliosis. Spine, 32(24), 2719–2722. https://doi.org/10.1097/BRS.0b013e31815a5959 First citation in articleCrossref, Google Scholar

  • Schmidt, F. L., & Hunter, J. E. (1996). Measurement error in psychological research: Lessons from 26 research scenarios. Psychological Methods, 1, 199–223. https://doi.org/10.1037/1082-989X.1.2.199 First citation in articleCrossref, Google Scholar

  • Schneider, E. F., Lang, A., Shin, M., & Bradley, S. D. (2004). Death with a story: How story impacts emotional, motivational, and physiological responses to first-person shooter video games. Human Communication Research, 30(3), 361–375. First citation in articleGoogle Scholar

  • Schubert, T. W., & Otten, S. (2002). Overlap of self, ingroup, and outgroup: Pictorial measures of self-categorization. Self and Identity, 1, 353–376. https://doi.org/10.1080/152988602760328012 First citation in articleCrossref, Google Scholar

  • Sonderegger, A., Heyden, K., Chavaillaz, A., & Sauer, J. (2016). AniSAM & AniAvatar: Animated Visualizations of Affective States. In ACMEd., Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (pp. 4828–4837). New York, NY: ACM. https://doi.org/10.1145/2858036.2858365 First citation in articleGoogle Scholar

  • Stern, R. A., Arruda, J. E., Hooper, C. R., Wolfner, G. D., & Morey, C. E. (1997). Visual analogue mood scales to measure internal mood state in neurologically impaired patients: Description and initial validity evidence. Aphasiology, 11, 59–71. https://doi.org/10.1080/02687039708248455 First citation in articleCrossref, Google Scholar

  • Truby, H., & Paxton, S. J. (2002). Development of the Children’s Body Image Scale. British Journal of Clinical Psychology, 41, 185–203. https://doi.org/10.1348/014466502163967 First citation in articleCrossref, Google Scholar

  • Urist, J. (1977). The Rorschach test and the assessment of object relations. Journal of Personality Assessment, 41, 3–9. First citation in articleCrossref, Google Scholar

  • Valla, J.-P., Bergeron, L., Bérubé, H., Gaudet, N., & St-Georges, M. (1994). A structured pictorial questionnaire to assess DSM-III-R-based diagnoses in children (6–11 years): Development, validity, and reliability. Journal of Abnormal Child Psychology, 22, 403–423. https://doi.org/10.1007/BF02168082 First citation in articleCrossref, Google Scholar

  • Valla, J. P., Bergeron, L., & Smolla, N. (2000). The Dominic-R: a pictorial interview for 6-to 11-year-old children. Journal of the American Academy of Child & Adolescent Psychiatry, 39, 85–93. First citation in articleCrossref, Google Scholar

  • Valentini, N. C., Barnett, L. M., Bandeira, P. F. R., Nobre, G. C., Zanella, L. W., & Sartori, R. F. (2018). The pictorial scale of perceived movement skill competence: Determining content and construct validity for Brazilian children. Journal of Motor Learning and Development, 6(s2), S189–S204. https://doi.org/10.1123/jmld.2016-0043 First citation in articleCrossref, Google Scholar

  • van Bakel, H. J., Maas, A. J. B., Vreeswijk, C. M., & Vingerhoets, A. J. (2013). Pictorial representation of attachment: Measuring the parent-fetus relationship in expectant mothers and fathers. BMC Pregnancy and Childbirth, 13, 138. https://doi.org/10.1186/1471-2393-13-138 First citation in articleCrossref, Google Scholar

  • Venham, L. L., & Gaulin-Kremer, E. (1979). A self-report measure of situational anxiety for young children. Pediatric Dentistry, 1, 91–96. First citation in articleGoogle Scholar

  • Venkatraman, N., & Grant, J. H. (1986). Construct measurement in organizational strategy research: A critique and proposal. Academy of Management Review, 11, 71–87. First citation in articleCrossref, Google Scholar

  • Weibel, D., Schmutz, J., Pahud, O., & Wissmath, B. (2015). Measuring spatial presence: Introducing and validating the pictorial presence SAM. Presence: Teleoperators and Virtual Environments, 24, 44–61. https://doi.org/10.1162/PRES_a_00214 First citation in articleCrossref, Google Scholar

  • Wissmath, B., Weibel, D., & Mast, F. W. (2010). Measuring presence with verbal versus pictorial scales: a comparison between online-and ex post-ratings. Virtual Reality, 14, 43–53. First citation in articleCrossref, Google Scholar