Skip to main content
Top
Gepubliceerd in: Psychological Research 7/2022

14-06-2021 | Original Article

An evaluation of the reading the mind in the eyes test's psychometric properties and scores in South Africa—cultural implications

Auteurs: Jason Gary Van Staden, Christian William Callaghan

Gepubliceerd in: Psychological Research | Uitgave 7/2022

Log in om toegang te krijgen
share
DELEN

Deel dit onderdeel of sectie (kopieer de link)

  • Optie A:
    Klik op de rechtermuisknop op de link en selecteer de optie “linkadres kopiëren”
  • Optie B:
    Deel de link per e-mail

Abstract

The ‘Reading the Mind in the Eyes’ test (RMET) has been translated and tested in many cultural settings. Results indicate that items show variability in meeting the original psychometric testing criteria. Individuals from non-Western cultures score differently on the RMET. As such, questions arise as to the cross-cultural validity of the RMET. This study tested the English version of the RMET, that consists almost exclusively of White faces, at a large South African university to determine its validity in a culturally diverse context. A total of 443 students from a range of different demographic backgrounds completed the instrument. Students were selected using simple random sampling. 30 out of the 36 items continued to show satisfactory psychometric properties. Further evidence shows significant differences based on race and home language in both overall scores and item level scores. Black race and African home language respondents show lower RMET scores and different item level perspectives on certain mental states. The current RMET is not inclusive. It requires stimuli reflecting more races and cultures. This lack of diversity is likely to be influencing and biasing results and psychometric properties. The continued exclusion of racial stimuli such as Black race is also promoting a systemic discriminatory instrument. These results have cultural implications for how we interpret and use the RMET.
Bijlagen
Alleen toegankelijk voor geautoriseerde gebruikers
Literatuur
go back to reference Adams, R. B., Jr., Rule, N. O., Franklin, R. G., Jr., Wang, E., Stevenson, M. T., Yoshikawa, S., & Ambady, N. (2010). Cross-cultural reading the mind in the eyes: An fMRI investigation. Journal of Cognitive Neuroscience, 22(1), 97–108.CrossRef Adams, R. B., Jr., Rule, N. O., Franklin, R. G., Jr., Wang, E., Stevenson, M. T., Yoshikawa, S., & Ambady, N. (2010). Cross-cultural reading the mind in the eyes: An fMRI investigation. Journal of Cognitive Neuroscience, 22(1), 97–108.CrossRef
go back to reference Baron-Cohen, S. (1996). Reading the mind in the face: A cross-cultural and developmental study. Visual Cognition, 3(1), 39–60.CrossRef Baron-Cohen, S. (1996). Reading the mind in the face: A cross-cultural and developmental study. Visual Cognition, 3(1), 39–60.CrossRef
go back to reference Baron-Cohen, S., Jolliffe, T., Mortimore, C., & Robertson, M. (1997a). Another advanced test of theory of mind: Evidence from very high functioning adults with autism or Asperger syndrome. Journal of Child Psychology and Psychiatry, 38(7), 813–822.CrossRef Baron-Cohen, S., Jolliffe, T., Mortimore, C., & Robertson, M. (1997a). Another advanced test of theory of mind: Evidence from very high functioning adults with autism or Asperger syndrome. Journal of Child Psychology and Psychiatry, 38(7), 813–822.CrossRef
go back to reference Baron-Cohen, S., Wheelwright, S., & Jolliffe, A. T. (1997b). Is there a" language of the eyes"? Evidence from normal adults, and adults with autism or Asperger syndrome. Visual Cognition, 4(3), 311–331.CrossRef Baron-Cohen, S., Wheelwright, S., & Jolliffe, A. T. (1997b). Is there a" language of the eyes"? Evidence from normal adults, and adults with autism or Asperger syndrome. Visual Cognition, 4(3), 311–331.CrossRef
go back to reference Baron-Cohen, S., Wheelwright, S., Hill, J., Raste, Y., & Plumb, I. (2001). The “Reading the Mind in the Eyes” test revised version: A study with normal adults, and adults with Asperger syndrome or high-functioning autism. Journal of Child Psychology and Psychiatry, 42(2), 241–251.CrossRef Baron-Cohen, S., Wheelwright, S., Hill, J., Raste, Y., & Plumb, I. (2001). The “Reading the Mind in the Eyes” test revised version: A study with normal adults, and adults with Asperger syndrome or high-functioning autism. Journal of Child Psychology and Psychiatry, 42(2), 241–251.CrossRef
go back to reference Cordaro, D. T., Sun, R., Kamble, S., Hodder, N., Monroy, M., Cowen, A., Bai, Y., & Keltner, D. (2020). The recognition of 18 facial-bodily expressions across nine cultures. Emotion, 20(7), 1292–1300.CrossRef Cordaro, D. T., Sun, R., Kamble, S., Hodder, N., Monroy, M., Cowen, A., Bai, Y., & Keltner, D. (2020). The recognition of 18 facial-bodily expressions across nine cultures. Emotion, 20(7), 1292–1300.CrossRef
go back to reference Cowen, A. S., Keltner, D., Schroff, F., Jou, B., Adam, H., & Prasad, G. (2020). Sixteen facial expressions occur in similar contexts worldwide. Nature, 589, 251–257.CrossRef Cowen, A. S., Keltner, D., Schroff, F., Jou, B., Adam, H., & Prasad, G. (2020). Sixteen facial expressions occur in similar contexts worldwide. Nature, 589, 251–257.CrossRef
go back to reference Dodell-Feder, D., Ressler, K. J., & Germine, L. T. (2020). Social cognition or social class and culture? On the interpretation of differences in social cognitive performance. Psychological Medicine, 50(1), 133–145.CrossRef Dodell-Feder, D., Ressler, K. J., & Germine, L. T. (2020). Social cognition or social class and culture? On the interpretation of differences in social cognitive performance. Psychological Medicine, 50(1), 133–145.CrossRef
go back to reference Ekman, P., Sorenson, E. R., & Friesen, W. V. (1969). Pan-cultural elements in facial displays of emotion. Science, 164(3875), 86–88.CrossRef Ekman, P., Sorenson, E. R., & Friesen, W. V. (1969). Pan-cultural elements in facial displays of emotion. Science, 164(3875), 86–88.CrossRef
go back to reference Fernández-Abascal, E. G., Cabello, R., Fernández-Berrocal, P., & Baron-Cohen, S. (2013). Test-retest reliability of the ‘Reading the Mind in the Eyes’ test: A one-year follow-up study. Molecular Autism, 4(1), 33.CrossRef Fernández-Abascal, E. G., Cabello, R., Fernández-Berrocal, P., & Baron-Cohen, S. (2013). Test-retest reliability of the ‘Reading the Mind in the Eyes’ test: A one-year follow-up study. Molecular Autism, 4(1), 33.CrossRef
go back to reference Fischer, R., & Karl, J. A. (2019). A primer to (cross-cultural) multi-group invariance testing possibilities in R. Frontiers in Psychology, 10, 1507.CrossRef Fischer, R., & Karl, J. A. (2019). A primer to (cross-cultural) multi-group invariance testing possibilities in R. Frontiers in Psychology, 10, 1507.CrossRef
go back to reference Franklin, R. G., Stevenson, M. T., Ambady, N., & Adams, R. B. (2015). Cross-cultural reading the mind in the eyes and its consequences for international relations. In J. E. Warnick & D. Landis (Eds.), Neuroscience in intercultural contexts (pp. 117–141). New York: Springer.CrossRef Franklin, R. G., Stevenson, M. T., Ambady, N., & Adams, R. B. (2015). Cross-cultural reading the mind in the eyes and its consequences for international relations. In J. E. Warnick & D. Landis (Eds.), Neuroscience in intercultural contexts (pp. 117–141). New York: Springer.CrossRef
go back to reference Golby, A. J., Gabrieli, J. D., Chiao, J. Y., & Eberhardt, J. L. (2001). Differential responses in the fusiform region to same-race and other-race faces. Nature Neuroscience, 4(8), 845–850.CrossRef Golby, A. J., Gabrieli, J. D., Chiao, J. Y., & Eberhardt, J. L. (2001). Differential responses in the fusiform region to same-race and other-race faces. Nature Neuroscience, 4(8), 845–850.CrossRef
go back to reference Hancock, K. J., & Rhodes, G. (2008). Contact, configural coding and the other-race effect in face recognition. British Journal of Psychology, 99(1), 45–56.CrossRef Hancock, K. J., & Rhodes, G. (2008). Contact, configural coding and the other-race effect in face recognition. British Journal of Psychology, 99(1), 45–56.CrossRef
go back to reference Happé, F. G. E. (1994). An advanced test of theory of mind: Understanding of story characters’ thoughts and feelings by able autistic, mentally handicapped, and normal children and adults. Journal of Autism and Developmental Disorders, 24(2), 129–154.CrossRef Happé, F. G. E. (1994). An advanced test of theory of mind: Understanding of story characters’ thoughts and feelings by able autistic, mentally handicapped, and normal children and adults. Journal of Autism and Developmental Disorders, 24(2), 129–154.CrossRef
go back to reference Harkness, K., Sabbagh, M., Jacobson, J., Chowdrey, N., & Chen, T. (2005). Enhanced accuracy of mental state decoding in dysphoric college students. Cognition & Emotion, 19(7), 999–1025.CrossRef Harkness, K., Sabbagh, M., Jacobson, J., Chowdrey, N., & Chen, T. (2005). Enhanced accuracy of mental state decoding in dysphoric college students. Cognition & Emotion, 19(7), 999–1025.CrossRef
go back to reference Hirschfeld, G., & Von Brachel, R. (2014). Improving Multiple-Group confirmatory factor analysis in R-A tutorial in measurement invariance with continuous and ordinal indicators. Practical Assessment, Research, and Evaluation, 19(1), 7. Hirschfeld, G., & Von Brachel, R. (2014). Improving Multiple-Group confirmatory factor analysis in R-A tutorial in measurement invariance with continuous and ordinal indicators. Practical Assessment, Research, and Evaluation, 19(1), 7.
go back to reference Hu, L. T., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6(1), 1–55.CrossRef Hu, L. T., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6(1), 1–55.CrossRef
go back to reference Ito, T. A., & Senholzi, K. B. (2013). Us versus them: Understanding the process of race perception with event-related brain potentials. Visual Cognition, 21(9–10), 1096–1120.CrossRef Ito, T. A., & Senholzi, K. B. (2013). Us versus them: Understanding the process of race perception with event-related brain potentials. Visual Cognition, 21(9–10), 1096–1120.CrossRef
go back to reference Izard, C. E. (1971). The face of emotion. East Norwalk, CT, US: Appleton-Century-Crofts. Izard, C. E. (1971). The face of emotion. East Norwalk, CT, US: Appleton-Century-Crofts.
go back to reference Jack, R. E. (2013). Culture and facial expressions of emotion. Visual Cognition, 21(9–10), 1248–1286.CrossRef Jack, R. E. (2013). Culture and facial expressions of emotion. Visual Cognition, 21(9–10), 1248–1286.CrossRef
go back to reference Kelly, D. J., Quinn, P. C., Slater, A. M., Lee, K., Ge, L., & Pascalis, O. (2007). The other-race effect develops during infancy: Evidence of perceptual narrowing. Psychological Science, 18(12), 1084–1089.CrossRef Kelly, D. J., Quinn, P. C., Slater, A. M., Lee, K., Ge, L., & Pascalis, O. (2007). The other-race effect develops during infancy: Evidence of perceptual narrowing. Psychological Science, 18(12), 1084–1089.CrossRef
go back to reference Khorashad, B. S., Baron-Cohen, S., Roshan, G. M., Kazemian, M., Khazai, L., Aghili, Z., & Afkhamizadeh, M. (2015). The “Reading the Mind in the Eyes” test: Investigation of psychometric properties and test–retest reliability of the persian version. Journal of Autism and Developmental Disorders, 45(9), 2651–2666.CrossRef Khorashad, B. S., Baron-Cohen, S., Roshan, G. M., Kazemian, M., Khazai, L., Aghili, Z., & Afkhamizadeh, M. (2015). The “Reading the Mind in the Eyes” test: Investigation of psychometric properties and test–retest reliability of the persian version. Journal of Autism and Developmental Disorders, 45(9), 2651–2666.CrossRef
go back to reference Liu, D., Wellman, H. M., Tardif, T., & Sabbagh, M. A. (2008). Theory of mind development in Chinese children: A meta-analysis of false-belief understanding across cultures and languages. Developmental Psychology, 44(2), 523.CrossRef Liu, D., Wellman, H. M., Tardif, T., & Sabbagh, M. A. (2008). Theory of mind development in Chinese children: A meta-analysis of false-belief understanding across cultures and languages. Developmental Psychology, 44(2), 523.CrossRef
go back to reference Matsumoto, D. (1989). Cultural influences on the perception of emotion. Journal of Cross-Cultural Psychology, 20(1), 92–105.CrossRef Matsumoto, D. (1989). Cultural influences on the perception of emotion. Journal of Cross-Cultural Psychology, 20(1), 92–105.CrossRef
go back to reference Meissner, C. A., & Brigham, J. C. (2001). Thirty years of investigating the own-race bias in memory for faces: A meta-analytic review. Psychology, Public Policy, and Law, 7(1), 3–35.CrossRef Meissner, C. A., & Brigham, J. C. (2001). Thirty years of investigating the own-race bias in memory for faces: A meta-analytic review. Psychology, Public Policy, and Law, 7(1), 3–35.CrossRef
go back to reference Michel, C., Rossion, B., Han, J., Chung, C. S., & Caldara, R. (2006). Holistic processing is finely tuned for faces of one’s own race. Psychological Science, 17(7), 608–615.CrossRef Michel, C., Rossion, B., Han, J., Chung, C. S., & Caldara, R. (2006). Holistic processing is finely tuned for faces of one’s own race. Psychological Science, 17(7), 608–615.CrossRef
go back to reference Ntuli, C. D. (2012). Intercultural Misunderstanding in South Africa: An Analysis of Nonverbal Communication Behaviour in Context. Intercultural Communication Studies, 21(2), 20–31. Ntuli, C. D. (2012). Intercultural Misunderstanding in South Africa: An Analysis of Nonverbal Communication Behaviour in Context. Intercultural Communication Studies, 21(2), 20–31.
go back to reference Olderbak, S., Wilhelm, O., Olaru, G., Geiger, M., Brenneman, M. W., & Roberts, R. D. (2015). A psychometric analysis of the reading the mind in the eyes test: Toward a brief form for research and applied settings. Frontiers in Psychology, 6, 1503.PubMedPubMedCentral Olderbak, S., Wilhelm, O., Olaru, G., Geiger, M., Brenneman, M. W., & Roberts, R. D. (2015). A psychometric analysis of the reading the mind in the eyes test: Toward a brief form for research and applied settings. Frontiers in Psychology, 6, 1503.PubMedPubMedCentral
go back to reference Pfaltz, M. C., McAleese, S., Saladin, A., Meyer, A. H., Stoecklin, M., Opwis, K., & Martin-Soelch, C. (2013). The Reading the Mind in the Eyes Test: Test-retest reliability and preliminary psychometric properties of the German version. International Journal of Advances in Psychology, 2(1), 1–9. Pfaltz, M. C., McAleese, S., Saladin, A., Meyer, A. H., Stoecklin, M., Opwis, K., & Martin-Soelch, C. (2013). The Reading the Mind in the Eyes Test: Test-retest reliability and preliminary psychometric properties of the German version. International Journal of Advances in Psychology, 2(1), 1–9.
go back to reference Premack, D., & Woodruff, G. (1978). Does the chimpanzee have a theory of mind? Behavioural and Brain Sciences, 1(4), 515–526.CrossRef Premack, D., & Woodruff, G. (1978). Does the chimpanzee have a theory of mind? Behavioural and Brain Sciences, 1(4), 515–526.CrossRef
go back to reference Putnick, D. L., & Bornstein, M. H. (2016). Measurement invariance conventions and reporting: The state of the art and future directions for psychological research. Developmental Review, 41, 71–90.CrossRef Putnick, D. L., & Bornstein, M. H. (2016). Measurement invariance conventions and reporting: The state of the art and future directions for psychological research. Developmental Review, 41, 71–90.CrossRef
go back to reference Rutherford, M. D., Baron-Cohen, S., & Wheelwright, S. (2002). Reading the mind in the voice: A study with normal adults and adults with Asperger syndrome and high functioning autism. Journal of Autism and Developmental Disorders, 32(3), 189–194.CrossRef Rutherford, M. D., Baron-Cohen, S., & Wheelwright, S. (2002). Reading the mind in the voice: A study with normal adults and adults with Asperger syndrome and high functioning autism. Journal of Autism and Developmental Disorders, 32(3), 189–194.CrossRef
go back to reference Stone, V. E., Baron-Cohen, S., & Knight, R. T. (1998). Frontal lobe contributions to theory of mind. Journal of Cognitive Neuroscience, 10(5), 640–656.CrossRef Stone, V. E., Baron-Cohen, S., & Knight, R. T. (1998). Frontal lobe contributions to theory of mind. Journal of Cognitive Neuroscience, 10(5), 640–656.CrossRef
go back to reference Varner, I., & Beamer, L. (2005). Nonverbal Language in Intercultural Communication. In L. Beamer & I. Varner (Eds.), Intercultural Communication in the Global Workplace (pp. 175–203). New York: McGraw-Hill/Irwin. Varner, I., & Beamer, L. (2005). Nonverbal Language in Intercultural Communication. In L. Beamer & I. Varner (Eds.), Intercultural Communication in the Global Workplace (pp. 175–203). New York: McGraw-Hill/Irwin.
go back to reference Wellman, H. M., Cross, D., & Watson, J. (2001). Meta-analysis of theory-of-mind development: The truth about false belief. Child Development, 72(3), 655–684.CrossRef Wellman, H. M., Cross, D., & Watson, J. (2001). Meta-analysis of theory-of-mind development: The truth about false belief. Child Development, 72(3), 655–684.CrossRef
go back to reference Wimmer, H., & Perner, J. (1983). Beliefs about beliefs: Representation and constraining function of wrong beliefs in young children’s understanding of deception. Cognition, 13(1), 103–128.CrossRef Wimmer, H., & Perner, J. (1983). Beliefs about beliefs: Representation and constraining function of wrong beliefs in young children’s understanding of deception. Cognition, 13(1), 103–128.CrossRef
go back to reference Yamane, T. (1967). Statistics, An Introductory Analysis (2nd ed.). Harper and Row. Yamane, T. (1967). Statistics, An Introductory Analysis (2nd ed.). Harper and Row.
go back to reference Yıldırım, E. A., Kaşar, M., Güdük, M., Ateş, E., Küçükparlak, I., & Ozalmete, E. O. (2011). Investigation of the reliability of the “reading the mind in the eyes test” in a Turkish population. Turkish Journal of Psychiatry, 22(3), 177–186.PubMed Yıldırım, E. A., Kaşar, M., Güdük, M., Ateş, E., Küçükparlak, I., & Ozalmete, E. O. (2011). Investigation of the reliability of the “reading the mind in the eyes test” in a Turkish population. Turkish Journal of Psychiatry, 22(3), 177–186.PubMed
Metagegevens
Titel
An evaluation of the reading the mind in the eyes test's psychometric properties and scores in South Africa—cultural implications
Auteurs
Jason Gary Van Staden
Christian William Callaghan
Publicatiedatum
14-06-2021
Uitgeverij
Springer Berlin Heidelberg
Gepubliceerd in
Psychological Research / Uitgave 7/2022
Print ISSN: 0340-0727
Elektronisch ISSN: 1430-2772
DOI
https://doi.org/10.1007/s00426-021-01539-w

Andere artikelen Uitgave 7/2022

Psychological Research 7/2022 Naar de uitgave