Skip to main content
Top
Gepubliceerd in: Psychological Research 6/2022

15-10-2021 | Original Article

Building and validation of a set of facial expression images to detect emotions: a transcultural study

Auteurs: Julian Tejada, Raquel Meister Ko Freitag, Bruno Felipe Marques Pinheiro, Paloma Batista Cardoso, Victor Rene Andrade Souza, Lucas Santos Silva

Gepubliceerd in: Psychological Research | Uitgave 6/2022

Log in om toegang te krijgen
share
DELEN

Deel dit onderdeel of sectie (kopieer de link)

  • Optie A:
    Klik op de rechtermuisknop op de link en selecteer de optie “linkadres kopiëren”
  • Optie B:
    Deel de link per e-mail

Abstract

The automatic emotion recognition from facial expressions has become an exceptional tool in research involving human subjects and has made it possible to obtain objective measurements of the emotional state of research subjects. Different software and commercial solutions are offered to perform this task. However, the adaptation to cultural context and the recognition of complex expressions and/or emotions are two of the main challenges faced by these solutions. Here, we describe the construction and validation of a set of facial expression images suitable for training a recognition system. Our datasets consist of images of people with no experience in acting who were recorded with a webcam as they performed a computer-assisted task in a room with a light background and overhead illumination. The six basic emotions and mockery were included and a combination of OpenCV, Dlib and Scikit-learn Python libraries were used to develop a support vector machine classifier. The code is available at GitHub and the images will be provided upon request. Since transcultural facial expressions to evaluate complex emotions and open-source solutions were used in this study, we strongly believe that our dataset will be useful in different research contexts.
Literatuur
go back to reference Biehl, M., Matsumoto, D., Ekman, P., Hearn, V., Heider, K., Kudoh, T., & Ton, V. (1997). Matsumoto and Ekman’s Japanese and Caucasian facial expressions of emotion (JACFEE): Reliability data and cross-national differences. Journal of Nonverbal Behavior, 21(1), 3–21. https://doi.org/10.1023/A:1024902500935CrossRef Biehl, M., Matsumoto, D., Ekman, P., Hearn, V., Heider, K., Kudoh, T., & Ton, V. (1997). Matsumoto and Ekman’s Japanese and Caucasian facial expressions of emotion (JACFEE): Reliability data and cross-national differences. Journal of Nonverbal Behavior, 21(1), 3–21. https://​doi.​org/​10.​1023/​A:​1024902500935CrossRef
go back to reference Boyko, N., Basystiuk, O., & Shakhovska, N. (2018). Performance evaluation and comparison of software for face recognition, based on Dlib and Opencv library. In: 2018 IEEE second international conference on data stream mining processing (DSMP) (pp. 478–482). https://doi.org/10.1109/DSMP.2018.8478556. Boyko, N., Basystiuk, O., & Shakhovska, N. (2018). Performance evaluation and comparison of software for face recognition, based on Dlib and Opencv library. In: 2018 IEEE second international conference on data stream mining processing (DSMP) (pp. 478–482). https://​doi.​org/​10.​1109/​DSMP.​2018.​8478556.
go back to reference Card, S. K. (2018). The psychology of human–computer interaction. CRC Press. (google-Books-ID: iUtaDwAAQBAJ).CrossRef Card, S. K. (2018). The psychology of human–computer interaction. CRC Press. (google-Books-ID: iUtaDwAAQBAJ).CrossRef
go back to reference Darwin, C., & Ekman, P. (2009). The expression of the emotions in man and animals, anniversary edition (4th ed.). Oxford University Press.CrossRef Darwin, C., & Ekman, P. (2009). The expression of the emotions in man and animals, anniversary edition (4th ed.). Oxford University Press.CrossRef
go back to reference Durán, J., Reisenzein, R., & Fernández-Dols, J. M. (2017). Coherence between emotions and facial expressions. In J. -M. Fernandez-Dols, J. A. Russell (Eds.) The science of facial expression (1st ed., pp. 107–139). Oxford University Press. Durán, J., Reisenzein, R., & Fernández-Dols, J. M. (2017). Coherence between emotions and facial expressions. In J. -M. Fernandez-Dols, J. A. Russell (Eds.) The science of facial expression (1st ed., pp. 107–139). Oxford University Press.
go back to reference Ekman, P., & Friesen, W. V. (1978a). Facial action coding system: Manual. Consulting Psychologists Press. (oCLC: 5851545). Ekman, P., & Friesen, W. V. (1978a). Facial action coding system: Manual. Consulting Psychologists Press. (oCLC: 5851545).
go back to reference Ekman, P., & Friesen, W. V. (1978b). Manual for the facial action coding system. Consulting Psychologists Press. Ekman, P., & Friesen, W. V. (1978b). Manual for the facial action coding system. Consulting Psychologists Press.
go back to reference Ekman, P., Rolls, E. T., Perrett, D. I., & Ellis, H. D. (1992). Facial expressions of emotion: An old controversy and new findings [and discussion]. Philosophical Transactions: Biological Sciences, 335(1273), 63–69.CrossRef Ekman, P., Rolls, E. T., Perrett, D. I., & Ellis, H. D. (1992). Facial expressions of emotion: An old controversy and new findings [and discussion]. Philosophical Transactions: Biological Sciences, 335(1273), 63–69.CrossRef
go back to reference Ekman, R. (1997). What the face reveals: Basic and applied studies of spontaneous expression using the facial action coding system (FACS). Oxford University Press. Ekman, R. (1997). What the face reveals: Basic and applied studies of spontaneous expression using the facial action coding system (FACS). Oxford University Press.
go back to reference Kortli, Y., Jridi, M., Falou, A. A., & Atri, M. (2018). A novel face detection approach using local binary pattern histogram and support vector machine. In: 2018 international conference on advanced systems and electric technologies (IC ASET) (pp. 28–33). https://doi.org/10.1109/ASET.2018.8379829. Kortli, Y., Jridi, M., Falou, A. A., & Atri, M. (2018). A novel face detection approach using local binary pattern histogram and support vector machine. In: 2018 international conference on advanced systems and electric technologies (IC ASET) (pp. 28–33). https://​doi.​org/​10.​1109/​ASET.​2018.​8379829.
go back to reference Lange, K., Kühn, S., & Filevich, E. (2014). “Just Another Tool for Online Studies” (JATOS): An easy solution for setup and management of web servers supporting online studies. PLoS ONE, 10(6), e0130834.CrossRef Lange, K., Kühn, S., & Filevich, E. (2014). “Just Another Tool for Online Studies” (JATOS): An easy solution for setup and management of web servers supporting online studies. PLoS ONE, 10(6), e0130834.CrossRef
go back to reference Lucey, P., Cohn, J. F., Kanade, T., Saragih, J., Ambadar, Z., Matthews, I. (2010). The Extended CohnKanade Dataset (CK+): A complete dataset for action unit and emotion-specified expression. In: 2010 IEEE computer society conference on computer vision and pattern recognition—workshops (pp. 94–101). https://doi.org/10.1109/CVPRW.2010.5543262(iSSN: 2160-7516). Lucey, P., Cohn, J. F., Kanade, T., Saragih, J., Ambadar, Z., Matthews, I. (2010). The Extended CohnKanade Dataset (CK+): A complete dataset for action unit and emotion-specified expression. In: 2010 IEEE computer society conference on computer vision and pattern recognition—workshops (pp. 94–101). https://​doi.​org/​10.​1109/​CVPRW.​2010.​5543262(iSSN: 2160-7516).
go back to reference Lundqvist, D., Flykt, A., Öhman, A. (1998). The Karolinska directed emotional faces—KDEF. [CD ROM] from Department of Clinical Neuroscience, Psychology section, Karolinska Institutet Lundqvist, D., Flykt, A., Öhman, A. (1998). The Karolinska directed emotional faces—KDEF. [CD ROM] from Department of Clinical Neuroscience, Psychology section, Karolinska Institutet
go back to reference Perez, F., Granger, B. E., & Hunter, J. D. (2010). Python: An ecosystem for scientific computing. Computing in Science & Engineering, 13(2), 13–21.CrossRef Perez, F., Granger, B. E., & Hunter, J. D. (2010). Python: An ecosystem for scientific computing. Computing in Science & Engineering, 13(2), 13–21.CrossRef
go back to reference Plutchik, R. (2001). The nature of emotions: Human emotions have deep evolutionary roots, a fact that may explain their complexity and provide tools for clinical practice. American Scientist, 89(4), 344–350.CrossRef Plutchik, R. (2001). The nature of emotions: Human emotions have deep evolutionary roots, a fact that may explain their complexity and provide tools for clinical practice. American Scientist, 89(4), 344–350.CrossRef
go back to reference VandenBos, G. R. (ed.). (2007). APA dictionary of psychology (pp. xvi, 1024). American Psychological Association. VandenBos, G. R. (ed.). (2007). APA dictionary of psychology (pp. xvi, 1024). American Psychological Association.
go back to reference Young, A., Perrett, D. I., Calder, A., Sprengelmeyer, R. H., Ekman, P. (2002). Facial expressions of emotion: Stimuli and test (FEEST). Type: Other Young, A., Perrett, D. I., Calder, A., Sprengelmeyer, R. H., Ekman, P. (2002). Facial expressions of emotion: Stimuli and test (FEEST). Type: Other
go back to reference Yu, L., Zhou, K., & Huang, Y. (2014). A comparative study on support vector machines classifiers for emotional speech recognition. Immune Computation, 2(1), 35–42. Yu, L., Zhou, K., & Huang, Y. (2014). A comparative study on support vector machines classifiers for emotional speech recognition. Immune Computation, 2(1), 35–42.
Metagegevens
Titel
Building and validation of a set of facial expression images to detect emotions: a transcultural study
Auteurs
Julian Tejada
Raquel Meister Ko Freitag
Bruno Felipe Marques Pinheiro
Paloma Batista Cardoso
Victor Rene Andrade Souza
Lucas Santos Silva
Publicatiedatum
15-10-2021
Uitgeverij
Springer Berlin Heidelberg
Gepubliceerd in
Psychological Research / Uitgave 6/2022
Print ISSN: 0340-0727
Elektronisch ISSN: 1430-2772
DOI
https://doi.org/10.1007/s00426-021-01605-3

Andere artikelen Uitgave 6/2022

Psychological Research 6/2022 Naar de uitgave