Skip to main content

Advertisement

SpringerLink
Log in

Mediating the expression of emotion in educational collaborative virtual environments: an experimental study

  • Original Article
  • Published:
Virtual Reality Aims and scope Submit manuscript

Abstract

The use of avatars with emotionally expressive faces is potentially highly beneficial to communication in collaborative virtual environments (CVEs), especially when used in a distance learning context. However, little is known about how, or indeed whether, emotions can effectively be transmitted through the medium of a CVE. Given this, an avatar head model with limited but human-like expressive abilities was built, designed to enrich CVE communication. Based on the facial action coding system (FACS), the head was designed to express, in a readily recognisable manner, the six universal emotions. An experiment was conducted to investigate the efficacy of the model. Results indicate that the approach of applying the FACS model to virtual face representations is not guaranteed to work for all expressions of a particular emotion category. However, given appropriate use of the model, emotions can effectively be visualised with a limited number of facial features. A set of exemplar facial expressions is presented.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1.
Fig. 2.
Fig. 3.
Fig. 4.
Fig. 5.
Fig. 6.
Fig. 7.
Fig. 8.
Fig. 9.
Fig. 10.
Fig. 11.
Fig. 12.
Fig. 13.

Similar content being viewed by others

References

  1. Thalmann D (2001) The role of virtual humans in virtual environment technology and interfaces. In: Earnshaw R, Guedj R and Vince J (eds) Frontiers of human-centred computing, online communities and virtual environments. Springer, Berlin Heidelberg New York

  2. Fleming B, Dobbs D (1999) Animating facial features and expressions. Charles River Media, Boston, MA

  3. Dumas C, Saugis G, Chaillou C, Degrande S and Viaud M (1998) A 3-D interface for cooperative work. In: Proceedings of the Conference on Collaborative Virtual Environments, Manchester, UK, 17–19 June 1998

  4. Manninen T, Kujanpää T (2002) Non-verbal communication forms in multi-player game sessions. In: Faulkner X, Finlay J, Détienne F (eds) People and computers XVI—memorable yet invisible. BCS Press, London, UK

  5. Atkins H, Moore D, Hobbs D and Sharpe S (2001) Learning style theory and computer mediated communication. In: Proceedings of ED-Media, Tampere, Finland, 25–30 June 2001

  6. Laurillard D (1993) Rethinking university teaching. Routledge, London, UK

  7. Moore M (1993) Three types of interaction. In: Harry K, John M and Keegan D (eds) Distance education: new perspectives. Routledge, London, UK

  8. Johnson D, Johnson R (1994) Cooperative learning in the culturally diverse classroom. In: DeVillar, Faltis, Cummins (eds) Cultural diversity in schools. State University of New York Press, Albany, NY

  9. Webb N (1995) Constructive activity and learning in collaborative small groups. Educ Psychol 87(3):406–423

    Article  Google Scholar 

  10. Wu A, Farrell R and Singley M (2002) Scaffolding group learning in a collaborative networked environment. In: Proceedings of CSCL 2002, Boulder, CO, 7–11 January 2002

  11. Lisetti C, Douglas M and LeRouge C (2002) Intelligent affective interfaces: a user-modeling approach for telemedicine. In: Proceedings of the International Conference on Universal Access in HCI, New Orleans, LA, 5–10 August 2002

  12. Daly-Jones O, Monk A and Watts L (1998) Some advantages of video conferencing over high-quality audio conferencing: fluency and awareness of attentional focus. Int J Hum-Comp Stud 49(1):21–58

    Google Scholar 

  13. McShea J, Jennings S and McShea H (1997) Characterising user control of video conferencing in distance education. In: Proceedings of CAL-97, Exeter, UK, 25–26 March 1997

  14. Fabri M, Gerhard M (2000) The virtual student: user embodiment in virtual learning environments. In: Orange G, Hobbs D (eds) International perspectives on tele-education and virtual learning environments, Ashgate, Aldershot, UK

  15. Knapp M (1978) Nonverbal communication in human interaction. Holt Rinehart Winston, New York, NY

  16. Morris D, Collett P, Marsh P and O’Shaughnessy M (1979) Gestures, their origin and distribution. Jonathan Cape, London, UK

  17. Argyle M (1988) Bodily communication (second edition). Methuen, New York, NY

  18. Strongman K (1996) The psychology of emotion (fourth edition). Wiley, New York

  19. Dittrich W, Troscianko T, Lea S and Morgan D (1996) Perception of emotion from dynamic point-light displays presented in dance. Perception 25:727–738

    Google Scholar 

  20. Keltner D (1995) Signs of appeasement: evidence for the distinct displays of embarrassment, amusement and shame. Pers Soc Psychol 68(3):441–454

    Article  Google Scholar 

  21. Picard R (1997) Affective computing. MIT Press, Cambridge, MA

  22. Lisetti C, Schiano D (2000) Facial expression recognition: where human-computer interaction, artificial intelligence and cognitive science intersect. Prag Cognit 8(1):185–235

    Google Scholar 

  23. Damásio A (1994) Descarte’s error: emotion, reason and the human brain. Avon, New York

  24. Cooper B, Brna P and Martins A (2000) Effective affective in intelligent systems—building on evidence of empathy in teaching and learning. In: Paiva A (ed) Affective interactions: towards a new generation of computer interfaces. Springer, Berlin Heidelberg New York

  25. Johnson W (1998) Pedagogical agents. In: Computers in education proceedings, Beijing, China

  26. McGrath A, Prinz W (2001) All that Is solid melts into software. In: Churchill, Snowdon, Munro (eds) Collaborative virtual environments—digital places and spaces for interaction, Springer, Berlin Heidelberg New York

  27. Durlach N, Slater M (2002) Meeting people virtually: experiments in shared virtual environments. In: Schroeder R (ed) The social life of avatars, Springer, Berlin Heidelberg New York

  28. Ekman P, Friesen W (1975) Unmasking the face. Prentice Hall, Englewood Cliffs, NJ

  29. New Oxford Dictionary of English. Oxford University Press, Oxford, UK

  30. Russell J, Férnandez-Dols J (1997) The psychology of facial expression. Cambridge University Press, Cambridge, UK

  31. Surakka V, Hietanen J (1998) Facial and emotional reactions to Duchénne and non-Duchénne smiles. Int J Psychophys 29(1):23–33

    Article  Google Scholar 

  32. Zebrowitz L (1997) Reading faces: window to the soul? Westview, Boulder, CO

    Google Scholar 

  33. Ekman P, Friesen W and Ellsworth P (1972) Emotion in the human face: guidelines for research and an integration of findings. Pergamon, New York

    Google Scholar 

  34. Ekman P (1999) Facial expressions. In: Dalgleish T, Power M (eds) Handbook of cognition and emotion. Wiley, New York

  35. Ekman P, Friesen W (1975) Pictures of facial affect. University of California Press, San Francisco, CA

  36. Ekman P, Friesen W (1978) Facial action coding system. Consulting Psychologists Press, San Francisco, CA

  37. Bartlett M (1998) Face image analysis by unsupervised learning and redundancy reduction. Dissertation, University of California

  38. Pélachaud C, Badler N and Steedman M (1996) Generating facial expressions for speech. Cog Sci 20(1):1–46

    Article  Google Scholar 

  39. Ekman P, Rosenzweig L (eds) What the face reveals: basic and applied studies of spontaneous expression using the facial action coding system. Oxford University Press, Oxford, UK

  40. Terzopoulos D, Waters K (1993) Analysis and synthesis of facial image sequences using physical and anatomical models. Patt Anal Mach Intell 15(6):569–579

    Article  Google Scholar 

  41. Platt S, Badler N (1981) Animating facial expression. ACM SIGGRAPH 15(3):245–252

    Google Scholar 

  42. Parke F (1982) Parameterized modeling for facial animation. IEEE Comp Graph Appl 2(9):61–68

    Google Scholar 

  43. Benford S, Bowers J, Fahlén L, Greenhalgh C and Snowdon D (1995) User embodiment in collaborative virtual environments. In: Proceedings of CHI 1995 Proceedings, Denver, CO, 7–11 May 1995

  44. Mori M (1982) The buddha in the robot. Tuttle, Boston, MA

  45. Reichardt J (1978) Robots: fact, fiction and prediction. Thames & Hudson, London, UK

  46. Hindmarsh J, Fraser M, Heath C and Benford S (2001) Virtually missing the point: configuring CVEs for object-focused interaction. In: Churchill E, Snowdon D and Munro A (eds) Collaborative virtual environments: digital places and spaces for interaction, Springer, Berlin Heidelberg New York

  47. Godenschweger F, Strothotte T and Wagener H (1997) Rendering gestures as line drawings. In: Proceedings of the Gesture Workshop 1997, Springer, Berlin Heidelberg New York

  48. Donath J (2001) Mediated faces. In: Beynon M, Nehaniv C and Dautenhahn K (eds) Cognitive technology: instruments of mind, Warwick, UK

  49. Bartneck C (2001) Affective expressions of machines. In: Proceedings of CHI 2001, Seattle, WA, 31 March–5 April 2001

  50. Ellis H (1990) Developmental trends in face recognition. Bullet Brit Psychol Soc 3:114–119

    Google Scholar 

  51. Dittrich W (1991) Facial motion and the recognition of emotions. Psychol Beit 33(3/4):366–377

    Google Scholar 

  52. H-Anim Working Group. Specification for a standard VRML humanoid. http://www.h-anim.org.

  53. Yacoob Y, Davis L (1994) Computing spatio-temporal representations of human faces. In: Proceedings of the Computer Vision and Pattern Recognition Conference, Seattle, WA, June 1994

  54. Essa I, Pentland A (1995) Coding, analysis, interpretation, and recognition of facial expressions. IEEE Trans Patt Anal Mach Intellig 19(7):757–763

    Article  Google Scholar 

  55. Neisser U (1976) Cognition and reality. Freeman, San Francisco, CA

  56. Poggi I, Pélachaud C (2000) Emotional meaning and expression in animated faces. In: Paiva A (ed) Affective interactions: towards a new generation of computer interfaces, Springer, Berlin Heidelberg New York

  57. Rutter D (1990) Non-verbal communication. In: Eysenck M (ed) The Blackwell dictionary of cognitive psychology, Blackwell, Oxford, UK

  58. Wehrle T, Kaiser S (2000) Emotion and facial expression. In: Paiva A (ed) Affective interactions: towards a new generation of computer interfaces, Springer, Berlin Heidelberg New York

  59. Markham R, Wang L (1996) Recognition of emotion by Chinese and Australian children. Cross-Cult Psychol 27(5):616–643

    Google Scholar 

  60. Spencer-Smith J, Innes-Ker A, Wild H and Townsend J (2002) Making faces with action unit morph targets. In: Proceedings of the Artificial Intelligence and Simulated Behaviour Conference, London, UK, 3–5 April 2002

  61. Coulson M (2002) Expressing emotion through body movement: a component process approach. In: Proceedings of the Artificial Intelligence and Simulated Behaviour Conference, London, UK, 3–5 April 2002

  62. Capin T, Pandzic I, Thalmann N and Thalmann D (1999) Realistic avatars and autonomous virtual humans in VLNET networked virtual environments. In: Earnshaw R, Vince J (eds) Virtual worlds on the Internet, IEEE Computer Science Press, Washington, DC

  63. Wing L (1996) Autism spectrum disorders. Constable Robinson, London, UK

  64. Moore D, McGrath P and Thorpe J (2000) Computer aided learning for people with autism—a framework for research and development. Innov Educ Train Intl 37(3): 218–228

    Article  Google Scholar 

  65. Moore D, Taylor J (2001) Interactive multimedia systems for people with autism. Educ Med 25(3):169–177

    Article  Google Scholar 

Download references

Acknowledgements

Photographs from the CD-Rom Pictures of Facial Affect [35] are used with permission. Original virtual head geometry by Geometrek. Detailed results of this study as well as the virtual head prototypes are available online at http://www.leedsmet.ac.uk/ies/comp/staff/mfabri/emotion.

Author information

Authors and Affiliations

  1. ISLE Research Group, Leeds Metropolitan University, Leeds, UK

    Marc Fabri & David Moore

  2. School of Informatics, University of Bradford, Bradford, UK

    Dave Hobbs

Authors
  1. Marc Fabri
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. David Moore
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Dave Hobbs
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Marc Fabri.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Fabri, M., Moore, D. & Hobbs, D. Mediating the expression of emotion in educational collaborative virtual environments: an experimental study. Virtual Reality 7, 66–81 (2004). https://doi.org/10.1007/s10055-003-0116-7

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10055-003-0116-7

Keywords

Search

Navigation