ABSTRACT
TellTale is a wearable device that seeks to augment communication with subconscious emotion information. By sensing a user's heart rate and galvanic response, two major biological indicators of physiological state, TellTale can provide insight into true physiological and emotional response. In this way, TellTale acts as a playful, wearable polygraph or lie-detector. Through abstracted visualisations of the physiological data, we aim to position TellTale in-line with the learned skills of communication. In this paper, we motivate the design of TellTale, detail a prototype device and pilot study and present future areas for TellTale's exploration.
- Anttonen, J. and Surakka, V. Emotions and Heart Rate While Sitting on a Chair. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, ACM (2005), 491--499. Google ScholarDigital Library
- Baveye, Y., Bettinelli, J.-N., Dellandréa, E., Chen, L., and Chamaret, C. A Large Video Data Base for Computational Models of Induced Emotion. Proceedings of the 2013 Humaine Association Conference on Affective Computing and Intelligent Interaction, IEEE Computer Society (2013), 13--18. Google ScholarDigital Library
- DePaulo, B.M., Lindsay, J.J., Malone, B.E., Muhlenbruck, L., Charlton, K., and Cooper, H. Cues to deception. Psychological Bulletin 129, 1 (2003), 74--118.Google ScholarCross Ref
- Gaver, W.W., Bowers, J., Boehner, K., et al. Indoor Weather Stations: Investigating a Ludic Approach to Environmental HCI Through Batch Prototyping. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, ACM (2013), 3451--3460. Google ScholarDigital Library
- Goodwin, C. Notes on story structure and the organization of participation. Structures of social action, (1984), 225--246.Google Scholar
- Hogenboom, A., Bal, D., Frasincar, F., Bal, M., de Jong, F., and Kaymak, U. Exploiting Emoticons in Sentiment Analysis. Proceedings of the 28th Annual ACM Symposium on Applied Computing, ACM (2013), 703--710. Google ScholarDigital Library
- Iverson, J.M. and Goldin-Meadow, S. Why people gesture when they speak. Nature 396, 6708 (1998), 228--228.Google ScholarCross Ref
- Jacobs, M. and Worbin, L. Reach: Dynamic Textile Patterns for Communication and Social Expression. CHI '05 Extended Abstracts on Human Factors in Computing Systems, ACM (2005), 1493--1496. Google ScholarDigital Library
- Lisetti, C.L. etitia and Nasoz, F. Using Noninvasive Wearable Computers to Recognize Human Emotions from Physiological Signals. EURASIP J. Appl. Signal Process. 2004, (2004), 1672--1687. Google ScholarDigital Library
- McAtamney, G. and Parker, C. An Examination of the Effects of a Wearable Display on Informal Faceto-face Communication. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, ACM (2006), 45--54. Google ScholarDigital Library
- Mehrabian, A. Nonverbal Communication. Transaction Publishers, 1977.Google Scholar
- Schegloff, E.A. On some gestures' relation to talk. Structures of social action: Studies in conversation analysis, (1984), 266--296.Google Scholar
- Takano, Y. and Suzuki, K. Affective Communication Aid Using Wearable Devices Based on Biosignals. Proceedings of the 2014 Conference on Interaction Design and Children, ACM (2014), 213--216. Google ScholarDigital Library
- Tobita, H. and Kuzi, T. SmartWig: Wig-based Wearable Computing Device for Communication and Entertainment. Proceedings of the International Working Conference on Advanced Visual Interfaces, ACM (2012), 299--302. Google ScholarDigital Library
- Williams, L.M., Phillips, M.L., Brammer, M.J., et al. Arousal Dissociates Amygdala and Hippocampal Fear Responses: Evidence from Simultaneous fMRI and Skin Conductance Recording. NeuroImage 14, 5 (2001), 1070--1079.Google ScholarCross Ref
- Wittgenstein, L. Philosophical Investigations. John Wiley & Sons, 2010.Google Scholar
- Yuasa, M., Saito, K., and Mukawa, N. Emoticons Convey Emotions Without Cognition of Faces: An fMRI Study. CHI '06 Extended Abstracts on Human Factors in Computing Systems, ACM (2006), 1565--1570. Google ScholarDigital Library
Index Terms
- TellTale: Adding a Polygraph to Everyday Life
Recommendations
The Effect of Different Affective Arousal Levels on Taste Perception
ICMI '20 Companion: Companion Publication of the 2020 International Conference on Multimodal InteractionThe emotions we experience shape our perception, and our emotion is shaped by our perceptions. Taste perception is also influenced by emotions. Positive and negative emotions alter sweetness, sourness, and bitterness perception. However, most previous ...
"It sounds like she is sad": Introducing a Biosensing Prototype that Transforms Emotions into Real-time Music and Facilitates Social Interaction
CHI EA '19: Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing SystemsThis paper introduces a biosensing prototype that transforms emotions into music, helping people recognize and understand their own feelings and actions and those of other people. This study presents a series of three experiments with 20 participants in ...
Psychological responses to simulated displays of mismatched emotional expressions
Embodied agents are often designed with the ability to simulate human emotion. This paper investigates the psychological impact of simulated emotional expressions on computer users with a particular emphasis on how mismatched facial and audio ...
Comments