Matthew K.X.J. Pan
ABSTRACT
This work explores a novel interaction paradigm driven by implicit, low-attention user control, accomplished by monitoring a user's physiological state. We have designed and prototyped this interaction for a first use case of bookmarking an audio stream, to holistically explore the implicit interaction concept. Here, a user's galvanic skin conductance (GSR) is monitored for orienting responses (ORs) to external interruptions; our prototype automatically bookmarks the media such that the user can attend to the interruption, then resume listening from the point he/she is interrupted. To test this approach's viability, we addressed questions such as: does GSR exhibit a detectable response to interruptions, and how should the interaction utilize this information? In evaluating this system in a controlled environment, we found an OR detection accuracy of 84%; users provided subjective feedback on its accuracy and utility.
- Wickens CD. Engineering Psychology and Human Performance. Merrill; 1984:513.Google Scholar
- Weiser M, Brown JS. Designing Calm Technology. Powergrid Journal. 1996;1.01(July):94--110.Google Scholar
- Picard RW. Affective Computing. Cambridge, MA: MIT Press; 1998. Google ScholarDigital Library
- MacLean K. Putting Haptics into the Ambience. IEEE Trans. on Haptics. 2009;2(3):123--135. Google ScholarDigital Library
- Baumann MA, Maclean KE, Hazelton TW, McKay A. Emulating Human Attention-Getting Practices with Wearable Haptics. In: IEEE Haptics Symp. ; (2010). Google ScholarDigital Library
- Cowie R, Douglas-Cowie E, Tsapatsoulis N, et al. Emotion Recognition in Human-Computer Interaction. IEEE Signal Processing. 2001;26(1):32--80.Google Scholar
- Picard RW, Vyzas E, Healey J. Toward Machine Emo-tional Intelligence: Analysis of Affective Physiological State. IEEE Trans. on Pattern Analysis and Machine Intelligence. 2001;23(10). Google ScholarDigital Library
- Picard RW. Toward Agents that Recognize Emotion. MIT Media Lab Perceptual Computing Section Technical Report. 1998;(515).Google Scholar
- Kim, K.H., Bang, S.W., Kim, S.R. Emotion recognition system using short-term monitoring of physiological signals. Med. & Bio. Eng. & Computing. 42, 3 (2004).Google Scholar
- Healey J, Picard RW. StartleCam: a cybernetic wearable camera. Intl. Symp. on Wearable Comp., IEEE Comp. Soc. (1998), 42--49. Google ScholarDigital Library
- 1Conati, C. Probabilistic Assessment of User's Emotions in Educational Games. Applied Artificial Intelligence 16, 7--8 (2002), 555--575.Google ScholarCross Ref
- Frith CD, Allen HA. The skin conductance OR as an in-dex of attention. Biological Psychology. 1983;17(1).Google Scholar
- Boucsein, W. Electrodermal Activity. Plenem Press, New York, New York, USA, 1992.Google Scholar
- Cacioppo JT, Tassinary LG. Inferring psychological significance from physiological signals. The American Psychologist. 1990;45(1):16--28.Google Scholar
- Bernstein, A. An analysis of the skin conductance OR in samples of American, British, and German schizophrenics. Biological Psych. 1982;14(3--4):155--211.Google Scholar
- Cacioppo JT, Tassinary LG, Berntson GG. The Electrodermal System. In: Handbook of Psychophysiology. 3rd ed. New York, New York, USA: Cambridge University Press; 2007:159--181.Google Scholar
- www.thoughtechnology.com.Google Scholar
- Anderson, C. Free: The Future of a Radical Price. HarperCollins, New York, New York, USA.. Google ScholarDigital Library
Index Terms
- Now where was I?: physiologically-triggered bookmarking
Recommendations
Galvanic skin response-derived bookmarking of an audio stream
CHI EA '11: CHI '11 Extended Abstracts on Human Factors in Computing SystemsWe demonstrate a novel interaction paradigm driven by implicit, low-attention user control, accomplished by monitoring a user's physiological state. We have designed and prototyped this interaction for a first use case of bookmarking an audio stream, to ...
Intelligent Interruption Management using Electro Dermal Activity based Physiological Sensor for Collaborative Sensemaking
Sensemaking tasks are difficult to accomplish with limited time and attentional resources because analysts are faced with a constant stream of new information. While this information is often important, the timing of the interruptions may detract from ...
Stress recognition in human-computer interaction using physiological and self-reported data: a study of gender differences
PCI '15: Proceedings of the 19th Panhellenic Conference on InformaticsThis paper investigates gender differences in stress recognition in human computer interaction (HCI) for both objective (i.e., skin conductance) and subjective (i.e., valence-arousal VA ratings) metrics. To this end, 31 healthy participants, 18 females, ...
Comments