Jacob Eisenstein
ABSTRACT
Gesture plays a prominent role in human-human interaction, and it offers promise as a new modality for human-computer interaction. However, our understanding of gesture is still at an early stage. This study explores gesture in natural interaction and describes how the presence of a display can affect the use of gesture. We identify common gesturing behaviors that, if accommodated, may improve the naturalness and usability of gestural user interfaces.
- D. McNeill. Hand and Mind. The University of Chicago Press, 1992.Google Scholar
- S. Oviatt. Ten myths of multimodal interaction. Communications of the ACM, 42(11):74--81, 1999. Google ScholarDigital Library
- I. Poddar, Y. Sethi, E. Ozyildiz, and R. Sharma. Toward natural gesture/speech HCI: A case study of weather narration. In Proceedings of 1998 Workshop on Perceptual User Interfaces, 1998.Google Scholar
- C. J. Sparrell. Coverbal iconic gesture in human-computer interaction. Master's thesis, Massachusetts Institute of Technology, 1993.Google Scholar
Index Terms
- Natural gesture in descriptive monologues
Recommendations
An approach to natural gesture in virtual environments
Special issue on virtual reality software and technologyThis article presents research—an experiment and the resulting prototype—on a method for treating gestural input so that it can be used for multimodal applications, such as interacting with virtual environments. This method involves the capture and use ...
Facilitating multiparty dialog with gaze, gesture, and speech
ICMI-MLMI '10: International Conference on Multimodal Interfaces and the Workshop on Machine Learning for Multimodal InteractionWe study how synchronized gaze, gesture and speech rendered by an embodied conversational agent can influence the flow of conversations in multiparty settings. We begin by reviewing a computational framework for turn-taking that provides the foundation ...
Multimodal human discourse: gesture and speech
Gesture and speech combine to form a rich basis for human conversational interaction. To exploit these modalities in HCI, we need to understand the interplay between them and the way in which they support communication. We propose a framework for the ...
Comments