Robert J. K. Jacob
ABSTRACT
In seeking hitherto-unused methods by which users and computers can communicate, we investigate the usefulness of eye movements as a fast and convenient auxiliary user-to-computer communication mode. The barrier to exploiting this medium has not been eye-tracking technology but the study of interaction techniques that incorporate eye movements into the user-computer dialogue in a natural and unobtrusive way. This paper discusses some of the human factors and technical considerations that arise in trying to use eye movements as an input medium, describes our approach and the first eye movement-based interaction techniques that we have devised and implemented in our laboratory, and reports our experiences and observations on them.
- 1.R.A. Bolt, "Gaze-Orchestrated Dynamic Windows," Computer Graphics 15(3) pp. 109-119 (August 1981). Google Scholar
Digital Library
- 2.R.A. Bolt, "Eyes at the Interface," Proc. A CM Human Factors in Computer Systems Conference pp. 360-362 (1982). Google ScholarDigital Library
- 3.F.P. Brooks, "Grasping Reality Through Illusion-Interactive Graphics Serving Science," Proc. ACM CHI'88 Human Factors in Computing Systems Conference pp. 1-11 (1988). Google ScholarDigital Library
- 4.J. Co~;co "TV, Paralysis Victim Will See Eye-to-Eye," Virginian-Pilot pp. A1-A12 (October 23, 1986).Google Scholar
- 5.F.A. Glenn and others, "Eye-voicecontrolled Interface," Proc. 30th Annual Meeting of the Human Factors Society pp. 322-326, Santa Monica, Calif. (1986).Google Scholar
- 6.R.J.K. Jacob, "A Specification Language for Direct Manipulation User Interfaces," ACM Transactions on Graphics $ pp. 283-317 (1986). Special Issue on User Interface Software. Google ScholarDigital Library
- 7.M.A. Just and P.A. Carpenter, "A Theory of Reading: From Eye Fixations to Comprehension," Psychological Review 87 pp. 329-354 (1980).Google ScholarCross Ref
- 8.J.L. Levine, "An Eye-Controlled Computer,'" manuscript, IBM Thomas J. Watson Research Center, Yorktown Heights, N.Y. (1981).Google Scholar
- 9.J. Merchant, R. Morrissette, and J.L. Porterfield, "Remote Measurement of Eye Direction Allowing Subject Motion Over One Cubic Foot of Space," IEEE Trans. on Biomedical Engineering BME-21 pp. 309-317 (1974).Google ScholarCross Ref
- 10.R.A. Monty and J.W. Senders, Eye Movements and Psychological Processes, Lawrence Erlbaum, Hillsdale, N.J. (1976).Google Scholar
- 11.B.A. Ivlyers, "User-interface Tools" Introduction and Survey," IEEE Software 6(1)pp. 15-23 (1989). Google ScholarDigital Library
- 12.C. Schmandt and D. Hindus, "Augmenting a Window Manager with Speech input," Manuscript, M.I.T. Media Lab, Cambridge, Mass. (1989).Google Scholar
- 13.C. Ware and H.T. Mikaelian, "An Evaluation of an Eye Tracker as a Device for Computer Input," Proc. ACM CHI+G{'87 Human Factors in Computing Systems Conference pp. 183-188 (1987). Google ScholarDigital Library
- 14.L.R. Young and D. Sheena, "Survey of Eye Movement Recording Methods," Behavior Research Methods and Instrumentation 7 pp. 397-429 (1975).Google ScholarCross Ref
Index Terms
- What you look at is what you get: eye movement-based interaction techniques
Recommendations
User Defined Eye Movement-Based Interaction for Virtual Reality
Cross-Cultural Design. Methods, Tools, and UsersAbstractMost of the applications of eye movement-based interaction in VR are limited to blinking and gaze at present, however, gaze gestures were neglected. Therefore, the potential of eye movement-based interaction in VR is far from being realized. In ...
User Eye Fatigue Detection via Eye Movement Behavior
CHI EA '15: Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing SystemsIn this study we propose and evaluate a novel approach that allows detection of physical eye fatigue. The proposed approach is based on the analysis of the recorded eye movements via what is called behavioral scores. These easy-to-compute scores can be ...
Exploring Eye Expressions for Enhancing EOG-Based Interaction
Human-Computer Interaction – INTERACT 2023AbstractThis paper explores the classification of eye expressions for EOG-based interaction using JINS MEME, an off-the-shelf eye-tracking device. Previous studies have demonstrated the potential for using electrooculography (EOG) for hands-free human-...
Comments