ABSTRACT
The rapid development of large interactive wall displays has been accompanied by research on methods that allow people to interact with the display at a distance. The basic method for target acquisition is by ray casting a cursor from one's pointing finger or hand position; the problem is that selection is slow and error-prone with small targets. A better method is the bubble cursor that resizes the cursor's activation area to effectively enlarge the target size. The catch is that this technique's effectiveness depends on the proximity of surrounding targets: while beneficial in sparse spaces, it is less so when targets are densely packed together. Our method is the speech-filtered bubble ray that uses speech to transform a dense target space into a sparse one. Our strategy builds on what people already do: people pointing to distant objects in a physical workspace typically disambiguate their choice through speech. For example, a person could point to a stack of books and say "the green one". Gesture indicates the approximate location for the search, and speech 'filters' unrelated books from the search. Our technique works the same way; a person specifies a property of the desired object, and only the location of objects matching that property trigger the bubble size. In a controlled evaluation, people were faster and preferred using the speech-filtered bubble ray over the standard bubble ray and ray casting approach.
- Baudisch, P., Cutrell, E., Robbins, D., Czerwinski, M., Tandler, P., Bederson, B., and Zierlinger, A. (2003). Drag-and-Pop and drag-and-pick: Techniques for accessing remote screen control on touch and pen operated systems, Proc. Interact, 57--64.Google Scholar
- Bezerianos, A., Balakrishnan, R. (2005) The Vacuum: Facilitating the manipulation of distant objects. Proc. CHI 2005, ACM Press, 361--370. Google ScholarDigital Library
- Blanch, R., Guiard, Y., and Beaudoin-Lafon, M. (2004) Semantic pointing: improving target acquisition with control-display ratio adaptation. Proc. ACM CHI '04, 519--525. Google ScholarDigital Library
- Bolt, R.A., Put-that-there: Voice and gesture at the graphics interface. Proc ACM Conf. Computer Graphics and Interactive Techniques Seattle, 1980, 262--270. Google ScholarDigital Library
- Dietz, P., Leigh, D., (2001) DiamondTouch: A Multi-User Touch Technology, Proc. UIST '01, ACM Press, 219--226. Google ScholarDigital Library
- Fitts, P. M. (1954). The information capacity of the human motor system in controlling the amplitude of movement. Journal of Experimental Psychology, 47, 181--196.Google ScholarCross Ref
- Grossman, T., Balakrishnan, R. (2005) The Bubble Cursor: Enhancing target acquisition by dynamic resizing of the cursor's activation area. Proc. CHI '05, 281--290. Google ScholarDigital Library
- Kabbash, P. and Buxton, W. (1995) The "Prince" technique: Fitts' law and selection using area cursors. Proc. ACM CHI '95, 273--279. Google ScholarDigital Library
- Kaiser, E., Olwal, A., McGee, D., Benko, H., Corradini, A., Li, X., Cohen, P., and Feiner, S. (2003) Mutual disambiguation of 3D multimodal interaction in augmented and virtual reality. Proc. ICMI '03, ACM Press, 12--19. Google ScholarDigital Library
- MacKenzie, I. S. (1989). A note on the information theoretic basis for Fitts' Law. Journal of Motor Behavior, 21:323--330.Google ScholarCross Ref
- Mackenzie, I. S. (1995) Movement time prediction in human-computer interfaces. In R. M. Baecker, W. A. S. Buxton, J. Grudin, and S. Greenberg, editors, Readings in Human-Computer Interaction. Kaufmann, second edition.Google Scholar
- McGuffin, M., Balakrishnan, R. (2005) Fitts' law and expanding targets: Experimental studies and designs for user interfaces. ACM TOCHI, 12(4), ACM Press, 388--422. Google ScholarDigital Library
- Myers, B., Bhatnagar, R., Nichols, J., Peck, C., Kong, D., Miller, R., and Long, C. (2002) Interacting At a Distance: Measuring the Performance of Laser Pointers and Other Devices. Proc CHI'02, 33--40. Google ScholarDigital Library
- Oviatt, S. (1997) Multimodal interactive maps: Designing for human performance. Human-Computer Interaction 12. Google ScholarDigital Library
- Parker, K., Mandryk, R., Nunes, M., Inkpen, K. (2005) TractorBeam Selection Aids: Improving Target Acquisition for Pointing Input on Tabletop Displays. Proc. Interact '05, Google ScholarDigital Library
- Schmidt, R., Penner, E., Carpendale, M. S. T. (2004) Reconfigurable Displays. Workshop on Ubiquitous Display Environments; at UBICOMP 2004. ACM Press,Google Scholar
- Tse, E. and Greenberg, S. (2004) Rapidly Prototyping Single Display Groupware through the SDG Toolkit, Proc. Australasian User Interface Conference, Australian Computer Society Inc., p101--110. Google ScholarDigital Library
- Tse, E., Shen, C., Greenberg, S., Forlines, C. (2007) How Pairs Interact Over a Multimodal Digital Table, Proc. ACM CHI '07. Google ScholarDigital Library
- Vogel, D., Balakrishnan, R. (2005). Distant freehand pointing and clicking on very large high resolution displays. Proc. ACM UIST 2005, 33--42. Google ScholarDigital Library
Index Terms
- Speech-filtered bubble ray: improving target acquisition on display walls
Recommendations
Multi-point interactions with immersive omnidirectional visualizations in a dome
ITS '10: ACM International Conference on Interactive Tabletops and SurfacesThis paper describes an interactive immersive experience using mid-air gestures to interact with a large curved display: a projected dome. Our Pinch-the-Sky Dome is an immersive installation where several users can interact simultaneously with ...
Vulture: a mid-air word-gesture keyboard
CHI '14: Proceedings of the SIGCHI Conference on Human Factors in Computing SystemsWord-gesture keyboards enable fast text entry by letting users draw the shape of a word on the input surface. Such keyboards have been used extensively for touch devices, but not in mid-air, even though their fluent gestural input seems well suited for ...
Trackball text entry for people with motor impairments
CHI '06: Proceedings of the SIGCHI Conference on Human Factors in Computing SystemsWe present a new gestural text entry method for trackballs. The method uses the mouse cursor and relies on crossing instead of pointing. A user writes in fluid Roman-like unistrokes by ""pulsing"" the trackball in desired letter patterns. We examine ...
Comments