Abstract
We discuss a two-handed user interface designed to support three-dimesional neurosurgical visualization. By itself, this system is a “point design,” an example of an advanced user interface technique. In this work, we argue that in order to understand why interaction techniques do or do not work, and to suggest possibilities for new techniques, it is important to move beyond point design and to introduce careful scientific measurement of human behavioral principles. In particular, we argue that the common-sense viewpoint that “two hands save time by working in parallel” may not always be an effective way to think about two-handed interface design because the hands do not necessarily work in parallel (there is a structure to two-handed manipulation) and because two hands do more than just save time over one hand (two hands provide the user with more information and can structure how the user thinks about a task). To support these claims, we present an interface design developed in collaboration with neurosurgeons which has undergone extensive informal usability testing, as well as a pair of formal experimental studies which investigate behavioral aspects of two-handed virtual object manipulation. Our hope is that this discussion will help others to apply the lessons in our neurosurgery application to future two-handed user interface designs.
- ANNETT, J., ANNETT, M., HUDSON, P., AND TURNER, A. 1979. The control of movement in the preferred and non-preferred hands. Q. J. Exp. Psychol. 31,641-652.Google ScholarCross Ref
- BRAECKER, R., GRUDIN, J., BUXTON, W., AND GREENBERG, S. 1995. The emergence of graphical user interfaces. In Readings in Human-Computer Interaction: Toward the Year 2000. Morgan Kaufmann Publishers Inc., San Francisco, CA, 49-70. Google ScholarDigital Library
- BIER, E. A., STONE, M. C., PIER, K., BUXTON, W., AND DEROSE, T. D. 1993. Toolglass and magic lenses: The see-through interface. In Conference Proceedings on Computer Graphics (SIGGRAPH 93, Anaheim, CA, Aug. 1-6), M. C. Whitton, Ed. ACM Press, New York, NY, 73-80. Google ScholarDigital Library
- BOLT, R. A. AND HERRANZ, E. 1992. Two-handed gesture in multi-modal natural dialog. In Proceedings of the 5th Annual ACM Symposium on User Interface Software and Technology (UIST '92, Monterey, CA, Nov. 15-18), J. Mackinlay and M. Green, Eds. ACM Press, New York, NY, 7-14. Google ScholarDigital Library
- BRITTON, E., LIPSCOMB, J., AND PIQUE, M. 1978. Making nested rotations convenient for the user. SIGGRAPH Comput. Graph. 12, 3, 222-227. Google ScholarDigital Library
- BROOKS, F. P. 1988. Grasping reality through illusion--Interactive graphics serving science. In Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI '88, Washington, DC, May 15-19), J. J. O'Hare, Ed. ACM Press, New York, NY, 1-11. Google ScholarDigital Library
- BUXTON, W. 1986. Chunking and phrasing and the design of human-computer dialogues. In Proceedings of the IFIP World Computer Congress on Information Processing 86 (Dublin, Ireland, Sept. 1-5), H.-J. Kugler, Ed. North-Holland Publishing Co., Amsterdam, The Netherlands, 475-480.Google Scholar
- BUXTON, W. 1990. The pragmatics of haptic input. In Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI '90, Seattle, WA, Apr. 1-5). ACM, New York, NY.Google Scholar
- BUXTON, W. AND MYERS, B. 1986. A study in two-handed input. In Conference Proceedings on Human Factors in Computing Systems (CHI '86, Boston, MA, Apr. 13-17), M. Mantei and P. Orbeton, Eds. ACM Press, New York, NY, 321-326. Google ScholarDigital Library
- CARD, S. K. AND MORAN, T. P. 1995. User technology: From pointing to pondering. In Human-Computer Interaction: Toward the Year 2000, Baecker, R. M., Grudin, J., Buxton, W. A. S., and Greenberg, S., Eds. Morgan Kaufmann Publishers Inc., San Francisco, CA, 587-602. Google ScholarDigital Library
- CARD, S., ENGLISH, W., AND BURR, B. 1978. Evaluation of mouse, rate-controlled isometric joystick, step keys, and text keys for text selection on a CRT. Ergonomics 21,601-613.Google ScholarCross Ref
- CHATTY, S. 1994a. Extending a graphical toolkit for two-handed interaction. In Proceedings of the ACM Symposium on User Interface Software and Technology (UIST '94, Marina del Rey, CA, Nov. 2-4), P. Szekely, Ed. ACM Press, New York, NY, 195-204. Google ScholarDigital Library
- CHATTY, S. 1994b. Issues and experience in designing two-handed interaction. In Proceedings of the ACM Conference on Human Factors in Computing Systems: "Celebrating Interdependence" (CHI '94, Boston, MA, Apr. 24-28), B. Adelson, S. Dumais, and J. Olson, Eds. ACM Press, New York, NY, 253-354. Google ScholarDigital Library
- CREMER, M. AND ASHTON, R. 1981. Motor performance and concurrent cognitive tasks. J. Motor Behav. 13, 187-196.Google ScholarCross Ref
- CUTLER, L., FROHLICH, B., AND HANRAHAN, P. 1997. Two-handed direct manipulation on the responsive workbench. In Proceedings of the ACM/SIGGRAPH Symposium on Interactive 3D Graphics (Providence, RI, Apr. 27-30). ACM, New York, NY, 107-114. Google ScholarDigital Library
- DEERING, M. 1992. High resolution virtual reality. SIGGRAPH Comput. Graph. 26, 2 (July), 195-202. Google ScholarDigital Library
- FITZMAURICE, G. AND BUXTON, W. 1997. An empirical evaluation of graspable user interfaces: Towards specialized, space-multiplexed input. In Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI '97, Atlanta, GA, Mar. 22-27). ACM, New York, NY, 43-50. Google ScholarDigital Library
- FITZMAURICE, G. W., ISHII, H., AND BUXTON, W. A. S. 1995. Bricks: Laying the foundations for graspable user interfaces. In Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI '95, Denver, CO, May 7-11), I. R. Katz, R. Mack, L. Marks, M. B. Rosson, and J. Nielsen, Eds. ACM Press/Addison-Wesley Publ. Co., New York, NY, 442-449. Google ScholarDigital Library
- GALYEAN, T. A. AND HUGHES, J. F. 1991. Sculpting: An interactive volumetric modeling technique. SIGGRAPH Comput. Graph. 25, 4 (July), 267-274. Google ScholarDigital Library
- GIBSON, J. 1962. Observations on active touch. Psychol. Rev. 69, 6, 477-491.Google ScholarCross Ref
- GOBLE, J., HINCKLEY, K., SNELL, J., PAUSCH, R., AND KASSELL, N. 1995. Two-handed spatial interface tools for neurosurgical planning. IEEE Comput. 28, 7 (July), 20-26. Google ScholarDigital Library
- GOBLE, J., SNELL, J., HINCKLEY, K., AND KASSELL, N. 1994. A real-time system for 3D neurosurgical planning. In Proceedings of the Conference on Visualization in Biomedical Computing (Rochester, MN, Sept.). Proceedings of SHE--The International Society for Optical Engineering, vol. 2359. SPIE, Bellingham, WA, 552-573.Google Scholar
- GRIBNAU, M. W. AND HENNESSEY, J. M. 1998. Comparing single- and two-handed 3D input for a 3D object assembly task. In Proceedings of the ACM Conference on Human Factors in Computing Systems: CHI '98 Summary (CHI '98, Los Angeles, CA, Apr. 18-23). ACM, New York, NY, 233-234. Google ScholarDigital Library
- GUIARD, Y. 1987. Asymmetric division of labor in human skilled bimanual action: The kinematic chain as a model. J. Motor Behav. 19, 4, 486-517.Google ScholarCross Ref
- GUIARD, Y. 1989. Failure to sing the left-hand part of the score during piano performance. J. Music Perception 6, 3, 299-314.Google ScholarCross Ref
- GUIARD, Y. AND FERRAND, T. 1995. Asymmetry in bimanual skills. In Manual Asymmetries in Motor Performance, Elliott, and Roy, Eds. CRC Press, Inc., Boca Raton, FL.Google Scholar
- HALPERN, D. 1992. Sex Differences in Cognitive Ability. Lawrence Erlbaum Associates, Inc., Mahwah, NJ.Google Scholar
- HAUPTMANN, A. 1989. Speech and gestures for graphic image manipulation. In Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI '89, Austin, TX, Apr. 30-May 4). ACM, New York, NY, 241-245. Google ScholarDigital Library
- HINCKLEY, K. 1997. Haptic issues for virtual manipulation. Ph.D. Dissertation. University of Virginia, Charlottesville, VA. Google ScholarDigital Library
- HINCKLEY, K., GOBLE, J., PAUSCH, R., AND KASSELL, N. 1995. New applications for the touchscreen in 2D and 3D medical imaging workstations. In Proceedings of the Conference on Medical Imaging 1995: Image Display. Proceedings of SPIE--The International Society for Optical Engineering, vol. 2431. SPIE, Bellingham, WA, 561-570.Google ScholarCross Ref
- HINCKLEY, K., PAUSCH, R., GOBLE, J. C., AND KASSELL, N. F. 1994a. Passive real-world interface props for neurosurgical visualization. In Proceedings of the ACM Conference on Human Factors in Computing Systems: "Celebrating Interdependence" (CHI '94, Boston, MA, Apr. 24-28), B. Adelson, S. Dumais, and J. Olson, Eds. ACM Press, New York, NY, 452-458. Google ScholarDigital Library
- HINCKLEY, K., PAUSCH, R., GOBLE, J. C., ANn KASSELL, N. F. 1994b. A survey of design issues in spatial input. In Proceedings of the ACM Symposium on User Interface Software and Technology (UIST '94, Marina del Rey, CA, Nov. 2-4), P. Szekely, Ed. ACM Press, New York, NY, 213-222. Google ScholarDigital Library
- HINCKLEY, K., PAUSCH, R., PROFFITT, D., AND KASSELL, N. 1997a. Attention and visual feedback: The bimanual frame-of-reference. In Proceedings of the ACM/SIGGRAPH Symposium on Interactive 3D Graphics (Providence, RI, Apr. 27-30). ACM, New York, NY, 121-126. Google ScholarDigital Library
- HINCKLEY, K., PAUSCH, R., PROFFITT, D., PATTEN, J., AND KASSELL, N. 1997b. Cooperative bimanual action. In Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI '97, Atlanta, GA, Mar. 22-27). ACM, New York, NY, 27-34. Google ScholarDigital Library
- HINCKLEY, K., TULLIO, J., PAUSCH, R., PROFFITT, D., AND KASSELL, N. 1997c. Usability analysis of 3D rotation techniques. In Proceedings of the ACM Symposium on User Interface Software and Technology (UIST '97, Banff, Alberta, Canada, Oct. 14-17). ACM Press, New York, NY, 1-10. Google ScholarDigital Library
- HONDA, H. 1982. Rightward superiority of eye movements in a bimanual aiming task. Q.J. Exp. Psychol. 34A, 499-513.Google ScholarCross Ref
- ISHII, H. AND ULLMER, B. 1997. Tangible bits: Towards seamless interfaces between people, bits, and atoms. In Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI '97, Atlanta, GA, Mar. 22-27). ACM, New York, NY, 234-241. Google ScholarDigital Library
- JACOB, R. J. K., SIBERT, L. E., MCFARLANE, D. C., AND MULLEN, M. P. 1994. Integrality and separability of input devices. ACM Trans. Comput. Hum. Interact. 1, I (Mar.), 3-26. Google ScholarDigital Library
- KABBASH, P., BUXTON, W., AND SELLEN, A. 1994. Two-handed input in a compound task. In Proceedings of the ACM Conference on Human Factors in Computing Systems: "Celebrating Interdependence" (CHI '94, Boston, MA, Apr. 24-28), B. Adelson, S. Dumais, and J. Olson, Eds. ACM Press, New York, NY, 417-423. Google ScholarDigital Library
- KABBASH, P., MACKENZIE, I. S., AND BUXTON, W. 1993. Human performance using computer input devices in the preferred and non-preferred hands. In Proceedings of them ACM Conference on Human Factors in Computing (INTERCHI '93, Amsterdam, The Netherlands, Apr. 24-29), B. Arnold, G. van der Veer, and T. White, Eds. ACM Press, New York, NY, 474-481. Google ScholarDigital Library
- KIYOKAWA, K., TAKEMURA, H., KATAYAMA, Y., IWASA, H., AND YOKOYA, N. 1996. VLEGO: A simple two-handed modeling environment based on toy blocks. In Proceedings of the ACM Symposium on Virtual Reality Software and Technology (VRST '96, Hong Kong, July 1-4). ACM, New York, NY, 27-34.Google ScholarDigital Library
- KIYOKAWA, K., TAKEMURA, H., AND YOKOYA, N. 1997. Manipulation aid for two-handed 3-D designing within a shared virtual environment. In Proceedings of the 7th International Conference on Human-Computing Interaction (HCI International '97, San Francisco, CA, Aug. 24-29). 937-940.Google Scholar
- KRUEGER, M. 1991. Artificial Reality H. Addison-Wesley, Reading, MA.Google Scholar
- KRUEGER, M.W. 1993. Environmental technology: Making the real world virtual. Commun. ACM 36, 7 (July), 36-37. Google ScholarDigital Library
- KRUEGER, M., GIONFRIDDO, T., AND HINRICHSEN, K. 1985. VIDEOPLACE--An artificial reality. In Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI '85, San Francisco, CA, Apr. 14-18). ACM, New York, NY, 35-40. Google ScholarDigital Library
- KURTENBACH, G., FITZMAURICE, G., BAUDEL, T., AND BUXTON, B. 1997. The design of a GUI paradigm based on tablets, two-hands, and transparency. In Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI '97, Atlanta, GA, Mar. 22-27). ACM, New York, NY, 35-42. Google ScholarDigital Library
- LEBLANC, A., KALRA, P., MAGNENAT-THALMANN, N., AND THALMANN, D. 1991. Sculpting with the "Ball and mouse" metaphor. In Proceedings of Graphics Interface '91 (Calgary, Alberta, June 3-7), W. A. Davis and B. Wyvill, Eds. Morgan Kaufmann Publishers Inc., San Francisco, CA, 152-159.Google Scholar
- LEGANCHUK, A., ZHAI, S., AND BUXTON, W. 1998. Manual and cognitive benefits of two-handed input: An experimental study. ACM Trans. Comput. Hum. Interact. 5, 4 (Dec.). Accepted for publication. Tentatively scheduled for Dec. 1998. Google ScholarDigital Library
- LIANG, J. AND GREEN, M. 1993. JDCAD: A highly interactive 3D modeling system. In Proceedings of the 3rd International Conference on CAD and Computer Graphics (Beijing, China, Aug.). 217-222.Google Scholar
- MACKENZIE, I. S. 1992. Fitts' law as a research and design tool in human-computer interaction. Human-Comput. Interact. 7, 91-139.Google ScholarDigital Library
- MAPES, D. AND MOSHELL, J. M. 1995. A two-handed interface for object manipulation in virtual environments. Presence: Teleoper. Virtual Environ. 4, 4 (Fall), 403-416.Google ScholarDigital Library
- MARTENIUK, R., MACKENZIE, C., AND BABA, D. 1984. Bimanual movement control: Information processing and interaction effects. Q. J. Exp. Psychol. 36A, 335-365.Google ScholarCross Ref
- MATSUSHITA, N. AND REKmOTO, J. 1997. HoloWall: Designing a finger, hand, body, and object sensitive wall. In Proceedings of the ACM Symposium on User Interface Software and Technology (UIST '97, Banff, Alberta, Canada, Oct. 14-17). ACM Press, New York, NY, 209-211. Google ScholarDigital Library
- MULTIGEN. 1997. MultiGen Smart Scene. MultiGen, Inc., San Jose, CA. http://www.multigen.com/Google Scholar
- NIELSEN, J.1993. Noncommand user interfaces. Commun. ACM 36, 6 (June), 82-99. Google ScholarDigital Library
- NIELSEN, J.1993. Usability Engineering. Academic Press Prof., Inc., San Diego, CA. Google ScholarDigital Library
- PETERS, M. 1985. Constraints in the performance of bimanual tasks and their expression in unskilled and skilled subjects. Q. J. Exp. Psychol. 37A, 171-196.Google Scholar
- POSTON, T. AND SERRA, L. 1996. Dexterous virtual work. Commun. ACM 39, 5 (May), 37-45. Google ScholarDigital Library
- POULTON, E. AND FREEMAN, P. 1966. Unwanted asymmetrical transfer effects. Psychol. Bull. 66, 1, 1-8.Google ScholarCross Ref
- PROVINS, K. AND GLENCROSS, D. 1968. Handwriting, typewriting and handedness. Q. J. Exp. Psychol. 20, 282-289.Google ScholarCross Ref
- SACHS, E., ROBERTS, A., AND STOOPS, D. 1991. 3-Draw: A tool for designing 3D shapes. IEEE Comput. Graph. Appl. (Nov.), 18-26. Google ScholarDigital Library
- SERRA, L., HERN, N., BENG CHOON, C., AND POSTON, T. 1997. Interactive vessel tracing in volume data. In Proceedings of the ACM/SIGGRAPH Symposium on Interactive 3D Graphics (Providence, RI, Apr. 27-30). ACM, New York, NY, 131-137. Google ScholarDigital Library
- SHAW, C. AND GREEN, M. 1994. Two-handed polygonal surface design. In Proceedings of the ACM Symposium on User Interface Software and Technology (UIST '94, Marina del Rey, CA, Nov. 2-4), P. Szekely, Ed. ACM Press, New York, NY, 205-212. Google ScholarDigital Library
- STASSEN, H. AND SMETS, G. 1995. Telemanipulation and telepresence. In Proceedings of the 6th IFAC/IFIP/IFORS/IEA Symposium on Analysis, Design, and Evaluation of Man- Machine Systems (Cambridge, MA, June 27-29). 13-23.Google ScholarCross Ref
- STOAKLEY, R., CONWAY, M. J., AND PAUSCH, R. 1995. Virtual reality on a WIM: Interactive worlds in miniature. In Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI '95, Denver, CO, May 7-11), I. R. Katz, R. Mack, L. Marks, M. B. Rosson, and J. Nielsen, Eds. ACM Press/Addison-Wesley Publ. Co., New York, NY, 265-272. Google ScholarDigital Library
- STURMAN, D. J., ZELTZER, D., AND PIEPER, S. 1989. Hands-on interaction with virtual environments. In Proceedings of the ACM SIGGRAPH Symposium on User Interface Software and Technology (UIST '89, Williamsburg, VA, Nov. 13-15), J. Sibert, Ed. ACM Press, New York, NY, 19-24. Google ScholarDigital Library
- ULLMER, B. AND ISHH, H. 1997. The metaDESK: Models and prototypes for tangible user interfaces. In Proceedings of the ACM Symposium on User Interface Software and Technology (UIST '97, Banff, Alberta, Canada, Oct. 14-17). ACM Press, New York, NY, 223-232. Google ScholarDigital Library
- WEIMER, D. AND GANAPATHY, S. K. 1989. A synthetic visual environment with hand gesturing and voice input. In Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI '89, Austin, TX, Apr. 30-May 4). ACM, New York, NY, 235-240. Google ScholarDigital Library
- WEISER, M. 1991. The computer for the 21st century. Sci. Am. (Sept.), 94-104.Google ScholarCross Ref
- WING, A. 1982. Timing and co-ordination of repetitive bimanual movements. Q. J. Exp. Psychol. 34A, 339-348.Google ScholarCross Ref
- WOLFF, P., HURWITZ, I., AND MOSS, H. 1977. Serial organization of motor skills in the left- and right-handed adults. Neuropsychologia 15, 539-546.Google ScholarCross Ref
- WREN, C., AZARBAYEJANI, A., DARRELL, T., AND PENTLAND, A. 1997. Pfinder: Real-time tracking of the human body. IEEE Trans. Pattern Anal. Mach. Intell. 19, 7, 780-785. Google ScholarDigital Library
- ZELEZNIK, R., FORSBERG, A., AND STRAUSS, P. 1997. Two pointer input for 3D interaction. In Proceedings of the ACM/SIGGRAPH Symposium on Interactive 3D Graphics (Providence, RI, Apr. 27-30). ACM, New York, NY, 115-120. Google ScholarDigital Library
- ZELEZNIK, R., HERNDON, K., AND HUGHES, J. 1996. SKETCH: An interface for sketching 3D scenes. In Proceedings of the ACM/ SIGRAPH Conference on Graphics (SIGTRAPH '96, New Orleans, LA, Aug. 6-11). ACM, New York, NY, 163-170. Google ScholarDigital Library
- ZHAI, S., BUXTON, W., AND MILGRAM, P. 1996a. The partial occlusion effect: Utilizing semi-transparency for human computer interaction. ACM Trans. Comput. Hum. Interact. 3, 3, 254-284. Google ScholarDigital Library
- ZHAI, S., MILGRAM, P., AND BUXTON, W. 1996b. The effects of using fine muscle groups in multiple degree-of-freedom input. In ACM Conference on Human Factors in Computing Systems (CHI '96, Vancouver, British Columbia, Canada, April 13-18). ACM, New York, NY, 308-315. Google ScholarDigital Library
- ZIMMERMAN, T., LANIER, J., BLANCHARD, C., BRYSON, S., AND HARVILL, Y. 1987. A hand gesture interface device. In Proceedings of the ACM CHI+GI '87 Conference on Human Factors in Computing Systems and Graphics Interface (CHI '87, Toronto, Ont., Canada, Apr. 5-9), J. M. Carroll and P. P. Tanner, Eds. ACM Press, New York, NY, 189-192. Google ScholarDigital Library
Index Terms
- Two-handed virtual manipulation
Recommendations
An empirical evaluation of graspable user interfaces: towards specialized, space-multiplexed input
CHI '97: Proceedings of the ACM SIGCHI Conference on Human factors in computing systemsAn Investigation of Two-Handed Manipulation and Related Techniques in Multi-touch Interaction
MVHI '10: Proceedings of the 2010 International Conference on Machine Vision and Human-machine InterfaceMulti-touch technique is a novel interactive technique that supports one finger or more to manipulate simultaneously. Thus, the bimanual interaction on the touch screen has been proved as a valuable input form with high degree of freedom (DOF). However, ...
Two-handed tangible interaction techniques for composing augmented blocks
Modeling tools typically have their own interaction methods for combining virtual objects. For realistic composition in 3D space, many researchers from the fields of virtual and augmented reality have been trying to develop intuitive interactive ...
Comments