Michel Beaudouin-Lafon
ABSTRACT
This article introduces a new interaction model called Instrumental Interaction that extends and generalizes the principles of direct manipulation. It covers existing interaction styles, including traditional WIMP interfaces, as well as new interaction styles such as two-handed input and augmented reality. It defines a design space for new interaction techniques and a set of properties for comparing them. Instrumental Interaction describes graphical user interfaces in terms of domain objects and interaction instruments. Interaction between users and domain objects is mediated by interaction instruments, similar to the tools and instruments we use in the real world to interact with physical objects. The article presents the model, applies it to describe and compare a number of interaction techniques, and shows how it was used to create a new interface for searching and replacing text.
- 1.Ahlberg, C., Williamson, C., Shneiderman, B. Dynamic Queries for Information Exploration: An Implementation and Evaluation~ In Proc. A CM Human Factors in Computing Systems, CH1'92, ACM Press, p.619-626, 1992. Google Scholar
Digital Library
- 2.Apple Computer. Macintosh Human Interface Guidelines, Addison-Wesley, 1992. Google ScholarDigital Library
- 3.Bederson, B. and Hollan, J. Pad++: A Zooming Graphical Interface for Exploring Alternate Interface Physics. In Proc. A CM Symposium on User interface Software and Technology, UIST'94, ACM Press, p. 17- 26, 1994 Google ScholarDigital Library
- 4.Bederson, B., Hollan, J., Druin, A., Stewart, J., Rogers, D., Proft, D. Local Tools : an Alternative to Tool Palettes. In Proc. A CM Symposium on User Interface Software and Technology, UIST'94, ACM Press, p. 169-170, 1994. Google ScholarDigital Library
- 5.Bier, E., Stone, M., Pier, K., Buxton, W., De Rose, T. Toolglass and Magic Lenses : the See-Through Interface. In Proc. ACM SIGGRAPH, p.73-80, 1993. Google ScholarDigital Library
- 6.B~dker, S. Through the Interface. A Human Activity Approach to User Interface Design. Lawrence Erlbaum Associates, 199 I. Google ScholarDigital Library
- 7.Card, S.K., Mackinlay, J.D., Robertson, G.G. A Morphological Analysis of the Design Space of Input Devices. A CM Trans. Information Systems, 9(2):99- 122, 1991. Google ScholarDigital Library
- 8.Card, S., Mackinlay, J., Shneiderman, B. Readings in Information Visualization: Using Vision to Think. Morgan Kaufmann Publishers, 1998. Google ScholarDigital Library
- 9.Card, S., Robertson, G., Mackinlay, J. The information Visualizer, an Information Workspace. In Proc. A CM Human Factors in Computing Systems, CHI'91, ACM Press, p.181-187, 1991. Google ScholarDigital Library
- 10.Fitzmaurice, G., Ishii, H., Buxton, W. Laying the Foundations for Graspable User Interfaces. In Proc. A CM Human Factors in Computing Systems, CHI'95, ACM Press, p.442-449, 1995. Google ScholarDigital Library
- 11.Foley, J., Wallace, V., Chart, P. The Human Factors of Computer Graphics Interaction Techniques. Computer Graphics and Applications, 4(11): 13-48, 1984. Google ScholarDigital Library
- 12.Gram, C. & Cockton, G. Design Principles for Interactive Software, Chapman & Hall, 1996. Google ScholarDigital Library
- 13.Guiard, Y. Asymmetric division of labor in human skilled bimanual action' The kinematic chain as a model. Journal of Motor Behavior, 19:486-517, 1987.Google ScholarCross Ref
- 14.Heller, D., Ferguson, P.M., Brennan, D. Motif Programming Manual, O'Reilly & Associates, 1994. Google ScholarDigital Library
- 15.Holland, S. & Oppenheim, D. Direct Combination. Proc. A CM Human Factors in Computing Systems, CHI'99, ACM Press, p.262-269, 1999. Google ScholarDigital Library
- 16.Jacob, I. & Oliver, J. Evaluation of Techniques for Specifying 3D Rotations with a 2D Input Device. Proc. HCI'95 Conference, People and Computers X, p.63-76, 1995. Google ScholarDigital Library
- 17.Jacob, R., Sibert, L., McFarlane, D., Preston Mullen, M. Integrability and Separability of Input Devices. A CM Trans. Human Computer Interaction, 1 (1), p.3- 26, 1994. Google ScholarDigital Library
- 18.Krasner, G.E. & Pope, S.T. A Description of the Model-View-Controller User Interface Paradigm in the Smalltalk80 System. J. Object Oriented Programming 1 (3):26-49, 1988. Google ScholarDigital Library
- 19.Kurtenbach, G. & Buxton, W. User Learning and Performance with Marking Menus. Proc. ACM Human Factors in Computing Systems, CHI'94, ACM Press, p.258-264, 1994. Google ScholarDigital Library
- 20.Kurtenbach, G., Fitzmaurice, G., Baudel, T., Buxton. W. The Design of a GUI Paradigm based on Tablets, Two-hands, and Transparency. In Proc. ACM Human Factors in Computing Systems, CHI'97, ACM Press, p.35-42, 1997. Google ScholarDigital Library
- 21.Kurtenbach, G., Fitzmaurice, G.W., Owen, R.N., Baudel, T. The Hotbox: efficient access to a large number of menu-items. Proc. ACM Human Factors in Computing Systems, CHI'99, ACM Press, p.231-237, 1999. Google ScholarDigital Library
- 22.Michotte, A. La perception de la causalitd. Publications Universitaires de Louvain, 1946.Google Scholar
- 23.Myers, B.A. A New Model for Handling Input. A CM Trans. Information Systems, 8(3):289-320, 1990. Google ScholarDigital Library
- 24.Myers, B.A. User Interface Software Tools. A CM Trans. Computer-Human Interaction, 2( 1):64-103, 1995. Google ScholarDigital Library
- 25.Robertson, G.G. & Mackinlay, J.D. The Document Lens Visualizing Information. Proc. ACM Symposium on User interface Software and Technology, p. 101 - 108, 1993. Google ScholarDigital Library
- 26.Shneiderman, B. Direct Manipulation : a Step Beyond Programming Languages. 1EEE Computer, 16(8), pp 57-69, 1983.Google Scholar
- 27.Smith, D., Irby, C., Kimball, R., Verplank, B., Harslem E. Designing the Star User Interface. Byte, 7(4), p.242:282, 1982.Google Scholar
- 28.Szekely, P., Luo. P., Neches, R.-Beyond Interface Builders: Model-Based Interface Tools Model-Based. Proc. A CM Human Factors in Computing Systems, INTERCHI'93, ACM Press, p.383-390, 1993. Google ScholarDigital Library
- 29.Took, R. Surface Interaction: A Paradigm and Model for Separating Application and Interface. Proc. A CM Human Factors in Computing Systems, CHI'90, ACM Press, p.35-42, 1990. Google ScholarDigital Library
- 30.Wellner, P., Mackay, M., Gold R. Computer- Augmented Environments. Special lssue of Communications of the ACM, 23(7).Google Scholar
Index Terms
- Instrumental interaction: an interaction model for designing post-WIMP user interfaces
Recommendations
Reality-based interaction: a framework for post-WIMP interfaces
CHI '08: Proceedings of the SIGCHI Conference on Human Factors in Computing SystemsWe are in the midst of an explosion of emerging human-computer interaction techniques that redefine our understanding of both computers and interaction. We propose the notion of Reality-Based Interaction (RBI) as a unifying concept that ties together a ...
Designing interaction, not interfaces
AVI '04: Proceedings of the working conference on Advanced visual interfacesAlthough the power of personal computers has increased 1000-fold over the past 20 years, user interfaces remain essentially the same. Innovations in HCI research, particularly novel interaction techniques, are rarely incorporated into products. In this ...
Body-centric interaction techniques for very large wall displays
NordiCHI '10: Proceedings of the 6th Nordic Conference on Human-Computer Interaction: Extending BoundariesWe examine the design space of interaction techniques for very large wall displays by drawing from existing theory and practice for reality-based interfaces and whole-body interfaces. We also apply insights drawn from research in psychology about the ...
Comments