ABSTRACT
Direct manipulation has had major influence on interface design since it was proposed by Shneiderman in 1982. Although directness generally benefits users, direct manipulation also has weaknesses. In some cases, such as when a user needs to manipulate small, attribute-rich objects or multiple objects simultaneously, indirect manipulation may be more efficient at the cost of directness or intuitiveness of the interaction. Several techniques have been developed over the years to address these issues, but these are all isolated and limited efforts with no coherent underlying principle. We propose the notion of Surrogate Interaction that ties together a large subset of these techniques through the use of a surrogate object that allow users to interact with the surrogate instead of the domain object. We believe that formalizing this family of interaction techniques will provide an additional and powerful interface design alternative for interaction designers, as well as uncover opportunities for future research.
Supplemental Material
- N. Andrienko and G. Andrienko. Exploratory Analysis of Spatial and Temporal Data: A Systematic Approach. Springer-Verlag, 2006. Google ScholarDigital Library
- Apple Inc. Keynote. http://www.apple.com/iwork/keynote/.Google Scholar
- M. Beaudouin-Lafon. Instrumental interaction: an interaction model for designing post-WIMP user interfaces. In Proceedings of the ACM CHI Conference on Human Factors in Computing Systems, pages 446--453, 2000. Google ScholarDigital Library
- M. Beaudouin-Lafon. Designing interaction, not interfaces. In Proceedings of the ACM Conference on Advanced Visual Interfaces, pages 15--22, 2004. Google ScholarDigital Library
- B. Buxton. HCI and the inadequacies of direct manipulation systems. SIGCHI Bulletins, 25(1):21--22, 1993. Google ScholarDigital Library
- W. S. Cleveland and M. E. McGill, editors. Dynamic Graphics for Statistics. Wadsworth & Brooks/Cole, Pacific Grove, CA, USA, 1988. Google ScholarDigital Library
- P. R. Cohen, M. Dalrymple, D. B. Moran, F. C. N. Pereira, J. W. Sullivan, R. A. G. Jr, J. L. Schlossberg, and S. W. Tyler. Synergistic use of direct manipulation and natural language. In Proceedings of the ACM CHI Conference on Human Factors in Computing Systems, pages 227--233, 1989. Google ScholarDigital Library
- P. Dourish. Where the Action Is: The Foundations of Embodied Interaction. MIT Press, 2001. Google ScholarCross Ref
- C. Esposito, W. B. Paley, and J. Ong. Of mice and monkeys: A specialized input device for virtual body animation. In Proceedings of the ACM Symposium on Interactive 3D Graphics, pages 109--114, 1995. Google ScholarDigital Library
- C. Forlines, D. Vogel, and R. Balakrishnan. Hybrid- Pointing: fluid switching between absolute and relative pointing with a direct input device. In Proceedings of the ACM Symposium on User Interface Software and Technology, pages 211--220, 2006. Google ScholarDigital Library
- D. Frohlich. Direct manipulation and other lessons. In M. Helander, T. K. Landauer, and P. V. Prabhu, editors, Handbook of Human-Computer Interaction, pages 463-- 488. 1997.Google ScholarCross Ref
- D. M. Frohlich. The history and future of direct manipulation. Behaviour & Information Technology, 12(6):315--329, 1993.Google Scholar
- E. Gamma, R. Helm, R. Johnson, and J. Vlissides. Design Patterns: Elements of Reusable Object-Oriented Software. Addison-Wesley, 1995. Google ScholarDigital Library
- H. Ishii and B. Ullmer. Tangible bits: Towards seamless interfaces between people, bits and atoms. In Proceedings of the ACM CHI Conference on Human Factors in Computing Systems, pages 234--241, 1997. Google ScholarDigital Library
- R. J. K. Jacob, A. Girouard, L. M. Hirshfield, M. S. Horn, O. Shaer, E. T. Solovey, and J. Zigelbaum. Reality-based interaction: a framework for post-WIMP interfaces. In Proceedings of the ACM CHI Conference on Human Factors in Computing Systems, pages 201--210, 2008. Google ScholarDigital Library
- C. N. Klokmose and M. Beaudouin-Lafon. VIGO: instrumental interaction in multi-surface environments. In Proceedings of the ACM CHI Conference on Human Factors in Computing Systems, pages 869--878, 2009. Google ScholarDigital Library
- P. Maes. Agents that reduce work and information overload. Communications of the ACM, 37(7):30--40, July 1994. Google ScholarDigital Library
- D. A. Norman. The Design of Everyday Things. The MIT Press, 1988.Google Scholar
- K. Perlin and D. Fox. Pad: An alternative approach to the computer interface. In Computer Graphics (Proceedings SIGGRAPH"93), pages 57--64, 1993. Google ScholarDigital Library
- M. P. Peterson. Active legends for interactive cartographic animation. International Journal of Geographical Information Science, 13(4):375--383, 1999.Google ScholarCross Ref
- J. S. Pierce, B. C. Stearns, and R. Randy Pausch. Voodoo dolls: Seamless interaction at multiple scales in virtual environments. In Proceedings of the ACM Symposium on Interactive 3D Graphics, pages 141--145, 1999. Google ScholarDigital Library
- I. Poupyrev, M. Billinghurst, S. Weghorst, and T. Ichikawa. The go-go interaction technique: Nonlinear mapping for direct manipulation in VR. In Proceedings of the ACM Symposium on User Interface Software and Technology, pages 79--80, 1996. Google ScholarDigital Library
- J. Rekimoto. Pick-and-drop: A direct manipulation technique for multiple computer environments. In Proceedings of the ACM Symposium on User Interface Software and Technology, pages 31--39, 1997. Google ScholarDigital Library
- N. H. Riche, B. Lee, and C. Plaisant. Understanding interactive legends: a comparative study with standard widgets. Computer Graphics Forum, 29(3):1193--1202, 2010.Google ScholarDigital Library
- B. Shneiderman. The future of interactive systems and the emergence of direct manipulation. Behaviour and Information Technology, 1(3):237--256, 1982.Google ScholarCross Ref
- B. Shneiderman. Direct manipulation: A step beyond programming languages. Computer, 16(8):57--69, 1983. Google ScholarDigital Library
- B. Shneiderman and P. Maes. Direct manipulation vs. interface agents. Interactions, 4(6):42--61, 1997. Google ScholarDigital Library
- B. Shneiderman and C. Plaisant. Designing the User Interface: Strategies for Effective Human-Computer Interaction. Addison-Wesley, 5th edition, 2009. Google ScholarDigital Library
- J. H. Siegel, E. J. Farrell, R. M. Goldwyn, and H. P. Friedman. The surgical implication of physiologic patterns in myocardial infarction shock. Surgery, 72(1):126--141, 1972.Google Scholar
- R. Stoakley, M. J. Conway, and R. Pausch. Virtual reality on a WIM: Interactive worlds in miniature. In Proceedings of the ACM CHI Conference on Human Factors in Computing Systems, pages 265--272, 1995. Google ScholarDigital Library
- The Omni Group. OmniGraffle Professional. http://www.omnigroup.com/products/omnigraffle/.Google Scholar
- M. E. Tudoreanu and D. Hart. Interactive legends. In Proceedings of the ACM Southeast Regional Conference, pages 448--453, 2004. Google ScholarDigital Library
- E. Tufte. The Visual Display of Quantitative Information. Graphics Press, 1983. Google ScholarDigital Library
- E. Tufte. Beautiful Evidence. Graphics Press, 2006. Google ScholarDigital Library
- A. van Dam. Post-WIMP user interfaces. Communications of the ACM, 40(2):63--67, Feb. 1997. Google ScholarDigital Library
- W. Willett, J. Heer, and M. Agrawala. Scented widgets: Improving navigation cues with embedded visualizations. IEEE Transactions on Visualization and Computer Graphics, 13(6):1129--1136, Nov./Dec. 2007. Google ScholarDigital Library
- C. Williamson and B. Shneiderman. The Dynamic HomeFinder: Evaluating dynamic queries in a realestate information exploration system. In Proceedings of the ACM Conference on Research and Development in Information Retrieval, pages 338--346, 1992. Google ScholarDigital Library
- Yahoo! Inc. Yahoo pipes. http://pipes.yahoo.com.Google Scholar
Index Terms
- Direct manipulation through surrogate objects
Recommendations
Instrumental interaction: an interaction model for designing post-WIMP user interfaces
CHI '00: Proceedings of the SIGCHI conference on Human Factors in Computing SystemsThis article introduces a new interaction model called Instrumental Interaction that extends and generalizes the principles of direct manipulation. It covers existing interaction styles, including traditional WIMP interfaces, as well as new interaction ...
Direct manipulation video navigation on touch screens
MobileHCI '14: Proceedings of the 16th international conference on Human-computer interaction with mobile devices & servicesDirect Manipulation Video Navigation (DMVN) systems allow a user to directly drag an object of interest along its motion trajectory and have been shown effective for space-centric video browsing tasks. This paper designs touch-based interface techniques ...
Facile 3D direct manipulation
CHI '93: Proceedings of the INTERACT '93 and CHI '93 Conference on Human Factors in Computing SystemsAn experimental 3D interface is described, including rendering acceleration hardware, a 3D mouse, and 3D interaction techniques. A 3D cursor, controlled by the augmented mouse, allows direct manipulation of 3D objects. Objects are selected by placing ...
Comments