Scott R. Klemmer
Jack Li
James Lin
James A. Landay
ABSTRACT
Tangible user interfaces (TUIs) augment the physical world by integrating digital information with everyday physical objects. Currently, building these UIs requires "getting down and dirty" with input technologies such as computer vision. Consequently, only a small cadre of technology experts can currently build these UIs. Based on a literature review and structured interviews with nine TUI researchers, we created Papier-Mâché, a toolkit for building tangible interfaces using computer vision, electronic tags, and barcodes. Papier-Mache introduces a high-level event model for working with these technologies that facilitates technology portability. For example, an application can be prototyped with computer vision and deployed with RFID. We present an evaluation of our toolkit with six class projects and a user study with seven programmers, finding the input abstractions, technology portability, and monitoring window to be highly effective.
- Ballagas, R., M. Ringel, et al., iStuff: a physical user interface toolkit for ubiquitous computing environments. Human Factors in Computing Systems, CHI Letters, 2003. 5(1): pp. 537 -- 44. Google Scholar
Digital Library
- Card, S.K., T.P. Moran, and A. Newell, Chapter 2: The Human Information Processor, in The Psychology of Human-Computer Interaction, Lawrence Erlbaum: Hillsdale. pp. 23 -- 97, 1983.Google Scholar
- Clements, P., R. Kazman, and M. Klein, Evaluating Software Architectures: Methods and Case Studies. Boston: Addison-Wesley. 323 pp, 2002. Google ScholarDigital Library
- Detienne, F., Software Design - Cognitive Aspects. London: Springer Verlag. 200 pp, 2001. Google ScholarDigital Library
- Dey, A.K., D. Salber, and G.D. Abowd, A Conceptual Framework and a Toolkit for Supporting the Rapid Prototyping of Context-Aware Applications. Human-Computer Interaction, 2001. 16(2-4): pp. 97 -- 166. Google ScholarDigital Library
- Fails, J.A. and D.R. Olsen, A Design Tool for Camera-based Interaction. Human Factors in Computing Systems, CHI Letters, 2003. 5(1): pp. 449 -- 56. Google ScholarDigital Library
- Fishkin, K.P., T.P. Moran, and B.L. Harrison. Embodied User Interfaces: Towards Invisible User Interfaces. Proc. Conf. on Engineering for Human-Computer Interaction. pp. 1--18, 1998. Google ScholarDigital Library
- Forsyth, D.A. and J. Ponce, Computer Vision: A Modern Approach. Upper Saddle River: Prentice Hall. 693 pp, 2003. Google ScholarDigital Library
- Freeman, W.T., D. Anderson, P. Beardsley, C. Dodge, et al., Computer vision for interactive computer graphics. IEEE Computer Graphics and Applications, 1998. 18(3): pp. 42 -- 53. Google ScholarDigital Library
- Grady, R.B., Practical Software Metrics for Project Management and Process Improvement, Prentice Hall: Englewood Cliffs, NJ. pp. 17, 1992. Google ScholarDigital Library
- Greenberg, S. and C. Fitchett, Phidgets: easy development of physical interfaces through physical widgets. User Interface Software & Technology, CHI Letters, 2001. 3(2): pp. 209 -- 18. Google ScholarDigital Library
- Heiner, J.M., S.E. Hudson, and K. Tanaka, Linking and messaging from real paper in the paper PDA. User Interface Software & Technology, CHI Letters, 1999. 1(1): pp. 179 -- 86. Google ScholarDigital Library
- Horn, B., Robot vision. Cambridge: MIT Press. 509 pp, 1986. Google ScholarDigital Library
- Ishii, H. and B. Ullmer. Tangible Bits: Human Factors in Computing Systems. Proc. CHI: Human factors in computing systems. pp. 234 -- 41, 1997. Google ScholarDigital Library
- Kato, H., M. Billinghurst, and I. Poupyrev. ARToolKit. University of Washington HIT Lab, 2000. http://www.hitl.washington.edu/artoolkit/Google Scholar
- Klemmer, S.R., J. Graham, G.J. Wolff, and J.A. Landay, Books with Voices: Paper Transcripts as a Tangible Interface to Oral Histories. Human Factors in Computing Systems, CHI Letters, 2003. 5(1): pp. 89 -- 96. Google ScholarDigital Library
- Klemmer, S.R., M.W. Newman, R. Farrell, M. Bilezikjian, and J.A. Landay, The Designers' Outpost: A Tangible Interface for Collaborative Web Site Design. User Interface Software and Technology, CHI Letters, 2001. 3(2): pp. 1 -- 10. Google ScholarDigital Library
- Mackay, W.E., A.-L. Fayard, L. Frobert, and L. Médini. Reinventing the Familiar: Exploring an Augmented Reality Design Space for Air Traf?c Control. Proc. CHI: Human Factors in Computing Systems. ACM Press. pp. 558 -- 65, 1998. Google ScholarDigital Library
- Mankoff, J., S.E. Hudson, and G.D. Abowd, Providing Integrated Toolkit-Level Support for Ambiguity in Recognition-Based Interfaces. Human Factors in Computing Systems, CHI Letters, 2000. 2(1): pp. 368 -- 375. Google ScholarDigital Library
- McGee, D.R., P.R. Cohen, R.M. Wesson, and S. Horman, Comparing paper and tangible, multimodal tools. Human Factors in Computing Systems, CHI Letters, 2002. 4(1): pp. 407 -- 414. Google ScholarDigital Library
- Moran, T.P., E. Saund, W. van Melle, A. Gujar, et al., Design and Technology for Collaborage: Collaborative Collages of Information on Physical Walls. UIST: User Interface Software and Technology, CHI Letters, 1999. 1(1): pp. 197 -- 206. Google ScholarDigital Library
- Myers, B., S.E. Hudson, and R. Pausch, Past, Present, and Future of User Interface Software Tools. ACM Transactions on Computer-Human Interaction, 2000. 7(1): pp. 3 -- 28. Google ScholarDigital Library
- Myers, B. and M.B. Rosson. Survey on User Interface Programming. Proc. CHI: Human Factors in Computing Systems. ACM Press. pp. 195 -- 202, 1992. Google ScholarDigital Library
- Myers, B.A., A new model for handling input. ACM Trans. on Information Systems, 1990. 8(3): pp. 289 -- 320. Google ScholarDigital Library
- Nelson, L., S. Ichimura, E.R. Pederson, and L. Adams. Palette: a paper interface for giving presentations. Proc. CHI: Human Factors in Computing Systems. ACM Press. pp. 354 -- 61, 1999. Google ScholarDigital Library
- Olsen, D.R., Chapter 5: Basic Interaction, in Developing User Interfaces, Morgan Kaufmann. pp. 132 -- 62, 1998. Google ScholarDigital Library
- Pane, J., A Programming System for Children that is Designed for Usability, Carnegie Mellon University, Pittsburgh, 2002. http://www.cs.cmu.edu/~pane/thesis Google ScholarDigital Library
- Rekimoto, J. and Y. Ayatsuka. CyberCode: Designing Augmented Reality Environments with Visual Tags. Proc. Designing Augmented Reality Environments (DARE 2000). ACM Press. pp. 1 -- 10, 2000. Google ScholarDigital Library
- Shneiderman, B. Empirical Studies of Programmers: The Territory, Paths, and Destinations. Proc. First Workshop on Empirical Studies of Programmers. Ablex Pub. pp. 1 -- 12, 1986. Google ScholarDigital Library
- Ullmer, B. and H. Ishii, Emerging Frameworks for Tangible User Interfaces, in Human-Computer Interaction in the New Millennium, Addison-Wesley. pp. 579 -- 601, 2001.Google Scholar
- Want, R., K.P. Fishkin, A. Gujar, and B.L. Harrison. Bridging Physical and Virtual Worlds With Electronic Tags. Proc. CHI: Human Factors in Computing Systems. ACM Press. pp. 370 -- 77, 1999. Google ScholarDigital Library
Index Terms
- Papier-Mache: toolkit support for tangible input
Recommendations
Decoupled design: building applications on the NetBeans platform
OOPSLA '06: Companion to the 21st ACM SIGPLAN symposium on Object-oriented programming systems, languages, and applicationsThe NetBeans Platform is the open-source NetBeans Integrated Development Environment (IDE) less those modules that make it a development tool. The platform is a "generic application" - a runtime which can be used to develop applications.One of the key ...
Natural and tangible human-computer interfaces for augmented environments
SIGDOC '08: Proceedings of the 26th annual ACM international conference on Design of communicationIn this talk, the author will introduce Augmented Reality as a new media to improve human-computer communication and industrial processes. The author will make a special emphasis in introducing and demonstrating new human-computer interfaces appropriate ...
Decoupled design: building applications on the NetBeans platform
OOPSLA '06: Companion to the 21st ACM SIGPLAN symposium on Object-oriented programming systems, languages, and applicationsThe NetBeans Platform is the open-source NetBeans Integrated Development Environment (IDE) less those modules that make it a development tool. The platform is a "generic application" - a runtime which can be used to develop applications.One of the key ...
Comments