ABSTRACT
Designing wearable application interfaces that integrate well into real-world processes like aircraft maintenance or medical examinations is challenging. One of themain success criteria is how well the multimodal interaction with the computer system fits an already existing real-world task. Therefore, the interface design needs to take the real-world task flow into account from the beginning.
We propose a model of interaction devices and human interaction capabilities that helps evaluate how well different interaction devices/techniques integrate with specific real-world scenarios. The model was developed based on a survey of wearable interaction research literature. Combining this model with descriptions of observed real-world tasks, possible conflicts between task performance and device requirements can be visualized helping the interface designer to find a suitable solution.
- M. Beaudouin-Lafon. Instrumental interaction: an interaction model for designing post-wimp user interfaces. In CHI '00: Proceedings of the SIGCHI conference on Human factors in computing systems, pages 446--453, New York, NY, USA, 2000. ACM Press. Google ScholarDigital Library
- T. W. Bleser and J. Sibert. Toto: a tool for selecting interaction techniques. In UIST '90: Proceedings of the 3rd annual ACM SIGGRAPH symposium on User interface software and technology, pages 135--142, New York, NY, USA, 1990. ACM Press. Google ScholarDigital Library
- M. Boronowsky, T. Nicolai, C. Schlieder, and A. Schmidt. Winspect: A case study for wearable computing-supported inspection tasks. Fifth International Symposium on Wearable Computers (ISWC'01), pages 8--9, 2001. Google ScholarDigital Library
- C. Bürgy. An Interaction Constraints Model for Mobile and Wearable Computer-Aided Engineering Systems in Industrial Applications. PhD thesis, Carnegie Mellon University, 2002.Google Scholar
- W. Buxton. Lexical and pragmatic considerations of input structures. SIGGRAPH Comput. Graph., 17(1):31--37, 1983. Google ScholarDigital Library
- S. K. Card, J. D. Mackinlay, and G. G. Robertson. The design space of input devices. In CHI '90: Proceedings of the SIGCHI conference on Human factors in computing systems, pages 117--124, New York, NY, USA, 1990. ACM Press. Google ScholarDigital Library
- S. K. Card, J. D. Mackinlay, and G. G. Robertson. A morphological analysis of the design space of input devices. ACM Trans. Inf. Syst., 9(2):99--122, 1991. Google ScholarDigital Library
- L. E. Dunne and B. Smyth. Psychophysical elements of wearability. In CHI '07: Proceedings of the SIGCHI conference on Human factors in computing systems, pages 299--302, New York, NY, USA, 2007. ACM Press. Google ScholarDigital Library
- M. Fukumoto. A finger-ring shaped wearable handset based on bone-conduction. Wearable Computers, 2005. Proceedings. Ninth IEEE International Symposium on, pages 10--13, 2005. Google ScholarDigital Library
- F. Gemperle, C. Kasabach, J. Stivoric, M. Bauer, and R. Martin. Design for wearability. In ISWC '98: Proceedings of the 2nd IEEE International Symposium on Wearable Computers, page 116, Washington, DC, USA, 1998. IEEE Computer Society. Google ScholarDigital Library
- B. Howard and S. Howard. Lightglove: Wrist-Worn Virtual Typing and Pointing. Proceedings of the Fifth International Symposium on Wearable Computers, pages 172--173, 2001. Google ScholarDigital Library
- A. Jameson and K. Klöckner. User multitasking with mobile multimodal systems. In W. Minker, D. Bühler, and L. Dybkjær, editors, Spoken Multimodal Human-Computer Dialogue in Mobile Environments. Kluwer Academic Publishers, Dordrecht, 2004.Google Scholar
- T. Klug. Computer aided observations of complex mobile situations. In CHI '07: CHI '07 extended abstracts on Human factors in computing systems, pages 2507--2512, New York, NY, USA, 2007. ACM Press. Google ScholarDigital Library
- J. S. Lipscomb and M. E. Pique. Analog input device physical characteristics. SIGCHI Bull., 25(3):40--45, 1993. Google ScholarDigital Library
- Y. Liu, R. Feyen, and O. Tsimhoni. Queueing network-model human processor (qn-mhp): A computational architecture for multitask performance in human-machine systems. ACM Trans. Comput.-Hum. Interact., 13(1):37--70, 2006. Google ScholarDigital Library
- C. Metzger, M. Anderson, and T. Starner. FreeDigiter: A Contact-Free Device for Gesture Control. Proceedings of the Eighth International Symposium onWearable Computers (ISWC'04)-Volume 00, pages 18--21, 2004. Google ScholarDigital Library
- H. Noma, A. Ohmura, N. Kuwahara, and K. Kogure. Wearable sensors for auto-event-recording on medical nursing-user study of ergonomic design. Wearable Computers, 2004. ISWC 2004. Eighth International Symposium on, 1. Google ScholarDigital Library
- J. Perng, B. Fisher, S. Hollar, and K. Pister. Acceleration sensing glove (ASG). Wearable Computers, 1999. Digest of Papers. The Third International Symposium on, pages 178--180, 1999. Google ScholarDigital Library
- J. Rekimoto. GestureWrist and GesturePad: Unobtrusive Wearable Interaction Devices. Proceedings of the 5th IEEE International Symposium on Wearable Computers, Zurich, Switzerland, 2001. Google ScholarDigital Library
- T. Starner. Wearable Computing and Context Awareness. PhD thesis, Massachusetts Institute of Technology, May 1999. Google ScholarDigital Library
- T. Starner, J. Auxier, D. Ashbrook, and M. Gandy. The Gesture Pendant: A Self-illuminating, Wearable, Infrared Computer Vision System for Home Automation Control and Medical Monitoring. International Symposium on Wearable Computing, 2000. Google ScholarDigital Library
- B. Thomas, K. Grimmer, D. Makovec, J. Zucco, and B. Gunther. Determination of placement of a body-attached mouse as a pointinginput device forwearable computers. Wearable Computers, 1999. Digest of Papers. The Third International Symposium on, pages 193--194, 1999. Google ScholarDigital Library
- B. Thomas, S. Tyerman, and K. Grimmer. Evaluation of text input mechanisms for wearable computers. Virtual Reality, 3(3):187--199, 1998.Google ScholarDigital Library
- A. Toney, L. Dunne, B. Thomas, and S. Ashdown. A shoulder pad insert vibrotactile display. Wearable Computers, 2003. Proceedings. Seventh IEEEInternational Symposium on, pages 35--44, 2003. Google ScholarDigital Library
- A. Toney, B. Mulley, B. Thomas, and W. Piekarski. Minimal social weight user interactions for wearable computers in business suits. Wearable Computers, 2002.(ISWC 2002). Proceedings. Sixth International Symposium on, pages 57--64, 2002. Google ScholarDigital Library
- wearIT@work Project Homepage, http://www.wearitatwork.com/, 7 2007.Google Scholar
Index Terms
- Modeling human interaction resources to support the design of wearable multimodal systems
Recommendations
Multimodal interaction for data visualization
AVI '18: Proceedings of the 2018 International Conference on Advanced Visual InterfacesMultimodal interaction offers many potential benefits for data visualization. It can help people stay in the flow of their visual analysis and presentation, with the strengths of one interaction modality offsetting the weaknesses of others. Furthermore, ...
Using on-body displays for extending the output of wearable devices
PerDis '16: Proceedings of the 5th ACM International Symposium on Pervasive DisplaysIn this work, we explore wearable on-body displays. These displays have the potential of extending the display space of smart watches to the user's body. Our research is motivated by wearable computing devices moving technology closer to the human. ...
Wearable remote control of a mobile device: comparing one- and two-handed interaction
MobileHCI '14: Proceedings of the 16th international conference on Human-computer interaction with mobile devices & servicesWhile wearable technologies are suitable for remotely controlling mobile devices, few studies have examined user preferences for one- or two-handed touch interaction with these wearables, especially when worn on the wrist and hand area. As these ...
Comments