skip to main content
10.1145/1322192.1322244acmconferencesArticle/Chapter ViewAbstractPublication Pagesicmi-mlmiConference Proceedingsconference-collections
poster

Modeling human interaction resources to support the design of wearable multimodal systems

Published:12 November 2007Publication History

ABSTRACT

Designing wearable application interfaces that integrate well into real-world processes like aircraft maintenance or medical examinations is challenging. One of themain success criteria is how well the multimodal interaction with the computer system fits an already existing real-world task. Therefore, the interface design needs to take the real-world task flow into account from the beginning.

We propose a model of interaction devices and human interaction capabilities that helps evaluate how well different interaction devices/techniques integrate with specific real-world scenarios. The model was developed based on a survey of wearable interaction research literature. Combining this model with descriptions of observed real-world tasks, possible conflicts between task performance and device requirements can be visualized helping the interface designer to find a suitable solution.

References

  1. M. Beaudouin-Lafon. Instrumental interaction: an interaction model for designing post-wimp user interfaces. In CHI '00: Proceedings of the SIGCHI conference on Human factors in computing systems, pages 446--453, New York, NY, USA, 2000. ACM Press. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. T. W. Bleser and J. Sibert. Toto: a tool for selecting interaction techniques. In UIST '90: Proceedings of the 3rd annual ACM SIGGRAPH symposium on User interface software and technology, pages 135--142, New York, NY, USA, 1990. ACM Press. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. M. Boronowsky, T. Nicolai, C. Schlieder, and A. Schmidt. Winspect: A case study for wearable computing-supported inspection tasks. Fifth International Symposium on Wearable Computers (ISWC'01), pages 8--9, 2001. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. C. Bürgy. An Interaction Constraints Model for Mobile and Wearable Computer-Aided Engineering Systems in Industrial Applications. PhD thesis, Carnegie Mellon University, 2002.Google ScholarGoogle Scholar
  5. W. Buxton. Lexical and pragmatic considerations of input structures. SIGGRAPH Comput. Graph., 17(1):31--37, 1983. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. S. K. Card, J. D. Mackinlay, and G. G. Robertson. The design space of input devices. In CHI '90: Proceedings of the SIGCHI conference on Human factors in computing systems, pages 117--124, New York, NY, USA, 1990. ACM Press. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. S. K. Card, J. D. Mackinlay, and G. G. Robertson. A morphological analysis of the design space of input devices. ACM Trans. Inf. Syst., 9(2):99--122, 1991. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. L. E. Dunne and B. Smyth. Psychophysical elements of wearability. In CHI '07: Proceedings of the SIGCHI conference on Human factors in computing systems, pages 299--302, New York, NY, USA, 2007. ACM Press. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. M. Fukumoto. A finger-ring shaped wearable handset based on bone-conduction. Wearable Computers, 2005. Proceedings. Ninth IEEE International Symposium on, pages 10--13, 2005. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. F. Gemperle, C. Kasabach, J. Stivoric, M. Bauer, and R. Martin. Design for wearability. In ISWC '98: Proceedings of the 2nd IEEE International Symposium on Wearable Computers, page 116, Washington, DC, USA, 1998. IEEE Computer Society. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. B. Howard and S. Howard. Lightglove: Wrist-Worn Virtual Typing and Pointing. Proceedings of the Fifth International Symposium on Wearable Computers, pages 172--173, 2001. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. A. Jameson and K. Klöckner. User multitasking with mobile multimodal systems. In W. Minker, D. Bühler, and L. Dybkjær, editors, Spoken Multimodal Human-Computer Dialogue in Mobile Environments. Kluwer Academic Publishers, Dordrecht, 2004.Google ScholarGoogle Scholar
  13. T. Klug. Computer aided observations of complex mobile situations. In CHI '07: CHI '07 extended abstracts on Human factors in computing systems, pages 2507--2512, New York, NY, USA, 2007. ACM Press. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. J. S. Lipscomb and M. E. Pique. Analog input device physical characteristics. SIGCHI Bull., 25(3):40--45, 1993. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Y. Liu, R. Feyen, and O. Tsimhoni. Queueing network-model human processor (qn-mhp): A computational architecture for multitask performance in human-machine systems. ACM Trans. Comput.-Hum. Interact., 13(1):37--70, 2006. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. C. Metzger, M. Anderson, and T. Starner. FreeDigiter: A Contact-Free Device for Gesture Control. Proceedings of the Eighth International Symposium onWearable Computers (ISWC'04)-Volume 00, pages 18--21, 2004. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. H. Noma, A. Ohmura, N. Kuwahara, and K. Kogure. Wearable sensors for auto-event-recording on medical nursing-user study of ergonomic design. Wearable Computers, 2004. ISWC 2004. Eighth International Symposium on, 1. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. J. Perng, B. Fisher, S. Hollar, and K. Pister. Acceleration sensing glove (ASG). Wearable Computers, 1999. Digest of Papers. The Third International Symposium on, pages 178--180, 1999. Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. J. Rekimoto. GestureWrist and GesturePad: Unobtrusive Wearable Interaction Devices. Proceedings of the 5th IEEE International Symposium on Wearable Computers, Zurich, Switzerland, 2001. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. T. Starner. Wearable Computing and Context Awareness. PhD thesis, Massachusetts Institute of Technology, May 1999. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. T. Starner, J. Auxier, D. Ashbrook, and M. Gandy. The Gesture Pendant: A Self-illuminating, Wearable, Infrared Computer Vision System for Home Automation Control and Medical Monitoring. International Symposium on Wearable Computing, 2000. Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. B. Thomas, K. Grimmer, D. Makovec, J. Zucco, and B. Gunther. Determination of placement of a body-attached mouse as a pointinginput device forwearable computers. Wearable Computers, 1999. Digest of Papers. The Third International Symposium on, pages 193--194, 1999. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. B. Thomas, S. Tyerman, and K. Grimmer. Evaluation of text input mechanisms for wearable computers. Virtual Reality, 3(3):187--199, 1998.Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. A. Toney, L. Dunne, B. Thomas, and S. Ashdown. A shoulder pad insert vibrotactile display. Wearable Computers, 2003. Proceedings. Seventh IEEEInternational Symposium on, pages 35--44, 2003. Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. A. Toney, B. Mulley, B. Thomas, and W. Piekarski. Minimal social weight user interactions for wearable computers in business suits. Wearable Computers, 2002.(ISWC 2002). Proceedings. Sixth International Symposium on, pages 57--64, 2002. Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. wearIT@work Project Homepage, http://www.wearitatwork.com/, 7 2007.Google ScholarGoogle Scholar

Index Terms

  1. Modeling human interaction resources to support the design of wearable multimodal systems

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Conferences
      ICMI '07: Proceedings of the 9th international conference on Multimodal interfaces
      November 2007
      402 pages
      ISBN:9781595938176
      DOI:10.1145/1322192

      Copyright © 2007 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 12 November 2007

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • poster

      Acceptance Rates

      Overall Acceptance Rate453of1,080submissions,42%

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader