skip to main content
10.1145/1738826.1738853acmotherconferencesArticle/Chapter ViewAbstractPublication PagesozchiConference Proceedingsconference-collections
research-article

Scroll, tilt or move it: using mobile phones to continuously control pointers on large public displays

Published:23 November 2009Publication History

ABSTRACT

Large and public displays mostly provide little interactivity due to technical constraints, making it difficult for people to capture interesting information or to influence the screen's content. Through the combination of largescale visual output and the mobile phone as an input device, bidirectional interaction with large public displays can be enabled. In this paper, we propose and compare three different interaction techniques (Scroll, Tilt and Move) for continuous control of a pointer located on a remote display using a mobile phone. Since each of these techniques seemed to have arguments for and against them, we conducted a comparative evaluation and discovered their specific strengths and weaknesses. We report the implementation of the techniques, their design and results of our user study. The experiment revealed that while Move and Tilt can be faster, they also introduce higher error rates for selection tasks.

References

  1. Ballagas, R. BYOD: Bring Your Own Device. Workshop Ubiquitous Display Environments, UbiComp '04, 2004Google ScholarGoogle Scholar
  2. Ballagas, R., Rohs, M., and Sheridan, J. G. Sweep and Point & Shoot: Phonecam-Based Interactions for Large Public Displays. In Proc. Of CHI 2005, 1200--1203 Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Ballagas, R., Borchers, J., Rohs, M., and Sheridan, J. G. The Smart Phone: A Ubiquitous Input Device. IEEE Pervasive Computing 5, 1 (2006), 70--77 Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Boring, S., Altendorfer, M., Broll, G., Hilliges, O., and Butz, A. Shoot & Copy: Phonecam-Based Information Transfer from Public Displays onto Mobile Phones. Proc. Mobility '07, ACM Press (2007), 24--31 Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Card, S. K., MacKinlay, J. D. and Robertson, G. G. A Morphological Analysis of the Design Space of Input Devices. ACM Transactions on Information Systems, 9, 2 (1991), 99--122 Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Douglas, S. A., Kirkpatrick, A. E., and MacKenzie, I. S. Testing Pointing Device Performance and User Assessment with the ISO 9241, Part 9 Standard, Proc. CHI '99, ACM Press (1999), 215--222 Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Forlines, C., Balakrishnan, R., Beardsley, P., van Baar, J., and Raskar, R. Zoom-and-Pick: Facilitating Visual Zooming and Precision Pointing with Interactive Handheld Projectors, UIST '05, ACM (2005), 73--82 Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Hardy, R., and Rukzio, E. Touch & Interact: Touch-Based Interaction of Mobile Phones with Displays. Proc. of MobileHCI '08, ACM Press (2008), 245--254 Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Holleis, P., et al. Keystroke-Level Model for Advanced Mobile Phone Interaction. Proc. CHI '07, 1505--1514 Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Jiang, H., Ofek, E., Moraveji, N., and Shi, Y. Direct Pointer: Direct Manipulation Technique for Large-Display Interaction using Handheld Cameras. Proc. CHI '06, ACM (2006), 1107--1110 Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Madhavapeddy, A., Scott, D., Sharp, R., and Upton, E. Using Camera-Phones to Enhance Human Computer Interaction. Adj. Proc. UbiComp '04, 2004Google ScholarGoogle Scholar
  12. Miyaoku, K., Higashino, S., and Tonomura, Y. C-Blink: A Hue-Difference-Based Light Signal Marker for Large Screen Interaction via any Mobile Terminal. Proc. UIST '04, ACM (2004) Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Myers, B. A., Stiel, H., and Gargiulo, R. Collaboration using Multiple PDAs Connected to a PC. Proc. CSCW '98, ACM (1998), 285--294 Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Pears, N., Olivier, P., and Jackson, D. Display Registration for Device Interaction -- a Proof of Principle Prototype. Proc. VisApp '08, 2008, 446--451Google ScholarGoogle Scholar
  15. Reilly, D., Rodgers, M., Argue, R., Nunes, M., and Inkpen, K. Marked-up Maps: Combining Paper Maps and Electronic Information Resources. Personal and Ubiquitous Computing 10, 4 (2006), 215--226 Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Rohs, M., Schöning, J., Raubal, M., Essl, G., and Krüger, A. Map Navigation with Mobile Devices: Virtual versus Physical Movement with and without Context. Proc. ICMI 2007, ACM Press (2007), 146--153 Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Scheible, J., Ojala, T., and Coulton, P. MobiToss: A Novel Gesture Based Interface for Creating and Sharing Mobile Multimedia Art on Large Public Displays. Proc. ACM Multimedia, ACM Press (2008), 957--960 Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Silfverberg, M., MacKenzie, I. S., and Kauppinen, T. An Isometric Joystick as a Pointing Device for Handheld Information Terminals. Proc. GI '01, 2001, 119--126 Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Vajk, T., Bamford, W., Coulton, P., and Edwards, R. Using a Mobile Phone as a 'Wii like' Controller. Computer Games Technology, 2 (2008)Google ScholarGoogle Scholar
  20. Vogel, D., and Baudisch, P. Shift: A Technique for Operating Pen-based Interfaces Using Touch. Proc. CHI '07, ACM Press (2007), 657--666 Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Want, R., Schilit, B. N., Adams, N. I., Gold, R., Petersen, K., Goldberg, D., Ellis, J. R., and Weiser, M. The Parc-Tab Ubiquitous Experiment. Technical Report CSL-95-1, PARC (1995)Google ScholarGoogle Scholar
  22. Yatani, K., Tamura, K., Hiroki, K., Sugimoto, M., and Hashizume, H. Toss-It: Intuitive Information Transfer Techniques for Mobile Devices. Proc. CHI '05, ACM Press (2005), 1881--1884 Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Scroll, tilt or move it: using mobile phones to continuously control pointers on large public displays

              Recommendations

              Comments

              Login options

              Check if you have access through your login credentials or your institution to get full access on this article.

              Sign in
              • Published in

                cover image ACM Other conferences
                OZCHI '09: Proceedings of the 21st Annual Conference of the Australian Computer-Human Interaction Special Interest Group: Design: Open 24/7
                November 2009
                445 pages
                ISBN:9781605588544
                DOI:10.1145/1738826

                Copyright © 2009 ACM

                Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

                Publisher

                Association for Computing Machinery

                New York, NY, United States

                Publication History

                • Published: 23 November 2009

                Permissions

                Request permissions about this article.

                Request Permissions

                Check for updates

                Qualifiers

                • research-article

                Acceptance Rates

                OZCHI '09 Paper Acceptance Rate32of60submissions,53%Overall Acceptance Rate362of729submissions,50%

              PDF Format

              View or Download as a PDF file.

              PDF

              eReader

              View online with eReader.

              eReader