skip to main content
10.1145/3170427.3173023acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
abstract

Fully Hand-and-Finger-Aware Smartphone Interaction

Published:20 April 2018Publication History

ABSTRACT

Touchscreens enable intuitive interaction through a combination of input and output. Despite the advantages, touch input on smartphones still poses major challenges that impact the usability. Amongst others, this includes the fat-finger problem, reachability challenges and the lack of shortcuts. To address these challenges, I explore interaction methods for smartphones that extend the input space beyond single taps and swipes on the touchscreen. This includes interacting with different fingers and parts of the hand driven by machine learning and raw capacitive data of the full interacting hand. My contribution is further broadened by the development of smartphone prototypes with full on-device touch sensing capability and an understanding of the physiological limitations of the human hand to inform the design of fully hand-and-finger-aware interaction.

References

  1. Baudisch, P. and Chu, G. Back-of-device Interaction Allows Creating Very Small Touch Devices. In Proc. of CHI '09. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Bergstrom-Lehtovirta, J. and Oulasvirta, A. Modeling the Functional Area of the Thumb on Mobile Touchscreen Surfaces. In Proc. of CHI '14. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Holz, C., Buthpitiya, S., and Knaust, M. Bodyprint: Biometric User Identification on Mobile Devices Using the Capacitive Touchscreen to Scan Body Parts. In Proc. of CHI '15. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Karlson, A. K., Bederson, B. B., and Contreras-Vidal, J. L. Studies in one-handed mobile design: Habit, desire and agility. In Proc. of 4th UI4ALL Workshop 06.Google ScholarGoogle Scholar
  5. Le, H. V., Bader, P., Kosch, T., and Henze, N. Investigating Screen Shifting Techniques to Improve One-Handed Smartphone Usage. In Proc. of NordiCHI '16. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Le, H. V., Clinch, S., Sas, C., Dingler, T., Henze, N., and Davies, N. Impact of Video Summary Viewing on Episodic Memory Recall: Design Guidelines for Video Summarizations. In Proc. of CHI '16. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Le, H. V., Kosch, T., Bader, P., Mayer, S., and Henze, N. PalmTouch: Using the Palm as an Additional Input Modality on Commodity Smartphones. In Proc. of CHI '18. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Le, H. V., Mayer, S., Bader, P., Bastian, F., and Henze, N. Interaction Methods and Use Cases for a Full-Touch Sensing Smartphone. In Proc. of CHI EA '17. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Le, H. V., Mayer, S., Bader, P., and Henze, N. Fingers' Range and Comfortable Area for One-Handed Smartphone Interaction Beyond the Touchscreen. In Proc. of CHI '18. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Le, H. V., Mayer, S., Bader, P., and Henze, N. A Smartphone Prototype for Touch Interaction on the Whole Device Surface. In Proc. of MobileHCI '17. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Le, H. V., Mayer, S., Wolf, K., and Henze, N. Finger Placement and Hand Grasp During Smartphone Interaction. In Proc. of CHI EA '16. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Mayer, S., Le, H. V., and Henze, N. Estimating the Finger Orientation on Capacitive Touchscreens Using Convolutional Neural Networks. In Proc. of ISS'17. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Mohd Noor, M. F., Rogers, S., and Williamson, J. Detecting Swipe Errors on Touchscreens Using Grip Modulation. In Proc. of CHI '16. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Sahami Shirazi, A., Le, H. V., Henze, N., and Schmidt, A. Automatic Classification of Mobile Phone's Contacts. In Proc. of Mensch & Computer 2013.Google ScholarGoogle Scholar
  15. Yoo, H., Yoon, J., and Ji, H. Index Finger Zone: Study on Touchable Area Expandability Using Thumb and Index Finger. In Proc. of MobileHCI '15. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Fully Hand-and-Finger-Aware Smartphone Interaction

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Conferences
      CHI EA '18: Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems
      April 2018
      3155 pages
      ISBN:9781450356213
      DOI:10.1145/3170427

      Copyright © 2018 Owner/Author

      Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 20 April 2018

      Check for updates

      Qualifiers

      • abstract

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader