ABSTRACT
Touchscreens enable intuitive interaction through a combination of input and output. Despite the advantages, touch input on smartphones still poses major challenges that impact the usability. Amongst others, this includes the fat-finger problem, reachability challenges and the lack of shortcuts. To address these challenges, I explore interaction methods for smartphones that extend the input space beyond single taps and swipes on the touchscreen. This includes interacting with different fingers and parts of the hand driven by machine learning and raw capacitive data of the full interacting hand. My contribution is further broadened by the development of smartphone prototypes with full on-device touch sensing capability and an understanding of the physiological limitations of the human hand to inform the design of fully hand-and-finger-aware interaction.
- Baudisch, P. and Chu, G. Back-of-device Interaction Allows Creating Very Small Touch Devices. In Proc. of CHI '09. Google ScholarDigital Library
- Bergstrom-Lehtovirta, J. and Oulasvirta, A. Modeling the Functional Area of the Thumb on Mobile Touchscreen Surfaces. In Proc. of CHI '14. Google ScholarDigital Library
- Holz, C., Buthpitiya, S., and Knaust, M. Bodyprint: Biometric User Identification on Mobile Devices Using the Capacitive Touchscreen to Scan Body Parts. In Proc. of CHI '15. Google ScholarDigital Library
- Karlson, A. K., Bederson, B. B., and Contreras-Vidal, J. L. Studies in one-handed mobile design: Habit, desire and agility. In Proc. of 4th UI4ALL Workshop 06.Google Scholar
- Le, H. V., Bader, P., Kosch, T., and Henze, N. Investigating Screen Shifting Techniques to Improve One-Handed Smartphone Usage. In Proc. of NordiCHI '16. Google ScholarDigital Library
- Le, H. V., Clinch, S., Sas, C., Dingler, T., Henze, N., and Davies, N. Impact of Video Summary Viewing on Episodic Memory Recall: Design Guidelines for Video Summarizations. In Proc. of CHI '16. Google ScholarDigital Library
- Le, H. V., Kosch, T., Bader, P., Mayer, S., and Henze, N. PalmTouch: Using the Palm as an Additional Input Modality on Commodity Smartphones. In Proc. of CHI '18. Google ScholarDigital Library
- Le, H. V., Mayer, S., Bader, P., Bastian, F., and Henze, N. Interaction Methods and Use Cases for a Full-Touch Sensing Smartphone. In Proc. of CHI EA '17. Google ScholarDigital Library
- Le, H. V., Mayer, S., Bader, P., and Henze, N. Fingers' Range and Comfortable Area for One-Handed Smartphone Interaction Beyond the Touchscreen. In Proc. of CHI '18. Google ScholarDigital Library
- Le, H. V., Mayer, S., Bader, P., and Henze, N. A Smartphone Prototype for Touch Interaction on the Whole Device Surface. In Proc. of MobileHCI '17. Google ScholarDigital Library
- Le, H. V., Mayer, S., Wolf, K., and Henze, N. Finger Placement and Hand Grasp During Smartphone Interaction. In Proc. of CHI EA '16. Google ScholarDigital Library
- Mayer, S., Le, H. V., and Henze, N. Estimating the Finger Orientation on Capacitive Touchscreens Using Convolutional Neural Networks. In Proc. of ISS'17. Google ScholarDigital Library
- Mohd Noor, M. F., Rogers, S., and Williamson, J. Detecting Swipe Errors on Touchscreens Using Grip Modulation. In Proc. of CHI '16. Google ScholarDigital Library
- Sahami Shirazi, A., Le, H. V., Henze, N., and Schmidt, A. Automatic Classification of Mobile Phone's Contacts. In Proc. of Mensch & Computer 2013.Google Scholar
- Yoo, H., Yoon, J., and Ji, H. Index Finger Zone: Study on Touchable Area Expandability Using Thumb and Index Finger. In Proc. of MobileHCI '15. Google ScholarDigital Library
Index Terms
- Fully Hand-and-Finger-Aware Smartphone Interaction
Recommendations
Finger Placement and Hand Grasp during Smartphone Interaction
CHI EA '16: Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing SystemsSmartphones are currently the most successful mobile devices. Through their touchscreens, they combine input and output in a single interface. A body of work investigated interaction beyond direct touch. In particular, previous work proposed using the ...
Bezel swipe: conflict-free scrolling and multiple selection on mobile touch screen devices
CHI '09: Proceedings of the SIGCHI Conference on Human Factors in Computing SystemsZooming user interfaces are increasingly popular on mobile devices with touch screens. Swiping and pinching finger gestures anywhere on the screen manipulate the displayed portion of a page, and taps open objects within the page. This makes navigation ...
A study on touch & hover based interaction for zooming
CHI EA '12: CHI '12 Extended Abstracts on Human Factors in Computing SystemsProximity is a useful medium for interaction with high interactive digital contents. It can be used in different contexts such as for navigation through depth in 3D space in zoomable interfaces. In this paper, we propose hover-based zoom interaction as ...
Comments