Ken Hinckley
ABSTRACT
This research explores distributed sensing techniques for mobile devices using synchronous gestures. These are patterns of activity, contributed by multiple users (or one user with multiple devices), which take on a new meaning when they occur together in time, or in a specific sequence in time. To explore this new area of inquiry, this work uses tablet computers augmented with touch sensors and two-axis linear accelerometers (tilt sensors). The devices are connected via an 802.11 wireless network and synchronize their time-stamped sensor data. This paper describes a few practical examples of interaction techniques using synchronous gestures such as dynamically tiling together displays by physically bumping them together, discusses implementation issues, and speculates on further possibilities for synchronous gestures.
Supplemental Material
- 1. Analog Devices Inc., Low-Cost +/-2g Dual-Axis Accelerometer with Duty Cycle Output, http:// www.analog.com/UploadedFiles/Datasheets/ 567227477ADXL202E_a.pdf, 2002.Google Scholar
- 2. Ayatsuka, Y., Matsushita, N., Rekimoto, J., HyperPalette: a Hybrid Computing Environment for Small Computing Devices, CHI 2000 Extended Abstracts, 2000, 133-134. Google ScholarDigital Library
- 3. Bahl, P., Padmanabhan, V., RADAR: An In-Building RF-Based User Location and Tracking System, IEEE 19th Annual Joint Conference of the IEEE Computer and Communications Societies (INFOCOM 2000), 775-784.Google ScholarCross Ref
- 4. Baxter, L.K., Capacitive Sensors: Design and Applications. IEEE Press Series on Electronics Technology, ed. R.J. Herrick. 1997, New York: The Institute of Electrical and Electronics Engineers.Google Scholar
- 5. Buxton, W., Chunking and Phrasing and the Design of Human-Computer Dialogues, Information Processing '86, Proc. of the IFIP 10th World Computer Congress, 1986: Amsterdam: North Holland Publishers, 475-480.Google Scholar
- 6. Chen, J.C., Yip, L., Wang, H., Maniezzo, D., Hudson, R.E., Elson, J., Yao, K., Estrin, D., DSP Implementation of a Distributed Acoustical Beamformer on a Wireless Sensor Platform, Proc. IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP 2003), 2003, Hong Kong, China.Google ScholarCross Ref
- 7. Choudhury, T., Pentland, A., The Sociometer: A Wearable Device for Understanding Human Networks, Conference on Computer Supported Cooperative Work (Workshop: Ad hoc Communications and Collaboratin in Ubiquitous Computing Environments), 2002.Google Scholar
- 8. Dannenberg, R., Aura as a Platform for Distributed Sensing and Control, Symposium on Sensing and Input for Media-Centric Systems (SIMS 02), 2002, University of Santa Barbara: Center for Research in Electronic Art Technology.Google Scholar
- 9. Dey, A., Abowd, G., Salber, D., A Conceptual Framework and a Toolkit for Supporting the Rapid Prototyping of Context-Aware Applications. Journal of Human-Computer Interaction, 2001. 16(2-4): p. 97-166. Google ScholarDigital Library
- 10. Dourish, P., Bly, S., Portholes: Supporting Awareness in a Distributed Work Group, Proc. CHI'92, 1992, 541-547. Google ScholarDigital Library
- 11. Elson, J., Girod, L., Estrin, D., Fine-Grained Network Time Synchronization using Reference Broadcasts, Proc. Fifth Symposium on Operating Systems Design and Implementation (OSDI 2002), 2002, Boston, MA. Google ScholarDigital Library
- 12. Gorbet, M., Orth, M., Ishii, H., Triangles: Tangible Interface for Manipulation and Exploration of Digital Information Topography, Proc. CHI'98 Conference on Human Factors in Computing Systems, 1998, 49-56. Google ScholarDigital Library
- 13. Grudin, J., Partitioning Digital Worlds: Focal and Peripheral Awareness in Multiple Monitor Use, CHI 2001, 2001, 458-465. Google ScholarDigital Library
- 14. Harrison, B., Fishkin, K., Gujar, A., Mochon, C., Want, R., Squeeze Me, Hold Me, Tilt Me! An Exploration of Manipulative User Interfaces, Proc. ACM CHI'98 Conf. on Human Factors in Computing Systems, 1998, 17-24. Google ScholarDigital Library
- 15. Hinckley, K., Distributed and Local Sensing Techniques for Face-to-Face Collaboration, ICMI-PUI'03 Fifth International Conference on Multimodal Interfaces, 2003, Vancouver B.C., Canada. Google ScholarDigital Library
- 16. Hinckley, K., Pierce, J., Sinclair, M., Horvitz, E., Sensing Techniques for Mobile Interaction, ACM UIST 2000 Symp. on User Interface Software & Technology, 2000, 91-100. Google ScholarDigital Library
- 17. Hinckley, K., Sinclair, M., Touch-Sensing Input Devices, ACM CHI'99 Conf. on Human Factors in Computing Systems, 1999, 223-230. Google ScholarDigital Library
- 18. Holmquist, L., Mattern, F., Schiele, B., Alahuhta, P., Beigl, M., Gellersen, H., Smart-Its Friends: A Technique for Users to Easily Establish Connections between Smart Artefacts, Ubicomp 2001, 2001: Springer-Verlag, 116-122. Google ScholarDigital Library
- 19. Horvitz, E., Kadie, C., Paek, T., Hovel, D., Models of Attention in Computing and Communications: From Principles to Applications. Comm. of the ACM, 2003. 46(3). Google ScholarDigital Library
- 20. Jiang, H., Kessler, D., Nonnemaker, J., DEMIS: A Dynamic Event Model for Interactive Systems, Proc. ACM Symposium on Virtual Reality Software and Technology (VRST 2002). Google ScholarDigital Library
- 21. Johanson, B., Fox, A., The Event Heap: A Coordination Infrastructure for Interactive Workspaces, Proc. of the 4th IEEE Workshop on Mobile Computer Systems and Applications (WMCSA-2002), 2002, Callicoon, New York. Google ScholarDigital Library
- 22. Pierce, J., Mahaney, H., Abowd, G., Opportunistic Annexing for Handheld Devices: Opportunities and Challenges, Tech Report #GIT-GVU-03-31, 2003. http://www.cc.gatech.edu/ gvu/research/techreports.html.Google Scholar
- 23. Rekimoto, J., Pick-and-Drop: A Direct Manipulation Technique for Multiple Computer Environments, UIST'97 Symp. on User Interface Software & Technology, 31-39. Google ScholarDigital Library
- 24. Schilit, B.N., Adams, N.I., Want, R., Context-Aware Computing Applications, Proc. IEEE Workshop on Mobile Computing Systems and Applications, 1994, Santa Cruz, CA: IEEE Computer Society, 85-90.Google Scholar
- 25. Tandler, P., Prante, T., Müller-Tomfelde, C., Streitz, N., Steinmetz, R., Connectables: dynamic coupling of displays for the flexible creation of shared workspaces, UIST 2001, 11-20. Google ScholarDigital Library
Index Terms
- Synchronous gestures for multiple persons and computers
Recommendations
HandSense: discriminating different ways of grasping and holding a tangible user interface
TEI '09: Proceedings of the 3rd International Conference on Tangible and Embedded InteractionAs mobile and tangible devices are getting smaller and smaller it is desirable to extend the interaction area to their whole surface area. The HandSense prototype employs capacitive sensors for detecting when it is touched or held against a body part. ...
The UnMousePad: an interpolating multi-touch force-sensing input pad
SIGGRAPH '09: ACM SIGGRAPH 2009 papersRecently, there has been great interest in multi-touch interfaces. Such devices have taken the form of camera-based systems such as Microsoft Surface [de los Reyes et al. 2007] and Perceptive Pixel's FTIR Display [Han 2005] as well as hand-held devices ...
Investigating mid-air gestures and handhelds in motion tracked environments
PerDis '16: Proceedings of the 5th ACM International Symposium on Pervasive DisplaysSmart spaces with multiple interactive devices and motion tracking capabilities are becoming more common. However, there is little research on how interaction with one device affects the usage of other devices in the space. We investigate the effects of ...
Comments