Sebastian Boring
Sven Gehring
Johannes Schöning
ABSTRACT
The increasing number of media facades in urban spaces offers great potential for new forms of interaction especially for collaborative multi-user scenarios. In this paper, we present a way to directly interact with them through live video on mobile devices. We extend the Touch Projector interface to accommodate multiple users by showing individual content on the mobile display that would otherwise clutter the facade's canvas or distract other users. To demonstrate our concept, we built two collaborative multi-user applications: (1) painting on the facade and (2) solving a 15-puzzle. We gathered informal feedback during the ARS Electronica Festival in Linz, Austria and found that our interaction technique is (1) considered easy-to-learn, but (2) may leave users unaware of the actions of others.
Supplemental Material
- 1. Ballagas, R., Borchers, J., Rohs, M., Sheridan, J.G. (2006). The Smart Phone: A Ubiquitous Input Device. IEEE Pervasive Computing 5, 1 (2006), 70--77. Google Scholar
Digital Library
- 2. Boring, S., Jurmu, M., Butz, A. (2009). Scroll, tilt or move it: using mobile phones to continuously control pointers on large public displays. Proc. OzCHI 2009, ACM Press (2009), 161--168. Google ScholarDigital Library
- 3. Boring, S., Baur, D., Butz, A., Gustafson, S., Baudisch, P. (2010). Touch projector: mobile interaction through video. Proc. CHI 2010, ACM Press (2010), 2287--2296. Google ScholarDigital Library
- 4. Borries, F., Walz, S., Böttger, M. (2007). Space Time Play: Computer Games, Architecture and Urbanism: The Next Level, Birkhäuser, Basel, 2007, 396--397.Google Scholar
- 5. Dalsgaard, P., Halskov, K. (2010). Designing Urban Media Facades: Cases and Challenges. Proc. CHI'10, ACM Press (2010), 2277--2286. Google ScholarDigital Library
- 6. Häusler M.H. (2009). Media Facades: History, Technology, Content. Av Edition, Ludwigsburg, 2009.Google Scholar
- 7. Pears, N., Jackson, D.G., Olivier, P. (2009). Smart Phone Interaction with Registered Displays. IEEE Pervasive Computing 8, 2 (2009), 14--21. Google ScholarDigital Library
- 8. Peltonen, P., Salovaara, A., Jacucci, G., Ilmonen, T., Ardito, C., Saarikko, P., Batra, V. (2007). Extending large-scale event participation with user-created mobile media on a public display. Proc. MUM '07, ACM (2007), 131--138. Google ScholarDigital Library
- 9. Scheible, J., Ojala, T. (2009). MobiSpray: mobile phone as virtual spray can for painting BIG anytime anywhere on anything. Proc. SIGGRAPH '09, ACM Press, 332--341. Google ScholarDigital Library
- 10. Schoch, O. (2006). My Building is my Display, Proc. eCAADe '06, 2006, 610--616.Google Scholar
- 11. Seitinger, S., Perry, D.S., Mitchell, W.J. (2009) Urban Pixels: Painting the City with Light. Proc. CHI 2009, 839--84. Google ScholarDigital Library
- 12. Sommerer, C., Jain, L., Mignonneau, L. (2008). Media Facades as Architectural Interfaces. The Art and Science of Interface and Interaction Design, Springer, 2008, 93--10.Google ScholarCross Ref
- 13. Struppek, M. (2006). The social potential of Urban Screens, Visual Communication 5, 2, 2006; 173--188.Google ScholarCross Ref
- 14. Tani, M., Yamashi, K., Tanikoshi, K., Futakawa, M., Tanifuji, S. (1992). Object-oriented video: interaction with real-world objects through live video. Proc. CHI 1992, ACM Press (1992), 593--598.. Google ScholarDigital Library
Index Terms
- Multi-user interaction on media facades through live video on mobile devices
Recommendations
Multi-user interaction using handheld projectors
UIST '07: Proceedings of the 20th annual ACM symposium on User interface software and technologyRecent research on handheld projector interaction has expanded the display and interaction space of handheld devices by projecting information onto the physical environment around the user, but has mainly focused on single-user scenarios. We extend this ...
Designing urban media façades: cases and challenges
CHI '10: Proceedings of the SIGCHI Conference on Human Factors in Computing SystemsMedia façades comprise a category of urban computing concerned with the integration of displays into the built environment, including buildings and street furniture. This paper identifies and discusses eight challenges faced when designing urban media ...
Touch projector: mobile interaction through video
CHI '10: Proceedings of the SIGCHI Conference on Human Factors in Computing SystemsIn 1992, Tani et al. proposed remotely operating machines in a factory by manipulating a live video image on a computer screen. In this paper we revisit this metaphor and investigate its suitability for mobile use. We present Touch Projector, a system ...
Comments