Julia Schwarz
Chris Harrison
ABSTRACT
We present Phone as a Pixel: a scalable, synchronization-free, platform-independent system for creating large, ad-hoc displays from a collection of smaller devices. In contrast to most tiled-display systems, the only requirement for participation is for devices to have an internet connection and a web browser. Thus, most smartphones, tablets, laptops and similar devices can be used. Phone as a Pixel uses a color-transition encoding scheme to identify and locate displays. This approach has several advantages: devices can be arbitrarily arranged (i.e., not in a grid) and infrastructure consists of a single conventional camera. Further, additional devices can join at any time without re-calibration. These are desirable properties to enable collective displays in contexts like sporting events, concerts and political rallies. In this paper we describe our system, show results from proof-of-concept setups, and quantify the performance of our approach on hundreds of displays.
Supplemental Material
- Barker, T., Haeusler, M. H., Maguire, F., and McDermott, J. Investigating political and demographic factors in crowd based interfaces. In Proc. OZCHI '09. 413--416. Google Scholar
Digital Library
- Barkhuus,L. and Jørgensen, T. Engaging the crowd: studies of audience-performer interaction. In Proc. CHI EA '08. 2925--2930. Google ScholarDigital Library
- Blinkendroid Project. http://code.google.com/p/blinkendroidGoogle Scholar
- Borovoy, R. and Knep, B. Junkyard Jumbotron. http://jumbotron.media.mit.eduGoogle Scholar
- Brown, B., O'Hara, L., Kindberg, T., and Williams, A. Crowd computer interaction. In Proc. CHI EA '09. 4755--4758. Google ScholarDigital Library
- Hinckley, K., Ramos, G., Guimbretiere, F., Baudisch, P. and Smith, M. Stitching: pen gestures that span multiple displays. In Proc. AVI '04. 23--31. Google ScholarDigital Library
- LED Throwies. http://graffitiresearchlab.com/projects/ledthrowiesGoogle Scholar
- Lee-Delisle, S. PixelPhones. http://sebleedelisle.com/2011/09/pixelphones-a-huge-display-made-with-smart-phones/.Google Scholar
- Merrill, D., Kalanithi, J., and Maes, P. Siftables: towards sensor network user interfaces. In Proc. TEI '07. 75--78. Google ScholarDigital Library
- Miyaoku, K., Higashino, S., and Tonomura, Y. C-blink: a hue-difference-based light signal marker for large screen interaction via any mobile terminal. In Proc. UIST '04. 147--156. Google ScholarDigital Library
- O'Hara, K., Glancy, M., and Robertshaw, S. Understanding collective play in an urban screen game. In Proc. CSCW '08. 67--76. Google ScholarDigital Library
- Okatani,T. and Deguchi, K. Easy Calibration of a Multi-projector Display System. Int. J. Comput. Vision, 85, 1 (Oct. 2009), pp. 1--18. Google ScholarDigital Library
- Reeves, S., Sherwood, S., and Brown, B. Designing for crowds. In Proc. NordiCHI '10. 393--402. Google ScholarDigital Library
- Sato, M., Hiyama, A., Tanikawa, T. and Hirose, M. Particle Display System - Virtually Perceivable Pixels with Randomly Distributed Physical Pixels. Journal of Information Processing, Vol. 17, 2009, pp. 280--291.Google ScholarCross Ref
- Schmitz, A., Li., M., Schonefeld, V., and Kobbelt, L. Ad-Hoc Multi-Displays for Mobile Interactive Applications. In Proc. Eurographics '10. 45--52.Google Scholar
- Shannon, C. E. Communication in the presence of noise. Proc. Institute of Radio Engineers, 37, 1 (Jan. 1949), pp. 10--21.Google Scholar
- Terrenghi, L., Quigley, A., and Dix, A. A taxonomy for and analysis of multi-person-display ecosystems. Personal Ubiquitous Computing, 13, 8 (Nov. 2009), pp. 583--598. Google ScholarDigital Library
- Welikesmall, Inc. iPod Wall. http://vimeo.com/13404489Google Scholar
- Wolfe, J. M., Kluender, K. R., Levi, D. M., Bartoshuk, L. M, Herz, R. S., Klatzky, R. L., and Lederman, S. J. 2006. Sensation and Perception. Sinauer Associates, Sunderland, MA.Google Scholar
Index Terms
- Phone as a pixel: enabling ad-hoc, large-scale displays using mobile devices
Recommendations
BlueTable: connecting wireless mobile devices on interactive surfaces using vision-based handshaking
GI '07: Proceedings of Graphics Interface 2007Associating and connecting mobile devices for the wireless transfer of data is often a cumbersome process. We present a technique of associating a mobile device to an interactive surface using a combination of computer vision and Bluetooth technologies. ...
Camera phone based motion sensing: interaction techniques, applications and performance study
UIST '06: Proceedings of the 19th annual ACM symposium on User interface software and technologyThis paper presents TinyMotion, a pure software approach for detecting a mobile phone user's hand movement in real time by analyzing image sequences captured by the built-in camera. We present the design and implementation of TinyMotion and several ...
Design Strategies for Efficient Access to Mobile Device Users via Amazon Mechanical Turk
CrowdSenSys '17: Proceedings of the First ACM Workshop on Mobile Crowdsensing Systems and ApplicationsIt is often challenging to access a pool of mobile device users and instruct them to perform an interactive task. Yet such data is often vital to provide design insight at various stages of the design process of a mobile application, service or system. ...
Comments