Niels Henze
Benjamin Poppinga
Susanne Boll
ABSTRACT
Since the introduction of application stores for mobile devices there has been an increasing interest to use this distribution platform to collect user feedback. Mobile application stores can make research prototypes widely available and enable to conduct user studies "in the wild" with participants from all over the world. Previous work published research prototypes to collect qualitative feedback or to collect quantitative attributes of specific prototypes. In this paper we explore how to conduct a study that focuses on a specific task and tries to isolate cause and effect much like controlled experiments in the lab. We compare three visualization techniques for off-screen objects by publishing a game in the Android Market. e.g. we show that the performance of the visualization techniques depends on the number of objects. Using a more realistic task and feedback from a hundred times more participants than previous studies lead to much higher external validity. We conclude that public experiments are a viable tool to complement or replace lab studies.
- P. Baudisch and R. Rosenholtz. Halo: a technique for visualizing off-screen objects. Proc. of CHI, 2003. Google Scholar
Digital Library
- S. Burigat, L. Chittaro, and S. Gabrielli. Visualizing locations of off-screen objects on mobile devices: a comparative evaluation of three approaches. Proc. of MobileHCI, 2006. Google ScholarDigital Library
- S. Gustafson, P. Baudisch, C. Gutwin, and P. Irani. Wedge: clutter-free visualization of off-screen locations. Proc. of CHI, 2008. Google ScholarDigital Library
- N. Henze and S. Boll. Push the study to the app store: Evaluating off-screen visualizations for maps in the android market. Proc. of MobileHCI, 2010. Google ScholarDigital Library
- J. Kjeldskov and C. Graham. A review of mobile hci research methods. Proc. of Mobile HCI, 2003.Google ScholarCross Ref
- R. Kohavi, R. Henne, and D. Sommerfield. Practical guide to controlled experiments on the web: listen to your customers not to the hippo. Proc. of SIGKDD, 2007. Google ScholarDigital Library
- J. Looser, A. Cockburn, J. Savage, and N. Christchurch. On the Validity of Using First-Person Shooters for Fitts' Law Studies. Proc. of British HCI, 2005.Google Scholar
- D. McMillan, A. Morrison, O. Brown, M. Hall, and M. Chalmers. Further into the Wild: Running Worldwide Trials of Mobile Systems. Proc. of Pervasive, 2010. Google ScholarDigital Library
- C. M. Nielsen, M. Overgaard, M. B. Pedersen, J. Stage, and S. Stenild. It's worth the hassle!: the added value of evaluating the usability of mobile systems in the field. Proc. of NordiCHI, 2006. Google ScholarDigital Library
- M. Pielot, B. Poppinga, and S. Boll. PocketNavigator: Vibro-Tactile Waypoint Navigation for Everyday Mobile Devices. Proc. of MobileHCI, 2010. Google ScholarDigital Library
- P. T. Zellweger, J. D. Mackinlay, L. Good, M. Stefik, and P. Baudisch. City lights: contextual views in minimal space. Proc. of CHI, 2003. Google ScholarDigital Library
- S. Zhai, P. Kristensson, P. Gong, M. Greiner, S. Peng, L. Liu, and A. Dunnigan. Shapewriter on the iPhone: from the laboratory to the real world. Proc. of CHI, 2009. Google ScholarDigital Library
Index Terms
- Experiments in the wild: public evaluation of off-screen visualizations in the Android market
Recommendations
Push the study to the App store: evaluating off-screen visualizations for maps in the android market
MobileHCI '10: Proceedings of the 12th international conference on Human computer interaction with mobile devices and servicesThe introduction of publicly available application stores for mobile devices enables to publish research prototypes to a wide audience. This distribution channel can be used to conduct studies with participants from all over the world and diverse ...
My App is an Experiment: Experience from User Studies in Mobile App Stores
Experiments are a cornerstone of HCI research. Mobile distribution channels such as Apple's App Store and Google's Android Market have created the opportunity to bring experiments to the end user. Hardly any experience exists on how to conduct such ...
Beyond Google Play: A Large-Scale Comparative Study of Chinese Android App Markets
IMC '18: Proceedings of the Internet Measurement Conference 2018China is one of the largest Android markets in the world. As Chinese users cannot access Google Play to buy and install Android apps, a number of independent app stores have emerged and compete in the Chinese app market. Some of the Chinese app stores ...
Comments