Karen Church
Denzil Ferreira
Nikola Banovic
ABSTRACT
Driven by curiosity and our own three diverse smartphone application usage datasets, we sought to unpack the nuances of mobile device use by revisiting two recent Mobile HCI studies [1, 17]. Our goal was to add to our broader understanding of smartphone usage by investigating if differences in mobile device usage occurred not only across our three datasets, but also in relation to prior work. We found differences in the top-10 apps in each dataset, in the durations and types of interactions as well as in micro-usage patterns. However, it proved very challenging to attribute such differences to a specific factor or set of factors: was it the time frame in which the studies were executed? The recruitment procedure? The experimental method? Using our somewhat troubled analysis, we discuss the challenges and issues of conducting mobile research of this nature and reflect on caveats related to the replicability and generalizability of such work.
- Banovic, N., Brant, C., Mankoff, J., and Dey, A. Proactivetasks: The short of mobile device use sessions. In Proceedings of MobileHCI '14, ACM (2014), 243--252. Google Scholar
Digital Library
- Bentley, F. R., and Metcalf, C. J. Location and activity sharing in everyday mobile communication. In CHI '08 Extended Abstracts, ACM (2008), 2453--2462. Google ScholarDigital Library
- Böhmer, M., Hecht, B., Schöning, J., Krüger, A., and Bauer, G. Falling asleep with angry birds, facebook and kindle: a large scale study on mobile application usage. In Proceedings of Mobile HCI'11, ACM (2011), 47--56. Google ScholarDigital Library
- Brandt, J., Weiss, N., and Klemmer, S. R. Txt 4 l8r: Lowering the burden for diary studies under mobile conditions. In CHI '07 Extended Abstracts, ACM (2007), 2303--2308. Google ScholarDigital Library
- Brown, B., McGregor, M., and McMillan, D. 100 days of iphone use: Understanding the details of mobile device use. In Proceedings of the MobileHCI '14, ACM (2014), 223--232. Google ScholarDigital Library
- Carrascal, J. P., and Church, K. An in-situ study of mobile app & mobile search interactions. In Proceedings of CHI '15, ACM (2015), 2739--2748. Google ScholarDigital Library
- Carter, S., Mankoff, J., and Heer, J. Momento: support for situated ubicomp experimentation. In Proceedings of CHI '07, ACM (2007), 125--134. Google ScholarDigital Library
- Cherubini, M., and Oliver, N. A refined experience sampling method to capture mobile user experience. In International Workshop on Mobile User Experience Research held at CHI '09 (2009).Google Scholar
- Church, K., Cherubini, M., and Oliver, N. A large-scale study of daily information needs captured in situ. In Transactions on Human-Computer Interaction (TOCHI) 21, 2 (2014), 10. Google ScholarDigital Library
- Consolvo, S., and Walker, M. Using the experience sampling method to evaluate ubicomp applications. IEEE Pervasive Computing 2, 2 (4 2003), 24--31. Google ScholarDigital Library
- Dearman, D., and Truong, K. Evaluating the implicit acquisition of second language vocabulary using a live wallpaper. In Proceedings of CHI '12, ACM (2012), 1391--1400. Google ScholarDigital Library
- Do, T. M. T., Blom, J., and Gatica-Perez, D. Smartphone usage in the wild: A large-scale analysis of applications and context. In Proceedings of the ICMI'11, ACM (2011), 353--360. Google ScholarDigital Library
- Drummond, C. Replicability is not reproducibility: nor is it good science. In Proceedings of the Evaluation Methods for Machine Learning Workshop at ICML (2009).Google Scholar
- Falaki, H., Mahajan, R., Kandula, S., Lymberopoulos, D., Govindan, R., and Estrin, D. Diversity in smartphone usage. In Proceedings of MobiSys '10, ACM (2010), 179--194. Google ScholarDigital Library
- Ferreira, D., Dey, A. K., and Kostakos, V. Understanding human-smartphone concerns: a study of battery life. In Pervasive Computing, Springer-Verlag (Berlin, Heidelberg, 2011), 19--33. Google ScholarDigital Library
- Ferreira, D., Ferreira, E., Goncalves, J., Kostakos, V., and Dey, A. K. Revisiting human-battery interaction with an interactive battery interface. In Proceedings of Ubicomp '13, ACM (2013), 563--572. Google ScholarDigital Library
- Ferreira, D., Goncalves, J., Kostakos, V., Barkhuus, L., and Dey, A. K. Contextual experience sampling of mobile application micro-usage. In Proceedings of MobileHCI '14, ACM (2014), 91--100. Google ScholarDigital Library
- Ferreira, D., Kostakos, V., Beresford, A. R., Janne, L., and Dey, A. K. Securacy: An empirical investigation of android applications? network usage, privacy and security. In Proceedings of the 8th ACM Conference on Security and Privacy in Wireless and Mobile Networks (WiSec) (2015). Google ScholarDigital Library
- Ferreira, D., Kostakos, V., and Dey, A. K. Lessons learned from large-scale user studies: Using android market as a source of data. International Journal of Mobile Human Computer Interaction 4, 3 (1 2012), 28--43. Google ScholarDigital Library
- Ferreira, D., Kostakos, V., and Dey, A. K. Aware: mobile context instrumentation framework. Frontiers in ICT 2, 6 (2015).Google ScholarCross Ref
- Fischer, J. E. Experience-sampling tools: a critical review. Mobile Living Labs 9 (2009), 1--3.Google Scholar
- Froehlich, J., Chen, M. Y., Consolvo, S., Harrison, B., and Landay, J. A. MyExperience: a system for in situ tracing and capturing of user feedback on mobile phones. In Proceedings of the 5th international conference on Mobile systems, applications and services, ACM (2007), 57--70. Google ScholarDigital Library
- Henze, N., Pielot, M., Poppinga, B., Schinke, T., and Boll, S. My app is an experiment: Experience from user studies. Developments in Technologies for Human-Centric Mobile Computing and Applications (2012), 294.Google Scholar
- Intille, S. S., Rondoni, J., Kukla, C., Ancona, I., and Bao, L. A context-aware experience sampling tool. In CHI '03 Extended Abstracts, ACM (2003), 972--973. Google ScholarDigital Library
- Kamisaka, D., Muramatsu, S., Yokoyama, H., and Iwamoto, T. Operation prediction for context-aware user interfaces of mobile phones. SAINT'09. Ninth Annual International Symposium on Applications and the Internet (2009), 16--22. Google ScholarDigital Library
- Lee, U., Lee, J., Ko, M., Lee, C., Kim, Y., Yang, S., Yatani, K., Gweon, G., Chung, K.-M. . M., and Song, J. Hooked on smartphones: An exploratory study on smartphone overuse among college students. In Proceedings of CHI '14, ACM (2014), 2327--2336. Google ScholarDigital Library
- McMillan, D., Morrison, A., Brown, O., Hall, M., and Chalmers, M. Further into the Wild: Running Worldwide Trials of Mobile Systems. Springer Berlin Heidelberg, 2010, 210--227. Google ScholarDigital Library
- Oulasvirta, A., Rattenbury, T., Ma, L., and Raita, E. Habits make smartphone use more pervasive. Personal and Ubiquitous Computing 16, 1 (1 2012), 105--114. Google ScholarDigital Library
- Palen, L., and Salzman, M. Voice-mail diary studies for naturalistic data capture under mobile conditions. In Proceedings of CSCW '02, ACM (2002), 87--95. Google ScholarDigital Library
- Pejovic, V., and Musolesi, M. Interruptme: Designing intelligent prompting mechanisms for pervasive applications. In Proceedings of the UbiComp '14, ACM (2014), 897--908. Google ScholarDigital Library
- Pielot, M. Large-scale evaluation of call-availability prediction. In Proceedings of UbiComp '14, ACM (2014), 933--937. Google ScholarDigital Library
- Pielot, M., Church, K., and de Oliveira, R. An in-situ study of mobile phone notifications. In Proceedings of MobileHCI '14, ACM (2014), 233--242. Google ScholarDigital Library
- Rachuri, K. K., Musolesi, M., Mascolo, C., Rentfrow, P. J., Longworth, C., and Aucinas, A. Emotionsense: a mobile phones based adaptive platform for experimental social psychology research. In Proceedings of UbiComp '10, ACM (2010), 281--290. Google ScholarDigital Library
- Raento, M., Oulasvirta, A., Petit, R., and Toivonen, H. Contextphone: A prototyping platform for context-aware mobile applications. IEEE Pervasive Computing 4, 2 (4 2005), 51--59. Google ScholarDigital Library
- Rahmati, A., and Zhong, L. Studying smartphone usage: Lessons from a four-month field study.Google Scholar
- Ramanathan, N., Alquaddoomi, F., Falaki, H., George, D., Hsieh, C., Jenkins, J., Ketcham, C., Longstaff, B., Ooms, J., Selsky, J., Tangmunarunkit, H., and Estrin, D. ohmage: An open mobile system for activity and experience sampling. In PervasiveHealth, IEEE (2012), 203--204.Google ScholarCross Ref
- Shepard, C., Rahmati, A., Tossell, C., Zhong, L., and Kortum, P. Livelab: Measuring wireless networks and smartphone users in the field. ACM SIGMETRICS Performance Evaluation Review 38, 3 (2011). Google ScholarDigital Library
- Shin, C., Hong, J.-H. . H., and Dey, A. K. Understanding and prediction of mobile application usage for smart phones. In Proceedings of UbiComp '12, ACM (2012), 173--182. Google ScholarDigital Library
- Srinivasan, V., Moghaddam, S., Mukherji, A., Rachuri, K. K., Xu, C., and Tapia, E. M. Mobileminer: Mining your frequent patterns on your phone. In Proceedings of UbiComp '14, ACM (2014), 389--400. Google ScholarDigital Library
- Truong, K. N., Shihipar, T., and Wigdor, D. J. Slide to x: unlocking the potential of smartphone unlocking. In Proceedings of CHI '14, ACM (2014), 3635--3644. Google ScholarDigital Library
- Vaish, R., Wyngarden, K., Chen, J., Cheung, B., and Bernstein, M. S. Twitch crowdsourcing: crowd contributions in short bursts of time. In Proceedings of CHI '14, ACM (2014), 3645--3654. Google ScholarDigital Library
- Vastenburg, M. H., and Herrera, N. R. Adaptive experience sampling: addressing the dynamic nature of in-situ user studies. In Ambient Intelligence and Future Trends-International Symposium on Ambient Intelligence (ISAmI 2010), Springer (2010), 197--200.Google ScholarCross Ref
- Vetek, A., Flanagan, J. A., Colley, A., and Keränen, T. Smartactions: Context-aware mobile phone shortcuts. In Proceedings of INTERACT '09, Springer-Verlag (2009), 796--799. Google ScholarDigital Library
- Wagner, D. T., Rice, A., and Beresford, A. R. Device analyzer: Large-scale mobile data collection. SIGMETRICS Performance Evaluation Review 41, 4 (4 2014), 53--56. Google ScholarDigital Library
- Yan, T., Chu, D., Ganesan, D., Kansal, A., and Liu, J. Fast app launching for mobile devices using predictive user context. In Proceedings of MobiSys '12 (6 2012), 113--126. Google ScholarDigital Library
- Zhang, C., Ding, X., Chen, G., Huang, K., Ma, X., and Yan, B. Nihao: A Predictive Smartphone Application Launcher. Springer Berlin Heidelberg, 2013, 294--313.Google Scholar
Index Terms
- Understanding the Challenges of Mobile Phone Usage Data
Recommendations
A Large-Scale Study of iPhone App Launch Behaviour
CHI '18: Proceedings of the 2018 CHI Conference on Human Factors in Computing SystemsThere have been many large-scale investigations of users' mobile app launch behaviour, but all have been conducted on Android, even though recent reports suggest iPhones account for a third of all smartphones in use. We report on the first large-scale ...
Mobile Phone Usage Patterns, Security Concerns, and Security Practices of Digital Generation
As the digital generations have grown up with high-tech gadgets and become avid users of mobile phones and apps, they are also exposed to increasing mobile security threats and vulnerability. In this paper the authors discuss the impact of recent mobile ...
Emerging research methods for understanding mobile technology use
OZCHI '05: Proceedings of the 17th Australia conference on Computer-Human Interaction: Citizens Online: Considerations for Today and the FutureMobile devices, applications and services have become integrated into people's daily lives on a personal and professional level. Although traditional research methods are being used to understand the use of mobile devices and applications, methodological ...
Comments