Jon Froehlich
Mike Y. Chen
Sunny Consolvo
James A. Landay
ABSTRACT
This paper presents MyExperience, a system for capturing both objective and subjective in situ data on mobile computing activities. MyExperience combines the following two techniques: 1) passive logging of device usage, user context, and environmental sensor readings, and 2) active context-triggered user experience sampling to collect in situ, subjective user feedback. MyExperience currently runs on mobile phones and supports logging of more than 140 event types, including: 1) device usage such as communication, application usage, and media capture, 2) user context such as calendar appointments, and 3) environmental sensing such as Bluetooth and GPS. In addition, user experience sampling can be targeted to moments of interest by triggering off sensor readings. We present several case studies of field deployments on people's personal phones to demonstrate how MyExperience can be used effectively to understand how people use and experience mobile technology.
- Barrett, L.F. and Barrett, D.J. An Introduction to Computerized Experience Sampling. Psychology. Social Science Computer Review., V. 19, No. 2, S01, pp. 175--185. Google Scholar
Digital Library
- Barkhuus, L. Why everyone loves to text message: social management with SMS. (Poster). In Proceedings of GROUP '05 (Sanibel Island, FL, USA, Nov., 2005). Google ScholarDigital Library
- Carter, S., J. Mankoff, and J. Heer. Momento: Support for Situated Ubicomp Experimentation. In Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI 2007), To appear. 2007. Google ScholarDigital Library
- Chen, M., Sohn, T., Chmelev, D., et al. Practical Metropolitan--Scale Positioning for GSM Phones. In Proc of Ubicomp 2006, Orange County, California, 2006. Google ScholarDigital Library
- Consolvo, S. and Walker, M. Using the Experience Sampling Method to Evaluate Ubicomp Applications. IEEE Pervasive Computing Mobile and Ubiquitous Systems: The Human Experience, Vol. 2, No. 2 (Apr--Jun 2003), pp. 24--31. Google ScholarDigital Library
- Consolvo, S., Harrison, B., Smith, I., Chen, M., Everitt, K., Froehlich, J., and Landay, J. Conducting In situ Evaluations for and with Ubiquitous Computing Technologies. Intl Journal of HCI, 22(1), 107--122, 2007 (to appear)Google Scholar
- Csikszentmihalyhi, M. and Larson, R. Validity and Reliability of the Experience--Sampling Method. Journal of Nervous and Mental Disease, 1987, 175:526--536.Google ScholarCross Ref
- Demumieux, R. and Losquin, P. Gather customer's real usage on mobile phones. Proc. Intl. Conf. Human Computer Interaction with Mobile Devices & Services (MobileHCI 2005), pp. 267--270. Google ScholarDigital Library
- Eagle, N. and Pentland, A. Social Serendipity: Mobilizing Social Software. IEEE Pervasive Computing, vol. 04, no. 2, pp. 28--34, April--June, 2005. Google ScholarDigital Library
- Froehlich, J., Chen, M., Smith, I., and Potter, F. Voting With Your Feet: An Investigative Study of the Relationship Between Place Visit Behavior and Preference. Proceedings of Ubicomp 2006, Orange County, California, 2006. Google ScholarDigital Library
- Gemmell, J., Williams, L., Wood, K., Lueder, R., and Bell, G. Passive capture and ensuing issues for a personal lifetime store. In Proc of the 1st ACM Workshop on Continuous Archival and Retrieval of Personal Experiences (New York, New York, USA, October 15--15, 2004). Google ScholarDigital Library
- Grinter, R. E.; Eldridge, M. Y do tngrs luv 2 txt msg? In Proc ECSCW 2001, September 16--20; Bonn, Germany. Kluwer; 2001; 219--238. Google ScholarDigital Library
- Häkkilä, J. and Chatfield, C. 2005. 'It's like if you opened someone else's letter': user perceived privacy and social practices with SMS communication. In Proc. of the 7th Conference on HCI w/Mobile Devices & Services (Salzburg, Austria, September, 2005). MobileHCI '05. Google ScholarDigital Library
- Harle, R. K. and Hopper, A. 2005. Deploying and evaluating a location--aware system. In Proc. of the 3rd international Conference on Mobile Systems, Applications, and Services (Seattle, WA, June, 2005). Mobisys 2005. Google ScholarDigital Library
- ter Hofte, Otte, R., Peddemors, A., Mulder, I., What's Your Lab Doing in My Pocket? Supporting Mobile Field Studies with SocioXensor. (Demonstration) CSCW2006 Conference Supplement, Nov. 4--8, 2006, Banff, Alberta, Canada.Google Scholar
- Intille, S. S., Rondoni, J., Kukla, C., Ancona, I., and Bao, L. A context--aware experience sampling tool. In CHI '03 Extended Abstracts (Ft. Lauderdale, Florida, USA, April 05--10, 2003). CHI '03. ACM Press, New York, NY, 972--973. Google ScholarDigital Library
- Isomursu, M., Kuutti, K., and Väinämö, S. Experience clip: method for user participation and evaluation of mobile concepts. In Proc. of the 8th Conference on Participatory Design: Artful integration: interweaving Media, Materials and Practices, Volume 1. Google ScholarDigital Library
- Kellar, M., Reilly, D., Hawkey, K., Rodgers, M., MacKay, B., Dearman, D., Ha, V., MacInnes, W. J., Nunes, M., Parker, K., Whalen, T., and Inkpen, K. M. It's a jungle out there: practical considerations for evaluation in the city. In CHI '05 Extended Abstracts (Portland, OR, USA, April 02--07, 2005). Google ScholarDigital Library
- Kjeldskov, J. and Graham, C. A review of Mobile HCI Research Methods. In Proceedings of Mobile HCI 2003, Springer--Verlag, LNCS 2795, 2003, 317--335.Google ScholarCross Ref
- Kotz, D. and Essien, K. Analysis of a campus--wide wireless network. In Proc. of the 8th Annual international Conference on Mobile Computing and Networking (Atlanta, Georgia, USA, September, 2002). MobiCom '02. Google ScholarDigital Library
- LaMarca A., Chawathe Y., Consolvo S., et al. Place Lab: Device Positioning Using Radio Beacons in the Wild. In Proc Pervasive'05, Munich, Germany. Google ScholarDigital Library
- Lester, J., Choudhury, T., and Borriello, G. A Practical Approach to Recognizing Physical Activities. In Proc of Pervasive 2006, May. 7, 2006 Google ScholarDigital Library
- Mankoff, J. and Carter, S. Crossing Qualitative and Quantitative Evaluation in the Domain of Ubiquitous Computing. Presented at the CHI 2005 Workshop on Usage Analysis: Combining logging and qualitative methods. Portland, OR, April 2005.Google Scholar
- Myers, B., Hudson, S. E., and Pausch, R. Past, present, and future of user interface software tools. ACM Trans. Computer.-Hum. Interact. 7, 1 (Mar. 2000), 3--28. Google ScholarDigital Library
- Nicholson, A. J., Chawathe, Y., Chen, M. Y., Noble, B. D., and Wetherall, D. Improved access point selection. In Proc. of the 4th international Conference of MobiSys 2006. (Uppsala, Sweden, June 19--22, 2006). Google ScholarDigital Library
- Palen, L. and Salzman, M. Voice--mail diary studies for naturalistic data capture under mobile conditions. In Proceedings of the CSCW 2002 (New Orleans, Louisiana, USA, November 16--20, 2002). Google ScholarDigital Library
- Patel, S.N., Kientz, J.A., Hayes, G.R., Bhat, S., and Abowd, G.D. Farther Than You May Think: An Empirical Investigation of the Proximity of Users to their Mobile Phones. In Proceedings of Ubicomp 2006, Orange County, California, 2006. Google ScholarDigital Library
- Raento, M.; Oulasvirta, A.; Petit, R.; Toivonen, H., ContextPhone: a prototyping platform for context--aware mobile applications. Pervasive Computing, IEEE, vol.4, no.2, pp. 51--59, Jan.-March 2005 Google ScholarDigital Library
- Rieman, J. The diary study: a workplace--oriented research tool to guide laboratory efforts. In Proceedings of CHI '93. (Amsterdam, The Netherlands, April 24--29, 1993). Google ScholarDigital Library
- Salovaara, A., Oulasvirta, A., and Jacucci, G. "The panopticon": a method for observing inter--group interactions. In CHI'06 Workshop on Reality TestingGoogle Scholar
- Schusteritsch, R., Rao, S., and Rodden, K. Mobile search with text messages: designing the user experience for Google SMS. In CHI '05 Extended Abstracts (Portland, OR, USA, April, 2005). CHI '05. Google ScholarDigital Library
- Tilkidjieva, D., Banerjee, N., Kazandjieva, M., Rollins, S., and Corner, M. LLAMA: An Adaptive Strategy for Performing Background Tasks on Mobile Devices. (Poster/Demo) at HotMobile '06, Semiahmoo, WA, 2006. Google ScholarDigital Library
- Verbowski, C. et al. Flight Data Recorder: Always--on Tracing and Scalable Analysis of Persistent State Interactions to Improve Systems and Security Management. In Proc. of OSDI 06. Seattle, WA, 2006. Google ScholarDigital Library
- Yoon, J., Noble, B. D., Liu, M., and Kim, M. Building realistic mobility models from coarse--grained traces. In Proceedings of the 4th international Conference on Mobile Systems, Applications and Services (Uppsala, Sweden, June 19--22, 2006). MobiSys 2006. Google ScholarDigital Library
- Zerfos, P., Meng, X., Wong, S. H., Samanta, V., and Lu, S. A study of the short message service of a nationwide cellular network. Proc. of 6th ACM SIGCOMM on Internet Measurement (Rio de Janeriro, Brazil, Oct, 2006). IMC '06. Google ScholarDigital Library
- Zhou, C., Ludford, P., Frankowski, D., and Terveen, L. An Experiment in Discovering Personally Meaningful Places from Location Data. In Extended Abstracts CHI 2005. Google ScholarDigital Library
Index Terms
- MyExperience: a system for in situ tracing and capturing of user feedback on mobile phones
Recommendations
Increasing the breadth: applying sensors, inference and self-report in field studies with the MyExperience tool
MobiEval '07: Proceedings of the 1st international workshop on System evaluation for mobile platformsIn this talk, we describe how the MyExperience tool uses sensing, machine inference, and self-report to gather information about human attitudes, behaviors, and mobile device usage. To illustrate this, we focus on four field studies that leverage ...
TinyBlackBox: Supporting Mobile In-The-Wild Studies
ASSETS '15: Proceedings of the 17th International ACM SIGACCESS Conference on Computers & AccessibilityMost work investigating mobile HCI is carried out within controlled laboratory settings; these spaces are not representative of the real-world environments for which the technology will predominantly be used. The result of which can produce a skewed or ...
Ask, but don't interrupt: the case for interruptibility-aware mobile experience sampling
UbiComp/ISWC'15 Adjunct: Adjunct Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2015 ACM International Symposium on Wearable ComputersThe mobile phone-based Experience Sampling Method (ESM) enables in situ recording of human behaviour and experience by querying users, via their smartphones, anywhere and anytime. Sampling can happen on a previously unimaginable scale, and across a ...
Comments