Stephen Intille
ABSTRACT
Ecological Momentary Assessment (EMA) is a method of in situ data collection for assessment of behaviors, states, and contexts. Questions are prompted during everyday life using an individual's mobile device, thereby reducing recall bias and increasing validity over other self-report methods such as retrospective recall. We describe a microinteraction-based EMA method ("micro" EMA, or μEMA) using smartwatches, where all EMA questions can be answered with a quick glance and a tap -- nearly as quickly as checking the time on a watch. A between-subjects, 4-week pilot study was conducted where μEMA on a smartwatch (n=19) was compared with EMA on a phone (n=14). Despite an =8 times increase in the number of interruptions, μEMA had a significantly higher compliance rate, completion rate, and first prompt response rate, and μEMA was perceived as less distracting. The temporal density of data collection possible with μEMA could prove useful in ubiquitous computing studies.
- Oliver Amft, Holger Junker, and Gerhard Troster. 2005. Detection of eating and drinking arm gestures using inertial body-worn sensors. In Proceedings of IEEE Intl Symp on Wearable Comp: 160-163. Google Scholar
Digital Library
- Dan. L. Ashbrook. 2009. Enabling Mobile Microinteractions. Ph.D Dissertation. College of Computing, Georgia Institute of Technology, Atlanta, GA. Google ScholarDigital Library
- Lisa F. Barrett and Daniel J. Barrett. 2001.An introduction to computerized experience sampling in psychology. Soc Sci Comput Rev, 19: 175-185. Google ScholarDigital Library
- Roy. F. Baumeister. 2002. Yielding to temptation: Self-control failure, impulsive purchasing, and consumer behavior. Consumer Research 28: 670-676.Google ScholarCross Ref
- Francis S. Collins and Harold Varmus. 2015. A new initiative on precision medicine. New Eng. J. Med 372: 793-795.Google ScholarCross Ref
- Lorraine R. Collins, Todd B. Kashdan, and Gernot Gollnisch. 2003. The feasibility of using cellular phones to collect ecological momentary assessment data: Application to alcohol consumption. Exp and Clin Psychopharmacology 11: 73-8.Google ScholarCross Ref
- Delphine S. Courvoisier, Michael Eid, and Tanza Lischetzke. 2012. Compliance to a cell phone-based ecological momentary assessment study: The effect of time and personality characteristics. Psychol Assess 24: 713-20.Google ScholarCross Ref
- Deborah Estrin. 2014. Small data, where n=me. Comm. of the ACM 57: 32-34. Google ScholarDigital Library
- Anind K. Dey, Katarzyna Wac, Denzil Ferreira, Kevin Tassini, Jin-Hyuk Hong, and Julian Ramos. 2011. Getting closer: An empirical investigation of the proximity of user to their smart phones. In Proceedings of Intl Conf on Ubiquitous Comput. (UbiComp '11), 163-172. Google ScholarDigital Library
- Genevieve F. Dunton, Eldin Dzubur, Keito Kawabata, Brenda Yanez, Bin Bo, and Stephen Intille. 2014. Development of a smartphone application to measure physical activity using sensor-assisted self-report. Frontiers in Pub Health 2: 88-100.Google Scholar
- Genevieve F. Dunton, Keito Kawabata, Stephen Intille, Jennifer Wolch, and Mary A. Pentz. 2002. Assessing the social and physical contexts of children's leisuretime physical activity: An ecological momentary assessment study. Am J. Health Promot. 26: 135-42.Google ScholarCross Ref
- Denzil Ferreira, Jorge Goncalves, Vassilis Kostakos, Louise Barkhuus, and Anind K. Dey. 2014. Contextual experience sampling of mobile application microusage. In Proceedings of the 16th Intl Conf on HumanComputer Interaction with Mobile Devices & Services (MobileHCI '14), 91-100. Google ScholarDigital Library
- James Fogarty, Andrew J. Ko, Htet Htet Aung, Elspeth Golden, Karen P. Tang, and Scott E. Hudson. 2005. Examining task engagement in sensor-based statistical models of human interruptibility. In Proceedings of the SIGCHI Conf on Human Factors in Comput Sys (CHI '05), 331-340. Google ScholarDigital Library
- Matthew Fuller-Tyszkiewicz, Helen Skouteris, Ben Richardson, Jed Blore, Millicent Holmes, and Jacqueline Mills. 2013. Does the burden of the experience sampling method undermine data quality in state body image research? Body Image 10: 607- 13.Google ScholarCross Ref
- Tony Gillie and Donald Broadbent. 1989. What makes interruptions disruptive A study of length, similarity, and complexity. Psychol Research 50: 243-50.Google ScholarCross Ref
- Louise C. Hawkley, Mary H. Burleson, Gary G. Berntson, and John T. Cacioppo. 2003. Loneliness in everyday life: Cardiovascular activity, psychosocial context, and health behaviors. J Pers Soc Psychol 85: 105-120.Google ScholarCross Ref
- Eric. B. Hekler, Predrag Klasnja, Vicente Traver, and Monique Hendriks. 2013. Realizing effective behavioral management of health: The metamorphosis of behavioral science methods. IEEE Pulse 4: 29 - 34.Google ScholarCross Ref
- Joel M. Hektner, Jennifer A. Schmidt, and Mihaly Csikszentmihalyi.2007. Experience Sampling Method: Measuring the Quality of Everyday Life. SAGE Publications.Google Scholar
- Michael R. Hufford, Alan L. Shields, Saul Shiffman, Jean Paty, and Mark Balabanis. 2002. Reactivity to ecological momentary assessment: An example using undergraduate problem drinkers. Psychol of Addictive Behav 16: 205-11.Google ScholarCross Ref
- IDC Forecasts Worldwide Shipments of Wearables to Surpass 200 Million in 2019. 2015. Retrieved January 10, 016 from https://www.idc.com/getdoc.jsp?containerId=prUS408 46515Google Scholar
- Stephen S. Intille. 2007. Technological innovations enabling automatic, context-sensitive ecological momentary assessment. in The Science of Real-Time Data Capture: Self-Report in Health Research, A. A. Stone, S. Shiffman, A. A. Atienza, and L. Nebeling, Eds: Oxford University Press: 308-337.Google Scholar
- Robert. M. Kaplan and Arthur A. Stone. 2013. Bringing the laboratory and clinic to the community: Mobile technologies for health promotion and disease prevention. Ann Rev of Psychol 64: 471-98.Google ScholarCross Ref
- Ashish Kapoor and Eric Horvitz. 2008. Experience sampling for building predictive user models: A comparative study. In Proceedings of the SIGCHI Conference on Human Factors in Comput Sys (CHI '08), 657-666. Google ScholarDigital Library
- Jinhyuk Kim, Toru Nakamura, Hiroe Kikuchi, Tsukasa Sasaki, and Yoshiharu Yamamoto.2013. Co-variation of depressive mood and locomotor dynamics evaluated by ecological momentary assessment in healthy humans. PloS One, 8 9: e74979.Google ScholarCross Ref
- Nicole Lee. 2015. Moto 360 review: It's the best Android Wear watch, but that isn't saying much. Retrieved March 25, 2016 from https://www.engadget.com/2014/09/12/moto-360-review/Google Scholar
- James R. Lewis. 1995. IBM computer usability satisfaction questionnaires: Psychometric evaluation and instructions for use. Intl J. Human-Computer Interaction 7, 1 (January 1995), 57-78. Google ScholarDigital Library
- Arnold M. Lund. 2001. Measuring usability with the USE questionnaire. STC Usability SIG Newsletter, 8.Google Scholar
- Kristine S. Nagel, James M. Hudson, and Gregory D. Abowd. 2004. Predictors of availability in home life context-mediated communication. In Proceedings of ACM Conf on Computer Supported Cooperative Work (CSCW '04), 497-506. Google ScholarDigital Library
- Wendy J. Nilsen and Misha Pavel. 2013. Moving behavioral theories into the 21st Century: Technological advancements for improving quality of life. IEEE Pulse 4: 25-28.Google ScholarCross Ref
- Pagano Marcello and Kimberlee Gauvreau. 2000. Principles of Biostatistics. Vol. 2. Pacific Grove, CA.Google Scholar
- William T. Riley, Daniel E. Rivera, Audie A. Atienza, Wendy Nilsen, Susannah M. Allison, and Robin Mermelstein. 2011. Health behavior models in the age of mobile interventions: Are our theories up to the task? Transl Behav Med 1: 53-71.Google ScholarCross Ref
- Daniel E. Rivera and Holly B. Jimison. 2013. Systems modeling of behavior change: Two illustrations from optimized interventions for improved health outcomes. IEEE Pulse 4: 41 - 47.Google ScholarCross Ref
- Nillo Saranummi, Donna Spruijt-Metz, Stephen S. Intille, IIkka Korhonen, Wendy J. Nilsen, and Misha Pavel. 2013. Moving the science of behavioral change into the 21st Century: Novel solutions to prevent disease and promote health. IEEE Pulse 4: 22-24.Google ScholarCross Ref
- Fuschia Serre, Melina Fatseas, Romain Debrabant, Jean-Marc Alexandre, Marc Auriacombe, and Joel Swendsen. 2012. Ecological momentary assessment in alcohol, tobacco, cannabis and opiate dependence: A comparison of feasibility and validity. Drug Alcohol Dependence 126: 118-23.Google ScholarCross Ref
- Saul Shiffman and Arthur A. Stone. 1998. Ecological momentary assessment in health psychology. Health Psychol 17: 3-5.Google ScholarCross Ref
- Saul Shiffman, Arthur A. Stone, and Michael R. Hufford. 2002. Ecological momentary assessment. Ann Rev Clinical Psychol, 4: 1-32.Google ScholarCross Ref
- Joshua M. Smyth and Arthur A. Stone. 2003. Ecological momentary assessment research in behavioral medicine. Happiness Studies 4: 35-52.Google ScholarCross Ref
- Cheri Speier, Iris Vessey, and Joseph S. Valacich. 2003. The effects of interruptions, task complexity, and information presentation on computer-supported decision-making performance. Decision Sciences 34: 771-797.Google ScholarCross Ref
- Cheri Speier, Joseph S. Valacich, and Iris Vessey. 1999. The influence of task interruption on individual decision making: An information overload perspective. Decision Sciences 30: 337- 360.Google ScholarCross Ref
- Bonnie Spring, Marientina Gotsis, Ana Paiva, and Donna Spruijt-Metz. 2013. Healthy apps: Mobile devices for continuous monitoring and intervention. IEEE Pulse 4: 34-40.Google ScholarCross Ref
- Donna Spruijt-Metz and Wendy Nilsen. 2014. Dynamic models of behavior for just-in-time adaptive interventions. Pervasive Comp, IEEE 13: 13-17.Google ScholarCross Ref
- Donna Spruijt-Metz, Eric Hekler, Niilo Saranummi, Stephen Intille, IIkka Korhonen, Wendy Nilsen, Daniel Rivera, Bonnie Spring, S. Michie, D. Asch, A. Sanna, V. Salcedo, R. Kukakfa, and Misha Pavel. 2015. Building new computational models to support health behavior change and maintenance: New opportunities in behavioral research. Transl Beh Med: 1-12.Google Scholar
- Donna Spruijt-Metz, Wendy Nilsen, and Misha Pavel. 2015. mHealth for behavior change and monitoring. In mHealth Multidisciplinary Verticals, S. Adibi, Ed. Boca Raton, FL: CRC Press, 120-32.Google Scholar
- Arthur A. Stone and Saul Shiffman. 1994. Ecological momentary assessment (EMA) in behavioral medicine. Annals of Beh Med 16: 199-202.Google ScholarCross Ref
- Arthur A. Stone, Saul Shiffman, Audie A. Atienza, and Linda Nebeling, Eds. 2007. The Science of Real-Time Data Capture: Self-Report in Health Research. New York, NY: Oxford University Press.Google Scholar
- Arthur A. Stone, Saul Shiffman, Audie A. Atienza, and Linda Nebeling. 2007. Historical roots and rationale of ecological momentary assessment (EMA). The Science of Real-Time Data Capture: Self-Reports in Health Research. A. A. Stone, S. Shiffman, A. A. Atienza, and L. Nebeling, Eds., New York, NY: Oxford University Press: 3-10.Google Scholar
- Qu Tang, Damon J. Vidrine, Eric Crowder, and Stephen S. Intille. 2014. Automated detection of puffing and smoking with wrist accelerometers. In Proceedings of the 8th Intl Conf on Pervasive Comput Tech for Healthcare (PervasiveHealth '14), 80-87. Google ScholarDigital Library
- Janko Timmermann, Wilko Heuten, Susanne Boll. 2015. Input methods for Brog-RPE-scale on smartwatches. In Proceedings of Intl Conf on Pervasive Comp Tech for Healthcare (PervasiveHealth'15), 80-83. Google ScholarDigital Library
- Khai N. Truong, Thariq Shihipar, and Daniel J. Wigdor. 2014. Slide to X: unlocking the potential of smartphone unlocking. In Proceedings of the SIGCHI Conf on Human Factors in Comput Sys (CHI '14). ACM, New York, NY, USA, 3635-3644. Google ScholarDigital Library
- Erin I. Walsh and Jay K. Brinker. 2016. Should participants be given a mobile phone, or use their own? Effects of novelty vs utility. Telematics and Informatics 33 1, 25-33. Google ScholarDigital Library
- David Watson, Lee A. Clark, and Auke Tellegen. Development and validation of brief measures of positive and negative affect: the PANAS scales. J. Pers Soc Psychol 54: 1063-70.Google Scholar
Index Terms
- μEMA: Microinteraction-based ecological momentary assessment (EMA) using a smartwatch
Recommendations
Contextual Biases in Microinteraction Ecological Momentary Assessment (μEMA) Non-response
Ecological momentary assessment (EMA) is used to gather in-situ self-report on behaviors using mobile devices. Microinteraction EMA (μEMA), is a type of EMA where each survey is only one single question that can be answered with a glanceable ...
Wearable ESM: differences in the experience sampling method across wearable devices
MobileHCI '16: Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and ServicesThe Experience Sampling Method is widely used for collecting self-report responses from people in natural settings. While most traditional approaches rely on using a phone to trigger prompts and record information, wearable devices now offer new ...
Microinteraction Ecological Momentary Assessment Response Rates: Effect of Microinteractions or the Smartwatch?
Mobile-based ecological-momentary-assessment (EMA) is an in-situ measurement methodology where an electronic device prompts a person to answer questions of research interest. EMA has a key limitation: interruption burden. Microinteraction-EMA(µEMA) may ...
Comments