Edison Thomaz
Gabriel Reyes
Irfan Essa
ABSTRACT
Activity recognition in the home has been long recognized as the foundation for many desirable applications in fields such as home automation, sustainability, and healthcare. However, building a practical home activity monitoring system remains a challenge. Striking a balance between cost, privacy, ease of installation and scalability continues to be an elusive goal. In this paper, we explore infrastructure-mediated sensing combined with a vector space model learning approach as the basis of an activity recognition system for the home. We examine the performance of our single-sensor water-based system in recognizing eleven high-level activities in the kitchen and bathroom, such as cooking and shaving. Results from two studies show that our system can estimate activities with overall accuracy of 82.69% for one individual and 70.11% for a group of 23 participants. As far as we know, our work is the first to employ infrastructure-mediated sensing for inferring high-level human activities in a home setting.
- L. Atallah and G. Yang. The use of pervasive sensing for behaviour profiling --- a survey. Pervasive and Mobile Computing, (5):447--464, 2009. Google Scholar
Digital Library
- G. Cohn, S. Gupta, J. Froehlich, E. Larson, and S. Patel. GasSense: Appliance-level, single-point sensing of gas activity in the home. Pervasive Computing, pages 265--282, 2010. Google ScholarDigital Library
- J. Fogarty, C. Au, and S. E. Hudson. Sensing from the basement: a feasibility study of unobtrusive and low-cost home activity recognition. In UIST '06: Proceedings of the 19th annual ACM symposium on User interface software and technology. ACM Request Permissions, Oct. 2006. Google ScholarDigital Library
- J. Froehlich, E. Larson, T. Campbell, C. Haggerty, J. Fogarty, and S. Patel. HydroSense: infrastructure-mediated single-point sensing of whole-home water activity. Proceedings of the 11th international conference on Ubiquitous computing, pages 235--244, 2009. Google ScholarDigital Library
- J. Froehlich, E. Larson, E. Saba, T. Campbell, L. Atlas, J. Fogarty, and S. Patel. A Longitudinal Study of Pressure Sensing to Infer Real-World Water Usage Events in the Home. Pervasive Computing, pages 50--69, 2011. Google ScholarDigital Library
- S. Gupta, M. Reynolds, and S. Patel. ElectriSense: single-point sensing using EMI for electrical event detection and classification in the home. Ubicomp '10: Proceedings of the 12th ACM international conference on Ubiquitous computing, Sept. 2010. Google ScholarDigital Library
- R. Hamid, S. Maddi, A. Johnson, A. Bobick, I. Essa, and C. Isbell. A novel sequence representation for unsupervised analysis of human activities. Artificial Intell., 173:1221--44, 2009. Google ScholarDigital Library
- T. Hirsch, J. Forlizzi, E. Hyder, J. Goetz, C. Kurtz, and J. Stroback. The ELDer project: social, emotional, and environmental factors in the design of eldercare technologies. Proceedings on the 2000 conference on Universal Usability, pages 72--79, 2000. Google ScholarDigital Library
- S. S. Intille, K. Larson, E. M. Mungia-Tapia, J. S. Beaudin, P. Kaushik, J. Nawyn, and R. Rockinson. Using a live-in laboratory for ubiquitous computing research. In Proc. Int. Conf. on Pervasive Computing, pages 349--365, 2006. Google ScholarDigital Library
- Y. A. Ivanov and A. F. Bobick. Recognition of visual activities and interactions by stochastic parsing. PAMI, 22(2):852--872, August 2000. Google ScholarDigital Library
- S. Katz, A. B. Ford, R. W. Moskowitz, B. A. Jackson, and M. W. Jaffe. Studies of illness in the aged. Jama The Journal Of The American Medical Association, 185(12):914--919, 1963.Google ScholarCross Ref
- J. Kientz, S. Patel, B. Jones, E. Price, E. D. Mynatt, and G. D. Abowd. The Georgia Tech aware home. In Proc. CHI, 2008. Google ScholarDigital Library
- M. Kranz, A. Schmidt, A. Maldonado, and R. B. Rusu. Context-aware kitchen utilities. In Proc. Int. Conf. Tangible and Embedded Interaction, 2007. Google ScholarDigital Library
- R. Larson and M. Csikszentmihalyi. Experience sampling method (esm). In H T Reis Ed Naturalistic Approaches to Studying Social Interaction New Directions for Methodology of Social and Behavioral Science, 15:41--56, 1983.Google Scholar
- M. P. Lawton and E. M. Brody. Assessment of older people: self-maintaining and instrumental activities of daily living. Gerontologist, 9(3):179--186, 1969.Google ScholarCross Ref
- C. Manning, P. Raghavan, and H. Schütze. Introduction to Information Retrieval. Cambridge Univ. Press, 2008. Google ScholarCross Ref
- D. Moore and I. Essa. Recognizing multitasked activities from video using stochastic context-free grammar. In AAAI, 2002. Google ScholarDigital Library
- E. Munguia-Tapia, S. Intille, and K. Larson. Activity recognition in the home using simple and ubiquitous sensors. Proceedings of PERVASIVE, pages 158--186, 2004.Google Scholar
- S. Patel, M. Reynolds, and G. Abowd. Detecting Human Movement by Differential Air Pressure Sensing in HVAC System Ductwork: An Exploration in Infrastructure Mediated Sensing. Pervasive '08: Proceedings of the 6th International Conference on Pervasive Computing, Mar. 2009. Google ScholarDigital Library
- C. Pham and P. Olivier. Slice & Dice: Recognizing Food Preparation Activities Using Embedded Accelerometers. In Proc. Europ. Conf. Ambient Intelligence, 2009. Google ScholarDigital Library
- M. Philipose, K. Fishkin, M. Perkowitz, D. Patterson, D. Fox, H. Kautz, and D. Hahnel. Inferring activities from interactions with objects. IEEE pervasive computing, 3(4):50--57, 2004. Google ScholarDigital Library
- G. Salton. The SMART retrieval system: Experiments in automatic document processing. Prentice-Hall, Upper Saddle River, NJ, 1971. Google ScholarDigital Library
- P. Turaga, R. Chellappa, V. S. Subrahmanian, and O. Udrea. Machine recognition of human activities: A survey. IEEE Trans. Circuits Systems for Video Tech., 2008. Google ScholarDigital Library
- H. Wang, M. M. Ullah, A. Kläser, I. Laptev, and C. Schmid. Evaluation of local spatio-temporal features for action recognition. In BMVC, 2009.Google ScholarCross Ref
Index Terms
- Recognizing water-based activities in the home through infrastructure-mediated sensing
Recommendations
Annotating smart environment sensor data for activity learning
Smart Environments: Technology to Support HealthcareThe pervasive sensing technologies found in smart homes offer unprecedented opportunities for providing health monitoring and assistance to individuals experiencing difficulties living independently at home. In order to monitor the functional health of ...
Fusion of Multiple Sensors Sources in a Smart Home to Detect Scenarios of Activities in Ambient Assisted Living
This work takes place within the framework of Smart Homes, with the goal to monitor the activities of elderly people, living independently at home, in order to continuously assess their level of activity and therefore their autonomy. A method is ...
Space-time flexible kernel for recognizing activities from wearable cameras
AbstractRecognizing activities of daily living is useful for ambient assisted living. In this regard, the use of wearable cameras is a promising technology. In this paper, we propose a novel approach for recognizing activities of daily living using ...
Comments