Qianli Xu
ABSTRACT
In this paper, we explore a new way to provide context-aware assistance for indoor navigation using a wearable vision system. We investigate how to represent the cognitive knowledge of wayfinding based on first-person-view videos in real-time and how to provide context-aware navigation instructions in a human-like manner. Inspired by the human cognitive process of wayfinding, we propose a novel cognitive model that represents visual concepts as a hierarchical structure. It facilitates efficient and robust localization based on cognitive visual concepts. Next, we design a prototype system that provides intelligent context-aware assistance based on the cognitive indoor navigation knowledge model. We conducted field tests and evaluated the system's efficacy by benchmarking it against traditional 2D maps and human guidance. The results show that context-awareness built on cognitive visual perception enables the system to emulate the efficacy of a human guide, leading to positive user experience.
- Aixplorer. http://www.aixplorer.de/.Google Scholar
- Arikawa, M., Konomi, S. I. and Ohnishi, K. NAVITIME: Supporting pedestrian navigation in the real world. Pervasive Computing, 6, 3, (2007), 21--29. Google ScholarDigital Library
- Baras, K., Moreira, A. and Meneses, F., Navigation based on symbolic space models. in IPIN'10, (2010), 1--5.Google ScholarCross Ref
- Barberis, C., Bottino, A., Malnati, G. and Montuschi, P. Experiencing indoor navigation on mobile devices. IT Professional, 14,1, (2014), 50--57.Google Scholar
- Bardram, J. E. Activity-based computing for medical work in hospitals. ACM Transactions on Computer-Human Interaction, 16, 2, (2009), 10:11--36. Google ScholarDigital Library
- Baus, J., Krüger, A. and Wahlster, W., A resource-adaptive mobile navigation system. in IUI'02, (2002), 15--22. Google ScholarDigital Library
- Brush, A. J., Karlson, A. K., Scott, J., Sarin, R., Jacobs, A., Bond, B., Murillo, O., Hunt, G., Sinclair, M., Hammil, K. and Levi, S. User experiences with activity-based navigation on mobile devices MobileHCI'10, ACM Press (2010). Google ScholarDigital Library
- Bulling, A., Weichel, C. and Gellersen, H., EyeContext: Recognition of high-level contextual cues from human visual behaviour. in CHI'13, (2013), 305--308. Google ScholarDigital Library
- Butz, A., Baus, J., Krüger, A. and Lohse, M., A hybrid indoor navigation system. in IUI'01, (2001), 25--32. Google ScholarDigital Library
- Chatting, D. J., Action and reaction for physical map interfaces. in TEI'08, (2008), 187--190. Google ScholarDigital Library
- Cheverst, K., Davies, N., Mitchell, K. and Friday, A., Experiences of developing and deploying a context-aware tourist guide: The guide project. in MobiCom'00, (2000), 20--31. Google ScholarDigital Library
- Cheverst, K., Davies, N., Mitchell, K., Friday, A. and Efstratiou, C., Developing a context-aware electronic tourist guide: Some issues and experiences. in CHI'00, (2000), 17--24. Google ScholarDigital Library
- Davies, N., Cheverst, K., Mitchell, K. and Efrat, A. Using and determining location in a context-sensitive tour guide. Computer, 34, 8, (2001), 35--41. Google ScholarDigital Library
- Dey, A. K., Abowd, G. D. and Salber, D. A conceptual framework and a toolkit for supporting the rapid prototyping of context-aware applications. Human-Computer Interaction, 16, 2, (2001), 97--166. Google ScholarDigital Library
- Etzion, O., Skarbovsky, I., Magid, Y., Zolotorevsky, N. and Rabinovich, E., Context aware computing and its utilization in event-based systems. in DEBS'10, (2010), 270--281. Google ScholarDigital Library
- Fallah, N., Apostolopoulos, I., Bekris, K. and Folmer, E. Indoor human navigation systems - A survey. Interacting with Computers, 25, 1, (2013), 21--33.Google Scholar
- Freksa, C., Klippel, A. and Winter, S. A cognitive perspective on spatial context. in Cohn, A. G., Freksa, C. and Nebel, B. eds. Spatial Cognition: Specialization and Integration, Dagstuhl, 2007.Google Scholar
- Giudice, N. A., Bakdash, J. Z., Legge, G. E. and Roy, R. Spatial learning and navigation using a virtual verbal display. ACM Trans. Applied Perception, 7, 1, (2010), No. 10. Google ScholarDigital Library
- Hanheide, M. A Cognitive Ego-Vision System for Interactive Assistance, University of Bielefeld, Bielefeld, 2006.Google Scholar
- Hegartya, M., Richardsona, A. E., Montellob, D. R., Lovelacea, K. and Subbiah, I. Development of a self-report measure of environmental spatial ability. Intelligence, 30, (2002), 425--447.Google ScholarCross Ref
- Heiniz, P., Krempels, K. H., Terwelp, C. and Wüller, S., Landmark-based navigation in complex buildings. in IPIN'12, (2012), 1--9.Google ScholarCross Ref
- Hile, H., Grzeszczuk, R., Liu, A., Vedantham, R., Kosecka, J. and Borriello, G. Landmark-based pedestrian navigation with enhanced spatial reasoning. Lecture Notes in Computer Science - Pervasive Computing, 5538, (2009), 59--76. Google ScholarDigital Library
- Hong, J., Suh, E.-H. and Kim, S.-J. Context-aware systems: A literature review and classification. Expert Systems with Applications, 36, 4, (2009), 8509--8522. Google ScholarDigital Library
- Kanade, T. and Hebert, M. First-person vision. Proceedings of the IEEE, 100, 8, (2012) 2442--2453.Google ScholarCross Ref
- Kaneko, Y. and Miura, J. View sequence generation for view-based outdoor navigation. in ACPR'11, (2011), 139--143.Google ScholarCross Ref
- Kenteris, M., Gavalas, D. and Economou, D. Electronic mobile guides: A survey. Personal and ubiquitous computing, 15, 1, (2011), 97--111. Google ScholarDigital Library
- Kjeldskov, J. and Paay, J. Indexicality: Understanding mobile human-computer interaction in context. ACM Trans. ComputerHuman Interaction, 17, 4, (2010), 14:11--28. Google ScholarDigital Library
- Kray, C., Elting, C., Laakso, K. and Coors, V., Presenting route instructions on mobile devices. in IUI'03, (2003), 117--124. Google ScholarDigital Library
- Li, L., Goh, W., Lim, J. H. and Pan, S. J. Extended spectral regression for efficient scene recognition. Pattern Recognition, 47, 9, (2014), 2940--2951.Google ScholarCross Ref
- McKnight, D. H., Carter, M., Thatcher, J. B. and Clay, P. Trust in a specific technology: An investigation of its components and measures. ACM Trans. Management Information Systems, 2, 2, (2011), 1--15. Google ScholarDigital Library
- Möller, A., Kranz, M., Huitl, R., Diewald, S. and Roalter, L. A mobile indoor navigation system interface adapted to vision-based localization, in MUM'12, (2012), No.4.Google ScholarDigital Library
- Mulloni, A., Seichter, H. and Schmalstieg, D., Handheld augmented reality indoor navigation with activity-based instructions. in MobileHCI'11, (2011), 211--220. Google ScholarDigital Library
- Mulloni, A., Seichter, H. and Schmalstieg, D., Indoor navigation with mixed reality world-in-miniature views and sparse localization on mobile devices. in AVI'12, (2012), 212--215. Google ScholarDigital Library
- Opperman, R. and Specht, M., A context-sensitive nomadic exhibition guide, in HUC'00, (2000), 127--149. Google ScholarDigital Library
- Richter, K.-F. and Klippel, A. A model for context-specific route directions. in Freksa, C., Knauff, M. and Krieg-Brückner, B. eds. Spatial Cognition IV. Reasoning, Action, and Interaction, (2004), 5878. Google ScholarDigital Library
- Schilit, B. and Theimer, M. Disseminating active map information to mobile hosts. IEEE Network, 88, 5, (1994), 22--32. Google ScholarDigital Library
- Snowdon, C. and Kray, C., Exploring the use of landmarks for mobile navigation support in natural environments. in MobileHCI '09, (2009), No. 13. Google ScholarDigital Library
- Taher, F. and Cheverst, K., Exploring user preferences for indoor navigation support through a combination of mobile and fixed displays. in MobileHCI'11, (2011), 201--210. Google ScholarDigital Library
- Wang, S.-L. and Wub, C.-Y. Application of context-aware and personalized recommendation to implement an adaptive ubiquitous learning system. Expert Systems with Applications, 38, 9, (2011), 10831--10838. Google ScholarDigital Library
- Wiener, J. M., Buchner, S. J. and Holscher, C. Towards a taxonomy of wayfinding tasks: A knowledge-based approach. Spatial Cognition and Computation, 9, 2, (2009), 152--165.Google ScholarCross Ref
- Willis, K. S., Hölscher, C., Wilbertz, G. and Li, C. Comparison of spatial knowledge acquisition with maps and mobile maps. Computers, Environment and Urban Systems, 33, 2, (2009), 100--110.Google ScholarCross Ref
Index Terms
- A wearable virtual guide for context-aware cognitive indoor navigation
Recommendations
Seamless outdoor/indoor navigation with WIFI/GPS aided low cost Inertial Navigation System
This paper describes an integrated navigation system that can be used for pedestrian navigation in both outdoor and indoor environments. With the aid of Global Positioning System (GPS) positioning solutions, an Inertial Navigation System (INS) can ...
Designing a Robot Guide for Blind People in Indoor Environments
HRI'15 Extended Abstracts: Proceedings of the Tenth Annual ACM/IEEE International Conference on Human-Robot Interaction Extended AbstractsNavigating indoors is challenging for blind people and they often rely on assistance from sighted people. We propose a solution for indoor navigation involving multi-purpose robots that will likely reside in many buildings in the future. In this report, ...
Obstacle avoidance and motion-induced navigation
CAMP '95: Proceedings of the Computer Architectures for Machine PerceptionIn nature, the visual detection of motion appears to be used in a variety of tasks, ranging from collision avoidance to posture maintenance. Many insects seem to rely primarily on information provided by an array of elementary movement detectors in ...
Comments