skip to main content
10.1145/1121241.1121245acmconferencesArticle/Chapter ViewAbstractPublication PageshriConference Proceedingsconference-collections
Article

Daily HRI evaluation at a classroom environment: reports from dance interaction experiments

Published:02 March 2006Publication History

ABSTRACT

The design and development of social robots that interact and assist people in daily life requires moving into unconstrained daily-life environments. This presents unexplored methodological challenges to robotic researchers. Is it possible, for example, to perform useful experiments in the uncontrolled conditions of everyday life environments? How long do these studies need to be to provide reliable results? What evaluations methods can be used?In this paper we present preliminary results on a study designed to evaluate an algorithm for social robots in relatively uncontrolled, daily life conditions. The study was conducted as part of the RUBI project, whose goal is to design and develop social robots by immersion in the environment in which the robots are supposed to operate. First we found that in spite of the relative chaotic conditions and lack of control existing in the daily activities of a child-care center, it is possible to perform experiments in a relatively short period of time and with reliable results. We found that continuous audience response methods borrowed from marketing research provided good inter-observer reliabilities, in the order of 70%, and temporal resolution (the cut-off frequency is in the order of 1 cycle per minute) at low cost (evaluation is performed continuously in real time). We also experimented with objective behavioral descriptions, like tracking children's movement across a room. These approaches complemented each other and provided a useful picture of the temporal dynamics of the child-robot interaction, allowing us to gather baseline data for evaluating future systems. Finally, we also touch the ongoing study of behavior analysis through 3 months long-term child-robot interaction.

References

  1. C. L. Breazeal. Designing Sociable Robots. The MIT Press, 2002. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. I. Fenwick and M. D. Rice. Reliability of Continuous Measurement Copy Testing Methods. Journal of Advertising Research, 31(1):23--29, 1991.Google ScholarGoogle Scholar
  3. T. Fong, I. Nourbakhsh, and K. Dautenhahn. A Survey of Socially Interactive Robots. Robotics and Autonomous Systems, 42(3-4):143--166, 2003.Google ScholarGoogle ScholarCross RefCross Ref
  4. M. Fujita, Y. Kuroki, T. Ishida, and T. T. Doi. SDR-4X II: A Small Humanoid as an Entertainer in Home Environment. In Proceedings of the 11th International Symposium of Robotics Research, 2003.Google ScholarGoogle Scholar
  5. T. Ishida, Y. Kuroki, and J. Yamaguchi. Development of Mechanical System for a Small Biped Entertainment Robot. In Proceedings of the 2003 IEEE International Workshop on Robot and Human Interactive Communication, pages 297--302, 2003.Google ScholarGoogle ScholarCross RefCross Ref
  6. T. Kanda, T. Hirano, D. Eaton, and H. Ishiguro. Interactive Robots as Social Partners and Peer Tutors for Children: A Field Trial. Human-Computer Interaction, 19(1-2):61--84, 2004. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. H. Kozima, C. Nakagawa, and Y. Yasuda. Interactive Robots for Communication-Care: A Case-Study in Autism Therapy. In Proceedings of the 2005 IEEE International Workshop on Robot and Human Interactive Communication, pages 341--346, 2005.Google ScholarGoogle ScholarCross RefCross Ref
  8. Y. Kuroki, T. Fukushima, K. Nagasaka, T. Moridaira, T. T. Doi, and J. Yamaguchi. A Small Biped Entertainment Robot Exploring Human-Robot Interactive Applications. In Proceedings of the 2003 IEEE International Workshop on Robot and Human Interactive Communication, pages 303--308, 2003.Google ScholarGoogle ScholarCross RefCross Ref
  9. J. R. Movellan, F. Tanaka, B. Fortenberry, and K. Aisaka. The RUBI/QRIO Project: Origins, Principles, and First Steps. In Proceedings of 2005 4th IEEE International Conference on Development and Learning, pages 80--86, 2005.Google ScholarGoogle ScholarCross RefCross Ref
  10. M. Polsfuss and M. Hess. `Liking' through Moment-To-Moment Evaluation: Identifying Key Selling Segments in Advertising. Advances in Consumer Research, 18(1):540--544, 1991.Google ScholarGoogle Scholar
  11. F. Tanaka and H. Suzuki. Dance Interaction with QRIO: A Case Study for Non-boring Interaction by Using an Entrainment Ensemble Model. In Proceedings of the 2004 IEEE International Workshop on Robot and Human Interactive Communication, pages 419--424, 2004.Google ScholarGoogle ScholarCross RefCross Ref

Index Terms

  1. Daily HRI evaluation at a classroom environment: reports from dance interaction experiments

                  Recommendations

                  Comments

                  Login options

                  Check if you have access through your login credentials or your institution to get full access on this article.

                  Sign in
                  • Published in

                    cover image ACM Conferences
                    HRI '06: Proceedings of the 1st ACM SIGCHI/SIGART conference on Human-robot interaction
                    March 2006
                    376 pages
                    ISBN:1595932941
                    DOI:10.1145/1121241

                    Copyright © 2006 ACM

                    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

                    Publisher

                    Association for Computing Machinery

                    New York, NY, United States

                    Publication History

                    • Published: 2 March 2006

                    Permissions

                    Request permissions about this article.

                    Request Permissions

                    Check for updates

                    Qualifiers

                    • Article

                    Acceptance Rates

                    Overall Acceptance Rate242of1,000submissions,24%

                  PDF Format

                  View or Download as a PDF file.

                  PDF

                  eReader

                  View online with eReader.

                  eReader