Skip to main content

Anticipations, Brains, Individual and Social Behavior: An Introduction to Anticipatory Systems

  • Conference paper
Anticipatory Behavior in Adaptive Learning Systems (ABiALS 2006)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 4520))

Included in the following conference series:

Abstract

Research on anticipatory behavior in adaptive learning systems continues to gain more recognition and appreciation in various research disciplines. This book provides an overarching view on anticipatory mechanisms in cognition, learning, and behavior. It connects the knowledge from cognitive psychology, neuroscience, and linguistics with that of artificial intelligence, machine learning, cognitive robotics, and others. This introduction offers an overview over the contributions in this volume highlighting their interconnections and interrelations from an anticipatory behavior perspective. We first clarify the main foci of anticipatory behavior research. Next, we present a taxonomy of how anticipatory mechanisms may be beneficially applied in cognitive systems. With relation to the taxonomy, we then give an overview over the book contributions. The first chapters provide surveys on currently known anticipatory brain mechanisms, anticipatory mechanisms in increasingly complex natural languages, and an intriguing challenge for artificial cognitive systems. Next, conceptualizations of anticipatory processes inspired by cognitive mechanisms are provided. The conceptualizations lead to individual, predictive challenges in vision and processing of event correlations over time. Next, anticipatory mechanisms in individual decision making and behavioral execution are studied. Finally, the book offers systems and conceptualizations of anticipatory processes related to social interaction.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Arbib, M.: The mirror system, imitation, and the evolution of language. In: Dautenhahn, K., Nehaniv, C.L. (eds.) Imitation in animals and artifacts, pp. 229–280. MIT Press, Cambridge, MA (2002)

    Google Scholar 

  2. Cont, A., Shlomo Dubnov, G.A.: Anticipatory model of musical style imitation using collaborative and competitive reinforcement learning. In: Butz, M.V., Sigaud, O., Pezzulo, G., Baldassarre, G. (eds.) Anticipatory Behavior in Adaptive Learning Systems: From Brains to Individual and Social Behavior, Springer, Heidelberg (2007)

    Google Scholar 

  3. Baars, B.: A Cognitive Theory of Consciousness. Cambridge University Press, Cambridge, MA (1988)

    Google Scholar 

  4. Baars, B.J.: The conscious access hypothesis: Origins and recent evidence. Trends Cogn Sci. 6, 47–52 (2002)

    Article  Google Scholar 

  5. Baldassarre, G.: Forward and bidirectional planning based on reinforcement learning and neural networks in a simulated robot. In: Butz, M.V., Sigaud, O., Gérard, P. (eds.) Anticipatory Behavior in Adaptive Learning Systems. LNCS (LNAI), vol. 2684, pp. 179–200. Springer, Heidelberg (2003)

    Google Scholar 

  6. Barto, A.G., Mahadevan, S.: Recent advances in hierarchical reinforcement learning. Discrete Event Dynamic Systems 13, 341–379 (2003)

    Article  MathSciNet  Google Scholar 

  7. Blancharnd, A.J., Cañamero, L.: Anticipating rewards in continuous time and space: A case study in developmental robotics. In: Butz, M.V., Sigaud, O., Pezzulo, G., Baldassarre, G. (eds.) Anticipatory Behavior in Adaptive Learning Systems: From Brains to Individual and Social Behavior, Springer, Heidelberg (2007)

    Google Scholar 

  8. Butz, M.V., Herbort, O., Hoffmann, J.: Exploiting redundancy for flexible behavior: Unsupervised learning in a modular sensorimotor control architecture. Psychological Review (in press)

    Google Scholar 

  9. Butz, M.V., Swarup, S., Goldberg, D.E.: Effective online detection of task-independent landmarks. In: Online Proceedings for the ICML 2004 Workshop on Predictive Representations of World Knowledge, p. 10 (2004)

    Google Scholar 

  10. Butz, M.V.: Anticipatory learning classifier systems. Kluwer Academic Publishers, Boston, MA (2002)

    MATH  Google Scholar 

  11. Butz, M.V.: COSEL: A cognitive sequence learning architecture. IlliGAL report 2004021, Illinois Genetic Algorithms Laboratory, University of Illinois at Urbana-Champaign (2004)

    Google Scholar 

  12. Butz, M.V., Hoffmann, J.: Anticipations control behavior: Animal behavior in an anticipatory learning classifier system. Adaptive Behavior 10, 75–96 (2002)

    Article  Google Scholar 

  13. Butz, M.V., Sigaud, O., Gérard, P. (eds.): Anticipatory Behavior in Adaptive Learning Systems: Foundations, Theories, and Systems, LNCS (LNAI), vol. 2684. Springer, Heidelberg (2003)

    Google Scholar 

  14. Butz, M.V., Sigaud, O., Gérard, P.: Anticipatory behavior: Exploiting knowledge about the future to improve current behavior. In: Butz, M.V., Sigaud, O., Gérard, P. (eds.) Anticipatory Behavior in Adaptive Learning Systems. LNCS (LNAI), vol. 2684, pp. 1–10. Springer, Heidelberg (2003)

    Google Scholar 

  15. Butz, M.V., Sigaud, O., Gérard, P.: Internal models and anticipations in adaptive learning systems. In: Butz, M.V., Sigaud, O., Gérard, P. (eds.) Anticipatory Behavior in Adaptive Learning Systems. LNCS (LNAI), vol. 2684, pp. 86–109. Springer, Heidelberg (2003)

    Google Scholar 

  16. Camacho, E.F., Bordons, C. (eds.): Model predictive control. Springer, Heidelberg (1999)

    Google Scholar 

  17. Capdepuy, P., Polani, D., Nehaniv, C.L.: Construction of an internal predictive model by event anticipation. In: Butz, M.V., Sigaud, O., Pezzulo, G., Baldassarre, G. (eds.) Anticipatory Behavior in Adaptive Learning Systems: From Brains to Individual and Social Behavior, Springer, Heidelberg (2007)

    Google Scholar 

  18. Damasio, A.R.: Descartes’ Error: Emotion, Reason and the Human Brain. Grosset/Putnam (1994)

    Google Scholar 

  19. Davidsson, P.: A framework for preventive state anticipation. In: Butz, M.V., Sigaud, O., Gérard, P. (eds.) Anticipatory Behavior in Adaptive Learning Systems. LNCS (LNAI), vol. 2684, pp. 151–166. Springer, Heidelberg (2003)

    Google Scholar 

  20. Deneve, S., Pouget, A.: Bayesian multisensory integration and cross-modal spatial links. Journal of Physiology - Paris 98, 249–258 (2004)

    Article  Google Scholar 

  21. Desmurget, M., Grafton, S.: Forward modeling allows feedback control for fast reaching movements. Trends in Cognitive Sciences 4, 423–431 (2000)

    Article  Google Scholar 

  22. Dubois, D.M.: Mathematical foundations of discrete and functional systems with strong and weak anticipations. In: Butz, M.V., Sigaud, O., Gérard, P. (eds.) Anticipatory Behavior in Adaptive Learning Systems. LNCS (LNAI), vol. 2684, pp. 110–132. Springer, Heidelberg (2003)

    Google Scholar 

  23. Elman, J.L.: Finding structure in time. Cognitive Science 14, 179–211 (1990)

    Article  Google Scholar 

  24. Fernández, S., Graves, A., Schmidhuber, J.: Sequence labelling in structured domains with hierarchical recurrent neural network. In: Proceedings of the 20th International Joint Conference on Artificial Intelligence, IJCAI 2007, vol. 20 (2007)

    Google Scholar 

  25. Fix, J., Vitay, J., Rougier, N.P.: A distributed computational model of spatial memory anticipation during a visual search task. In: Butz, M.V., Sigaud, O., Pezzulo, G., Baldassarre, G. (eds.) Anticipatory Behavior in Adaptive Learning Systems: From Brains to Individual and Social Behavior, Springer, Heidelberg (2007)

    Google Scholar 

  26. Fleischer, J.G.: Neural correlates of anticipation in cerebellum, basal ganglia, and hippocampus. In: Butz, M.V., Sigaud, O., Pezzulo, G., Baldassarre, G. (eds.) Anticipatory Behavior in Adaptive Learning Systems: From Brains to Individual and Social Behavior, Springer, Heidelberg (2007)

    Google Scholar 

  27. Gallese, V.: The manifold nature of interpersonal relations: The quest for a common mechanism. Philosophical transactions of the Royal Society of London. Series B, Biological sciences 358, 517–528 (2003)

    Article  Google Scholar 

  28. Gallese, V.: The ’shared manifold’ hypothesis: From mirror neurons to empathy. Journal of Consciousness Studies: Between Ourselves - Second-Person Issues in the Study of Consciousness 8, 33–50 (2001)

    Google Scholar 

  29. Gallese, V., Goldman, A.: Mirror neurons and the simulation theory of mind-reading. Trends in Cognitive Sciences 2, 493–501 (1998)

    Article  Google Scholar 

  30. Gers, F.A., Schraudolph, N., Schmidhuber, J.: Learning precise timing with LSTM recurrent networks. Journal of Machine Learning Research 3, 115–143 (2002)

    Article  MathSciNet  Google Scholar 

  31. Graves, A., Schmidhuber, J.: Framewise phoneme classification with bidirectional LSTM and other neural network architectures. Neural Networks 18, 602–610 (2005)

    Article  Google Scholar 

  32. Grush, R.: The emulation theor of representation: Motor control, imagery, and perception. Behavioral and Brain Sciences 27, 377–396 (2004)

    Google Scholar 

  33. Gomez, M., Carbo, J., Benac-Earle, C.: An anticipatory trust model for open distributed systems. In: Butz, M.V., Sigaud, O., Pezzulo, G., Baldassarre, G. (eds.) Anticipatory Behavior in Adaptive Learning Systems: From Brains to Individual and Social Behavior, Springer, Heidelberg (2007)

    Google Scholar 

  34. Haruno, M., Wolpert, D.M., Kawato, M.: Mosaic model for sensorimotor learning and control. Neural Computation 13, 2201–2220 (2001)

    Article  MATH  Google Scholar 

  35. Haruno, M., Wolpert, D.M., Kawato, M.: Hierarchical mosaic for movement generation. In: Ono, T., Matsumoto, G., Llinas, R., Berthoz, A., Norgren, R., Nishijo, H., Tamura, R. (eds.) Excepta Medica International Coungress Series, vol. 1250, pp. 575–590. Elsevier Science B.V, Amsterdam, The Netherlands (2003)

    Google Scholar 

  36. Haykin, S.: Adaptive filter theory, 4th edn. Prentice Hall, Upper Saddle River (2002)

    Google Scholar 

  37. Herbart, J.F.: Psychologie als Wissenschaft neu gegründet auf Erfahrung, Metaphysik und Mathematik. Zweiter, analytischer Teil. August Wilhem Unzer, Königsberg, Germany (1825)

    Google Scholar 

  38. Herbort, O., Butz, M.V.: Encoding complete body models enables task dependent optimal behavior. International Joint Conference on Neural Networks (in press)

    Google Scholar 

  39. Herbort, O., Ognibene, D., Butz, M.V., Baldassarre, G.: Learning to select targets within targets in reaching tasks.In: 6th IEEE International Conference on Development and Learning (submitted)

    Google Scholar 

  40. Hesslow, G.: Conscious thought as simulation of behaviour and perception. Trends in cognitive sciences 6, 242–247 (2002)

    Article  Google Scholar 

  41. Hinton, G.E., Dayan, P., Frey, B.J., Neal, R.M.: The wake-sleep algorithm for unsupervised neural networks. Science 268, 1158–1161 (1995)

    Article  Google Scholar 

  42. Hochreiter, S., Schmidhuber, J.: Long short-term memory. Neural Computation 9, 1735–1780 (1997)

    Article  Google Scholar 

  43. Hoffmann, J.: Vorhersage und Erkenntnis: Die Funktion von Antizipationen in der menschlichen Verhaltenssteuerung und Wahrnehmung. [ Anticipation and cognition: The function of anticipations in human behavioral control and perception.]. Hogrefe, Göttingen, Germany (1993)

    Google Scholar 

  44. Hoffmann, J.: Anticipatory behavioral control. In: Butz, M.V., Sigaud, O., Gérard, P. (eds.) Anticipatory Behavior in Adaptive Learning Systems. LNCS (LNAI), vol. 2684, pp. 44–65. Springer, Heidelberg (2003)

    Google Scholar 

  45. Ito, M., Noda, K., Hoshino, Y., Tani, J.: Dynamic and interactive generation of object handling behaviors by a small humanoid robot using a dynamic neural network model. Neural Networks (in press)

    Google Scholar 

  46. Ito, M., Tani, J.: On-line imitative interaction with a humanoid robot using a dynamic neural network model of a mirror system. Adaptive Behavior 12, 93–115 (2004)

    Article  Google Scholar 

  47. Jaeger, H., Haas, H.: Harnessing nonlinearity: Predicting chaotic systems and saving energy in wireless communication. Science 304, 78–80 (2004)

    Article  Google Scholar 

  48. James, W.: The principles of psychology. vol. 1, Holt, New York (1890)

    Google Scholar 

  49. Johansson, B., Balkenius, C.: An experimental study of anticipation in simple robot navigation. In: Butz, M.V., Sigaud, O., Pezzulo, G., Baldassarre, G. (eds.) Anticipatory Behavior in Adaptive Learning Systems: From Brains to Individual and Social Behavior, Springer, Heidelberg (2007)

    Google Scholar 

  50. Jordan, M.I., Rumelhart, D.E.: Forward models: Supervised learning with a distal teacher. Cognitive Science 16, 307–354 (1992)

    Article  Google Scholar 

  51. Kalman, R.E.: A new approach to linear filtering and prediction problems. Transactions of the ASME-Journal of Basic Engineering 82, 35–45 (1960)

    Google Scholar 

  52. Kiryazov, K., Petkov, G., Grinberg, M., Kokinov, B., Balkenius, C.: The interplay of analogy-making with active vision and motor control in anticipatory robots. In: Butz, M.V., Sigaud, O., Pezzulo, G., Baldassarre, G. (eds.) Anticipatory Behavior in Adaptive Learning Systems: From Brains to Individual and Social Behavior, Springer, Heidelberg (2007)

    Google Scholar 

  53. Knill, D.C., Pouget, A.: The bayesian brain: The role of uncertainty in neural coding and computation. Trends in Neurosciences 27, 712–719 (2004)

    Article  Google Scholar 

  54. Kondo, T., Ito, K.: An intrinsic neuromodulation model for realizing anticipatory behavior in reaching movement underunexperienced force fields. In: Butz, M.V., Sigaud, O., Pezzulo, G., Baldassarre, G. (eds.) Anticipatory Behavior in Adaptive Learning Systems: From Brains to Individual and Social Behavior, Springer, Heidelberg (2007)

    Google Scholar 

  55. Kunde, W., Weigelt, M.: Goal congruency in bimanual object manipulation. Journal of Experimental Psychology: Human Perception and Performance 31, 145–156 (2005)

    Article  Google Scholar 

  56. Kunde, W., Koch, I., Hoffmann, J.: Anticipated action effects affect the selection, initiation, and execution of actions. The Quarterly Journal of Experimental Psychology. Section A: Human Experimental Psychology 57, 87–106 (2004)

    Article  Google Scholar 

  57. Kuperstein, M.: Infant neural controller for adaptive sensory-motor coordination. Neural Netw. 4, 131–145 (1991)

    Article  Google Scholar 

  58. Lalev, E., Grinberg, M.: Backward vs. forward-oriented decision making in the iterated prisoners dilemma: A comparison between two connectionist models. In: Butz, M.V., Sigaud, O., Pezzulo, G., Baldassarre, G. (eds.) Anticipatory Behavior in Adaptive Learning Systems: From Brains to Individual and Social Behavior, Springer, Heidelberg (2007)

    Google Scholar 

  59. Lorini, E., Castelfranchi, C.: The unexpected aspects of surprise. International Journal of Pattern Recognition and Artificial Intelligence 20, 817–835 (2006)

    Article  Google Scholar 

  60. Mechsner, F., Kerzel, D., Knoblich, G., Prinz, W.: Perceptual basis of bimanual coordination. Nature 414, 69–73 (2001)

    Article  Google Scholar 

  61. Mehta, B., Schaal, S.: Forward models in visuomotor control. Journal of Neurophysiology 88, 942–953 (2002)

    Google Scholar 

  62. Mel, B.W.: A connectionist model may shed light on neural mechanisms for visually guided reaching. Journal of cognitive neuroscience 3, 273–292 (1991)

    Article  Google Scholar 

  63. Meyer, G.G., Szirbik, N.B.: Anticipatory alignment mechanisms for behavioural learning in multi agent systems. In: Butz, M.V., Sigaud, O., Pezzulo, G., Baldassarre, G. (eds.) Anticipatory Behavior in Adaptive Learning Systems: From Brains to Individual and Social Behavior, Springer, Heidelberg (2007)

    Google Scholar 

  64. Negatu, A., DMello, S., Franklin, S.: Cognitively inspired anticipatory adaptation and associated learning mechanisms for autonomous agents. In: Butz, M.V., Sigaud, O., Pezzulo, G., Baldassarre, G. (eds.) Anticipatory Behavior in Adaptive Learning Systems: From Brains to Individual and Social Behavior, Springer, Heidelberg (2007)

    Google Scholar 

  65. Pezzulo, G., Baldassarre, G., Butz, M.V., Castelfranchi, C., Hoffmann, J.: From actions to goals and vice-versa: Theoretical analysis and models of the ideomotor principle and tote. In: Butz, M.V., Sigaud, O., Pezzulo, G., Baldassarre, G. (eds.) Anticipatory Behavior in Adaptive Learning Systems: From Brains to Individual and Social Behavior, Springer, Heidelberg (2007)

    Google Scholar 

  66. Pezzulo, G., Calvi, G.: Schema-based design and the akira schema language: An overview. In: Butz, M.V., Sigaud, O., Pezzulo, G., Baldassarre, G. (eds.) Anticipatory Behavior in Adaptive Learning Systems: From Brains to Individual and Social Behavior, Springer, Heidelberg (2007)

    Google Scholar 

  67. Rao, R.P.N., Ballard, D.H.: Predictive coding in the visual cortex: A functional interpretation of some extra-classical receptive-field effects. Nature Neuroscience 2, 79–87 (1999)

    Article  Google Scholar 

  68. Redko, V.G., Mikhail, S., Burtsev, K.V.A., Manolov, A.I., Mosalov, O.P., Nepomnyashchikh, V.A., Prokhorov, D.V.: Project animat brain: Designing the animat control system on the basis of the functional systems theory. In: Butz, M.V., Sigaud, O., Pezzulo, G., Baldassarre, G. (eds.) Anticipatory Behavior in Adaptive Learning Systems: From Brains to Individual and Social Behavior, Springer, Heidelberg (2007)

    Google Scholar 

  69. Ridley, M.: The Origins of Virtue: Human Instincts and The Evolution of Cooperation. Penguin Books (1996)

    Google Scholar 

  70. Riegler, A.: Superstition in the machine. In: Butz, M.V., Sigaud, O., Pezzulo, G., Baldassarre, G. (eds.) Anticipatory Behavior in Adaptive Learning Systems: From Brains to Individual and Social Behavior, Springer, Heidelberg (2007)

    Google Scholar 

  71. Rizzolatti, G., Fadiga, L., Gallese, V., Fogassi, L.: Premotor cortex and the recognition of motor actions. Cognitive Brain Research 3, 131–141 (1996)

    Article  Google Scholar 

  72. Rosenbaum, D.A., Loukopoulos, L.D., Meulenbroek, R.G.J., Vaughan, J., Engelbrecht, S.E.: Planning reaches by evaluating stored postures. Psychological Review 102, 28–67 (1995)

    Article  Google Scholar 

  73. Schenck, W., Möller, R.: Training and application of a visual forward model for a robot camera head. In: Butz, M.V., Sigaud, O., Pezzulo, G., Baldassarre, G. (eds.) Anticipatory Behavior in Adaptive Learning Systems: From Brains to Individual and Social Behavior, Springer, Heidelberg (2007)

    Google Scholar 

  74. Schmidhuber, J.: Learning complex extended sequences using the principle of history compression. Neural Computation 4, 234–242 (1992)

    Article  Google Scholar 

  75. Simsek, Ö., Barto, A.G.: Using relative novelty to identify useful temporal abstractions in reinforcement learning. In: Proceedings of the Twenty-First International Conference on Machine Learning (ICML- 2004), pp. 751–758 ( 2004)

    Google Scholar 

  76. Stolzmann, W., Butz, M.V., Hoffmann, J., Goldberg, D.E.: First cognitive capabilities in the anticipatory classifier system. From Animals to Animats 6: In: Proceedings of the Sixth International Conference on Simulation of Adaptive Behavior, pp. 287–296 (2000)

    Google Scholar 

  77. Sutton, R.S.: Reinforcement learning architectures for animats. From Animals to Animats: In: Proceedings of the First International Conference on Simulation of Adaptive Behavior, pp. 288–296 (1991)

    Google Scholar 

  78. Sutton, R.S., Barto, A.G.: Reinforcement learning: An introduction. MIT Press, Cambridge, MA (1998)

    Google Scholar 

  79. Swarup, S., Gasser, L.: The role of anticipation in the emergence of language. In: Butz, M.V., Sigaud, O., Pezzulo, G., Baldassarre, G. (eds.) Anticipatory Behavior in Adaptive Learning Systems: From Brains to Individual and Social Behavior, Springer, Heidelberg (2007)

    Google Scholar 

  80. Todorov, E.: Optimality principles in sensorimotor control. Nature Review Neuroscience 7, 907–915 (2004)

    Article  Google Scholar 

  81. von Helmholtz, H.: Handbuch der physiologischen Optik. vol. III. Leopold Voss, Leipzig translated by The Optical Society of America in 1924 from the third germand edn. 1910, Treatise on physiological optics, vol. III (1867)

    Google Scholar 

  82. von Hofsten, C.: An action perspective on motor development. Trends in Cognitive Science 8, 266–272 (2004)

    Article  Google Scholar 

  83. von Holst, E., Mittelstaedt, H.: Das Reafferenzprinzip. Naturwissenschaften 37, 464–476 (1950)

    Article  Google Scholar 

  84. Wolpert, D.M., Kawato, M.: Multiple paired forward and inverse models for motor control. Neural Networks 11, 1317–1329 (1998)

    Article  Google Scholar 

  85. Zappacosta, S., Nolfi, S., Baldassarre, G.: A testbed for neural-network models capable of integrating information in time. In: Butz, M.V., Sigaud, O., Pezzulo, G., Baldassarre, G. (eds.) Anticipatory Behavior in Adaptive Learning Systems: From Brains to Individual and Social Behavior, Springer, Heidelberg (2007)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Martin V. Butz Olivier Sigaud Giovanni Pezzulo Gianluca Baldassarre

Rights and permissions

Reprints and permissions

Copyright information

© 2007 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Butz, M.V., Sigaud, O., Pezzulo, G., Baldassarre, G. (2007). Anticipations, Brains, Individual and Social Behavior: An Introduction to Anticipatory Systems. In: Butz, M.V., Sigaud, O., Pezzulo, G., Baldassarre, G. (eds) Anticipatory Behavior in Adaptive Learning Systems. ABiALS 2006. Lecture Notes in Computer Science(), vol 4520. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-74262-3_1

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-74262-3_1

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-74261-6

  • Online ISBN: 978-3-540-74262-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics