Abstract
Research on anticipatory behavior in adaptive learning systems continues to gain more recognition and appreciation in various research disciplines. This book provides an overarching view on anticipatory mechanisms in cognition, learning, and behavior. It connects the knowledge from cognitive psychology, neuroscience, and linguistics with that of artificial intelligence, machine learning, cognitive robotics, and others. This introduction offers an overview over the contributions in this volume highlighting their interconnections and interrelations from an anticipatory behavior perspective. We first clarify the main foci of anticipatory behavior research. Next, we present a taxonomy of how anticipatory mechanisms may be beneficially applied in cognitive systems. With relation to the taxonomy, we then give an overview over the book contributions. The first chapters provide surveys on currently known anticipatory brain mechanisms, anticipatory mechanisms in increasingly complex natural languages, and an intriguing challenge for artificial cognitive systems. Next, conceptualizations of anticipatory processes inspired by cognitive mechanisms are provided. The conceptualizations lead to individual, predictive challenges in vision and processing of event correlations over time. Next, anticipatory mechanisms in individual decision making and behavioral execution are studied. Finally, the book offers systems and conceptualizations of anticipatory processes related to social interaction.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Arbib, M.: The mirror system, imitation, and the evolution of language. In: Dautenhahn, K., Nehaniv, C.L. (eds.) Imitation in animals and artifacts, pp. 229–280. MIT Press, Cambridge, MA (2002)
Cont, A., Shlomo Dubnov, G.A.: Anticipatory model of musical style imitation using collaborative and competitive reinforcement learning. In: Butz, M.V., Sigaud, O., Pezzulo, G., Baldassarre, G. (eds.) Anticipatory Behavior in Adaptive Learning Systems: From Brains to Individual and Social Behavior, Springer, Heidelberg (2007)
Baars, B.: A Cognitive Theory of Consciousness. Cambridge University Press, Cambridge, MA (1988)
Baars, B.J.: The conscious access hypothesis: Origins and recent evidence. Trends Cogn Sci. 6, 47–52 (2002)
Baldassarre, G.: Forward and bidirectional planning based on reinforcement learning and neural networks in a simulated robot. In: Butz, M.V., Sigaud, O., Gérard, P. (eds.) Anticipatory Behavior in Adaptive Learning Systems. LNCS (LNAI), vol. 2684, pp. 179–200. Springer, Heidelberg (2003)
Barto, A.G., Mahadevan, S.: Recent advances in hierarchical reinforcement learning. Discrete Event Dynamic Systems 13, 341–379 (2003)
Blancharnd, A.J., Cañamero, L.: Anticipating rewards in continuous time and space: A case study in developmental robotics. In: Butz, M.V., Sigaud, O., Pezzulo, G., Baldassarre, G. (eds.) Anticipatory Behavior in Adaptive Learning Systems: From Brains to Individual and Social Behavior, Springer, Heidelberg (2007)
Butz, M.V., Herbort, O., Hoffmann, J.: Exploiting redundancy for flexible behavior: Unsupervised learning in a modular sensorimotor control architecture. Psychological Review (in press)
Butz, M.V., Swarup, S., Goldberg, D.E.: Effective online detection of task-independent landmarks. In: Online Proceedings for the ICML 2004 Workshop on Predictive Representations of World Knowledge, p. 10 (2004)
Butz, M.V.: Anticipatory learning classifier systems. Kluwer Academic Publishers, Boston, MA (2002)
Butz, M.V.: COSEL: A cognitive sequence learning architecture. IlliGAL report 2004021, Illinois Genetic Algorithms Laboratory, University of Illinois at Urbana-Champaign (2004)
Butz, M.V., Hoffmann, J.: Anticipations control behavior: Animal behavior in an anticipatory learning classifier system. Adaptive Behavior 10, 75–96 (2002)
Butz, M.V., Sigaud, O., Gérard, P. (eds.): Anticipatory Behavior in Adaptive Learning Systems: Foundations, Theories, and Systems, LNCS (LNAI), vol. 2684. Springer, Heidelberg (2003)
Butz, M.V., Sigaud, O., Gérard, P.: Anticipatory behavior: Exploiting knowledge about the future to improve current behavior. In: Butz, M.V., Sigaud, O., Gérard, P. (eds.) Anticipatory Behavior in Adaptive Learning Systems. LNCS (LNAI), vol. 2684, pp. 1–10. Springer, Heidelberg (2003)
Butz, M.V., Sigaud, O., Gérard, P.: Internal models and anticipations in adaptive learning systems. In: Butz, M.V., Sigaud, O., Gérard, P. (eds.) Anticipatory Behavior in Adaptive Learning Systems. LNCS (LNAI), vol. 2684, pp. 86–109. Springer, Heidelberg (2003)
Camacho, E.F., Bordons, C. (eds.): Model predictive control. Springer, Heidelberg (1999)
Capdepuy, P., Polani, D., Nehaniv, C.L.: Construction of an internal predictive model by event anticipation. In: Butz, M.V., Sigaud, O., Pezzulo, G., Baldassarre, G. (eds.) Anticipatory Behavior in Adaptive Learning Systems: From Brains to Individual and Social Behavior, Springer, Heidelberg (2007)
Damasio, A.R.: Descartes’ Error: Emotion, Reason and the Human Brain. Grosset/Putnam (1994)
Davidsson, P.: A framework for preventive state anticipation. In: Butz, M.V., Sigaud, O., Gérard, P. (eds.) Anticipatory Behavior in Adaptive Learning Systems. LNCS (LNAI), vol. 2684, pp. 151–166. Springer, Heidelberg (2003)
Deneve, S., Pouget, A.: Bayesian multisensory integration and cross-modal spatial links. Journal of Physiology - Paris 98, 249–258 (2004)
Desmurget, M., Grafton, S.: Forward modeling allows feedback control for fast reaching movements. Trends in Cognitive Sciences 4, 423–431 (2000)
Dubois, D.M.: Mathematical foundations of discrete and functional systems with strong and weak anticipations. In: Butz, M.V., Sigaud, O., Gérard, P. (eds.) Anticipatory Behavior in Adaptive Learning Systems. LNCS (LNAI), vol. 2684, pp. 110–132. Springer, Heidelberg (2003)
Elman, J.L.: Finding structure in time. Cognitive Science 14, 179–211 (1990)
Fernández, S., Graves, A., Schmidhuber, J.: Sequence labelling in structured domains with hierarchical recurrent neural network. In: Proceedings of the 20th International Joint Conference on Artificial Intelligence, IJCAI 2007, vol. 20 (2007)
Fix, J., Vitay, J., Rougier, N.P.: A distributed computational model of spatial memory anticipation during a visual search task. In: Butz, M.V., Sigaud, O., Pezzulo, G., Baldassarre, G. (eds.) Anticipatory Behavior in Adaptive Learning Systems: From Brains to Individual and Social Behavior, Springer, Heidelberg (2007)
Fleischer, J.G.: Neural correlates of anticipation in cerebellum, basal ganglia, and hippocampus. In: Butz, M.V., Sigaud, O., Pezzulo, G., Baldassarre, G. (eds.) Anticipatory Behavior in Adaptive Learning Systems: From Brains to Individual and Social Behavior, Springer, Heidelberg (2007)
Gallese, V.: The manifold nature of interpersonal relations: The quest for a common mechanism. Philosophical transactions of the Royal Society of London. Series B, Biological sciences 358, 517–528 (2003)
Gallese, V.: The ’shared manifold’ hypothesis: From mirror neurons to empathy. Journal of Consciousness Studies: Between Ourselves - Second-Person Issues in the Study of Consciousness 8, 33–50 (2001)
Gallese, V., Goldman, A.: Mirror neurons and the simulation theory of mind-reading. Trends in Cognitive Sciences 2, 493–501 (1998)
Gers, F.A., Schraudolph, N., Schmidhuber, J.: Learning precise timing with LSTM recurrent networks. Journal of Machine Learning Research 3, 115–143 (2002)
Graves, A., Schmidhuber, J.: Framewise phoneme classification with bidirectional LSTM and other neural network architectures. Neural Networks 18, 602–610 (2005)
Grush, R.: The emulation theor of representation: Motor control, imagery, and perception. Behavioral and Brain Sciences 27, 377–396 (2004)
Gomez, M., Carbo, J., Benac-Earle, C.: An anticipatory trust model for open distributed systems. In: Butz, M.V., Sigaud, O., Pezzulo, G., Baldassarre, G. (eds.) Anticipatory Behavior in Adaptive Learning Systems: From Brains to Individual and Social Behavior, Springer, Heidelberg (2007)
Haruno, M., Wolpert, D.M., Kawato, M.: Mosaic model for sensorimotor learning and control. Neural Computation 13, 2201–2220 (2001)
Haruno, M., Wolpert, D.M., Kawato, M.: Hierarchical mosaic for movement generation. In: Ono, T., Matsumoto, G., Llinas, R., Berthoz, A., Norgren, R., Nishijo, H., Tamura, R. (eds.) Excepta Medica International Coungress Series, vol. 1250, pp. 575–590. Elsevier Science B.V, Amsterdam, The Netherlands (2003)
Haykin, S.: Adaptive filter theory, 4th edn. Prentice Hall, Upper Saddle River (2002)
Herbart, J.F.: Psychologie als Wissenschaft neu gegründet auf Erfahrung, Metaphysik und Mathematik. Zweiter, analytischer Teil. August Wilhem Unzer, Königsberg, Germany (1825)
Herbort, O., Butz, M.V.: Encoding complete body models enables task dependent optimal behavior. International Joint Conference on Neural Networks (in press)
Herbort, O., Ognibene, D., Butz, M.V., Baldassarre, G.: Learning to select targets within targets in reaching tasks.In: 6th IEEE International Conference on Development and Learning (submitted)
Hesslow, G.: Conscious thought as simulation of behaviour and perception. Trends in cognitive sciences 6, 242–247 (2002)
Hinton, G.E., Dayan, P., Frey, B.J., Neal, R.M.: The wake-sleep algorithm for unsupervised neural networks. Science 268, 1158–1161 (1995)
Hochreiter, S., Schmidhuber, J.: Long short-term memory. Neural Computation 9, 1735–1780 (1997)
Hoffmann, J.: Vorhersage und Erkenntnis: Die Funktion von Antizipationen in der menschlichen Verhaltenssteuerung und Wahrnehmung. [ Anticipation and cognition: The function of anticipations in human behavioral control and perception.]. Hogrefe, Göttingen, Germany (1993)
Hoffmann, J.: Anticipatory behavioral control. In: Butz, M.V., Sigaud, O., Gérard, P. (eds.) Anticipatory Behavior in Adaptive Learning Systems. LNCS (LNAI), vol. 2684, pp. 44–65. Springer, Heidelberg (2003)
Ito, M., Noda, K., Hoshino, Y., Tani, J.: Dynamic and interactive generation of object handling behaviors by a small humanoid robot using a dynamic neural network model. Neural Networks (in press)
Ito, M., Tani, J.: On-line imitative interaction with a humanoid robot using a dynamic neural network model of a mirror system. Adaptive Behavior 12, 93–115 (2004)
Jaeger, H., Haas, H.: Harnessing nonlinearity: Predicting chaotic systems and saving energy in wireless communication. Science 304, 78–80 (2004)
James, W.: The principles of psychology. vol. 1, Holt, New York (1890)
Johansson, B., Balkenius, C.: An experimental study of anticipation in simple robot navigation. In: Butz, M.V., Sigaud, O., Pezzulo, G., Baldassarre, G. (eds.) Anticipatory Behavior in Adaptive Learning Systems: From Brains to Individual and Social Behavior, Springer, Heidelberg (2007)
Jordan, M.I., Rumelhart, D.E.: Forward models: Supervised learning with a distal teacher. Cognitive Science 16, 307–354 (1992)
Kalman, R.E.: A new approach to linear filtering and prediction problems. Transactions of the ASME-Journal of Basic Engineering 82, 35–45 (1960)
Kiryazov, K., Petkov, G., Grinberg, M., Kokinov, B., Balkenius, C.: The interplay of analogy-making with active vision and motor control in anticipatory robots. In: Butz, M.V., Sigaud, O., Pezzulo, G., Baldassarre, G. (eds.) Anticipatory Behavior in Adaptive Learning Systems: From Brains to Individual and Social Behavior, Springer, Heidelberg (2007)
Knill, D.C., Pouget, A.: The bayesian brain: The role of uncertainty in neural coding and computation. Trends in Neurosciences 27, 712–719 (2004)
Kondo, T., Ito, K.: An intrinsic neuromodulation model for realizing anticipatory behavior in reaching movement underunexperienced force fields. In: Butz, M.V., Sigaud, O., Pezzulo, G., Baldassarre, G. (eds.) Anticipatory Behavior in Adaptive Learning Systems: From Brains to Individual and Social Behavior, Springer, Heidelberg (2007)
Kunde, W., Weigelt, M.: Goal congruency in bimanual object manipulation. Journal of Experimental Psychology: Human Perception and Performance 31, 145–156 (2005)
Kunde, W., Koch, I., Hoffmann, J.: Anticipated action effects affect the selection, initiation, and execution of actions. The Quarterly Journal of Experimental Psychology. Section A: Human Experimental Psychology 57, 87–106 (2004)
Kuperstein, M.: Infant neural controller for adaptive sensory-motor coordination. Neural Netw. 4, 131–145 (1991)
Lalev, E., Grinberg, M.: Backward vs. forward-oriented decision making in the iterated prisoners dilemma: A comparison between two connectionist models. In: Butz, M.V., Sigaud, O., Pezzulo, G., Baldassarre, G. (eds.) Anticipatory Behavior in Adaptive Learning Systems: From Brains to Individual and Social Behavior, Springer, Heidelberg (2007)
Lorini, E., Castelfranchi, C.: The unexpected aspects of surprise. International Journal of Pattern Recognition and Artificial Intelligence 20, 817–835 (2006)
Mechsner, F., Kerzel, D., Knoblich, G., Prinz, W.: Perceptual basis of bimanual coordination. Nature 414, 69–73 (2001)
Mehta, B., Schaal, S.: Forward models in visuomotor control. Journal of Neurophysiology 88, 942–953 (2002)
Mel, B.W.: A connectionist model may shed light on neural mechanisms for visually guided reaching. Journal of cognitive neuroscience 3, 273–292 (1991)
Meyer, G.G., Szirbik, N.B.: Anticipatory alignment mechanisms for behavioural learning in multi agent systems. In: Butz, M.V., Sigaud, O., Pezzulo, G., Baldassarre, G. (eds.) Anticipatory Behavior in Adaptive Learning Systems: From Brains to Individual and Social Behavior, Springer, Heidelberg (2007)
Negatu, A., DMello, S., Franklin, S.: Cognitively inspired anticipatory adaptation and associated learning mechanisms for autonomous agents. In: Butz, M.V., Sigaud, O., Pezzulo, G., Baldassarre, G. (eds.) Anticipatory Behavior in Adaptive Learning Systems: From Brains to Individual and Social Behavior, Springer, Heidelberg (2007)
Pezzulo, G., Baldassarre, G., Butz, M.V., Castelfranchi, C., Hoffmann, J.: From actions to goals and vice-versa: Theoretical analysis and models of the ideomotor principle and tote. In: Butz, M.V., Sigaud, O., Pezzulo, G., Baldassarre, G. (eds.) Anticipatory Behavior in Adaptive Learning Systems: From Brains to Individual and Social Behavior, Springer, Heidelberg (2007)
Pezzulo, G., Calvi, G.: Schema-based design and the akira schema language: An overview. In: Butz, M.V., Sigaud, O., Pezzulo, G., Baldassarre, G. (eds.) Anticipatory Behavior in Adaptive Learning Systems: From Brains to Individual and Social Behavior, Springer, Heidelberg (2007)
Rao, R.P.N., Ballard, D.H.: Predictive coding in the visual cortex: A functional interpretation of some extra-classical receptive-field effects. Nature Neuroscience 2, 79–87 (1999)
Redko, V.G., Mikhail, S., Burtsev, K.V.A., Manolov, A.I., Mosalov, O.P., Nepomnyashchikh, V.A., Prokhorov, D.V.: Project animat brain: Designing the animat control system on the basis of the functional systems theory. In: Butz, M.V., Sigaud, O., Pezzulo, G., Baldassarre, G. (eds.) Anticipatory Behavior in Adaptive Learning Systems: From Brains to Individual and Social Behavior, Springer, Heidelberg (2007)
Ridley, M.: The Origins of Virtue: Human Instincts and The Evolution of Cooperation. Penguin Books (1996)
Riegler, A.: Superstition in the machine. In: Butz, M.V., Sigaud, O., Pezzulo, G., Baldassarre, G. (eds.) Anticipatory Behavior in Adaptive Learning Systems: From Brains to Individual and Social Behavior, Springer, Heidelberg (2007)
Rizzolatti, G., Fadiga, L., Gallese, V., Fogassi, L.: Premotor cortex and the recognition of motor actions. Cognitive Brain Research 3, 131–141 (1996)
Rosenbaum, D.A., Loukopoulos, L.D., Meulenbroek, R.G.J., Vaughan, J., Engelbrecht, S.E.: Planning reaches by evaluating stored postures. Psychological Review 102, 28–67 (1995)
Schenck, W., Möller, R.: Training and application of a visual forward model for a robot camera head. In: Butz, M.V., Sigaud, O., Pezzulo, G., Baldassarre, G. (eds.) Anticipatory Behavior in Adaptive Learning Systems: From Brains to Individual and Social Behavior, Springer, Heidelberg (2007)
Schmidhuber, J.: Learning complex extended sequences using the principle of history compression. Neural Computation 4, 234–242 (1992)
Simsek, Ö., Barto, A.G.: Using relative novelty to identify useful temporal abstractions in reinforcement learning. In: Proceedings of the Twenty-First International Conference on Machine Learning (ICML- 2004), pp. 751–758 ( 2004)
Stolzmann, W., Butz, M.V., Hoffmann, J., Goldberg, D.E.: First cognitive capabilities in the anticipatory classifier system. From Animals to Animats 6: In: Proceedings of the Sixth International Conference on Simulation of Adaptive Behavior, pp. 287–296 (2000)
Sutton, R.S.: Reinforcement learning architectures for animats. From Animals to Animats: In: Proceedings of the First International Conference on Simulation of Adaptive Behavior, pp. 288–296 (1991)
Sutton, R.S., Barto, A.G.: Reinforcement learning: An introduction. MIT Press, Cambridge, MA (1998)
Swarup, S., Gasser, L.: The role of anticipation in the emergence of language. In: Butz, M.V., Sigaud, O., Pezzulo, G., Baldassarre, G. (eds.) Anticipatory Behavior in Adaptive Learning Systems: From Brains to Individual and Social Behavior, Springer, Heidelberg (2007)
Todorov, E.: Optimality principles in sensorimotor control. Nature Review Neuroscience 7, 907–915 (2004)
von Helmholtz, H.: Handbuch der physiologischen Optik. vol. III. Leopold Voss, Leipzig translated by The Optical Society of America in 1924 from the third germand edn. 1910, Treatise on physiological optics, vol. III (1867)
von Hofsten, C.: An action perspective on motor development. Trends in Cognitive Science 8, 266–272 (2004)
von Holst, E., Mittelstaedt, H.: Das Reafferenzprinzip. Naturwissenschaften 37, 464–476 (1950)
Wolpert, D.M., Kawato, M.: Multiple paired forward and inverse models for motor control. Neural Networks 11, 1317–1329 (1998)
Zappacosta, S., Nolfi, S., Baldassarre, G.: A testbed for neural-network models capable of integrating information in time. In: Butz, M.V., Sigaud, O., Pezzulo, G., Baldassarre, G. (eds.) Anticipatory Behavior in Adaptive Learning Systems: From Brains to Individual and Social Behavior, Springer, Heidelberg (2007)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Butz, M.V., Sigaud, O., Pezzulo, G., Baldassarre, G. (2007). Anticipations, Brains, Individual and Social Behavior: An Introduction to Anticipatory Systems. In: Butz, M.V., Sigaud, O., Pezzulo, G., Baldassarre, G. (eds) Anticipatory Behavior in Adaptive Learning Systems. ABiALS 2006. Lecture Notes in Computer Science(), vol 4520. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-74262-3_1
Download citation
DOI: https://doi.org/10.1007/978-3-540-74262-3_1
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-74261-6
Online ISBN: 978-3-540-74262-3
eBook Packages: Computer ScienceComputer Science (R0)