Skip to main content
SpringerLink
Log in

Anticipatory Behavioral Control

  • Chapter
Anticipatory Behavior in Adaptive Learning Systems

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 2684))

Abstract

This contribution introduces the psychological learning framework of anticipatory behavioral control (ABC). Departing from the premise that almost all behavior of humans and higher animals is goal oriented, the framework proposes that (1) a voluntary action is preceded by a representation of the to-be-attained effect(s), (2) learning of such effect representations is triggered by the comparison of predicted and actual effects resulting in the primary learning of action-effect relations, (3) situational context is integrated secondarily, (4) action-effect representations are activated by the need or desire of an effect-related goal, and (5) conditionalized action-effect relations can also be activated by contingent stimuli. The framework is supported by a variety of experimental studies and an extensive literature survey.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Ach, N.: Über den Willensakt und das Temperament: Eine experimentelle Untersuchung. Verlag von Quelle & Meyer, Leipzig (1910)

    Google Scholar 

  2. Allan, L.G.: A note on measurements of contingency between two binary variables in judgment tasks. Bulletin of the Psychonomic Society 15, 147–149 (1980)

    Google Scholar 

  3. Allan, L.G., Jenkins, H.M.: The judgment of contingency and the nature of the response alternatives. Canadian Journal of Psychology 34, 1–11 (1980)

    Article  Google Scholar 

  4. Aschersleben, G., Prinz, W.: Synchronizing actions with events: The role of sensory information. Perception and Psychophysics 57, 305–317 (1995)

    Article  Google Scholar 

  5. Aschersleben, G., Prinz, W.: Delayed auditory feedback in synchronization. Journal of Motor Behavior 29, 35–46 (1997)

    Article  Google Scholar 

  6. Butz, M.V., Hoffmann, J.: Anticipations control behavior: Animal behavior in an anticipatory learning classifier system. Adaptive Behavior (2003) (in press)

    Google Scholar 

  7. Cleeremans, A.: Mechanisms of implicit learning. MIT Press, Cambridge (1993)

    Google Scholar 

  8. Cohen, A., Ivry, R., Keele, S.W.: Attention and structure in sequence learning. Journal of Experimental Psychology: Learning, Memory, and Cognition 16, 17–30 (1990)

    Article  Google Scholar 

  9. Colwill, R.M., Rescorla, R.A.: Postconditioning devaluation of a reinforcer affects instrumental learning. Journal of Experimental Psychology: Animal Behavior Processes 11, 120–132 (1985)

    Article  Google Scholar 

  10. Colwill, R.M., Rescorla, R.A.: Evidence for the hierarchical structure of instrumental learning. Animal Learning & Behavior 18, 71–82 (1990)

    Article  Google Scholar 

  11. Desmurget, M., Grafton, S.: Forward modeling allows feedback control for fast reaching movements. Trends in Cognitive Scienc 4, 423–431 (2000)

    Article  Google Scholar 

  12. Dickinson, A.: Instrumental conditioning. In: Mackintosh, N. (ed.) Animal learning and cognition, pp. 45–79. Academic Press, San Diego (1994)

    Google Scholar 

  13. Dickinson, A., Shanks, D.R., Evenden, J.: Judgment of act-outcome contingency: The role of selective attribution. Quarterly Journal of Experimental Psychology 36A, 29–50 (1984)

    Google Scholar 

  14. Elsner, B., Hommel, B.: Effect anticipation and action control. Journal of Experimental Psychology: Human Perception and Performance 27, 229–240 (2001)

    Article  Google Scholar 

  15. Gibson, J.J.: The ecological approach to visual perception. Houghton, Boston (1979)

    Google Scholar 

  16. Gomez, R.L., Schvaneveldt, R.W.: What is learned from artificial grammars? Transfer tests of simple associations. Journal of Experimental Psychology: Learning, Memory, and Cognition 20, 396–410 (1994)

    Article  Google Scholar 

  17. Greenwald, A.G.: Sensory feedback mechanisms in performance control: With special reference to the ideo-motor mechanism. Psychological Review 77, 73–99 (1970)

    Article  Google Scholar 

  18. Harle, E.: Der Apparat des Willens. Zeitschrift für hilosophie und philosophische Kritik 38, 50–73 (1861)

    Google Scholar 

  19. Hazeltine, E.: The representational nature of sequence learning: Evidence for goalbased codes. In: Prinz, W., Hommel, B. (eds.) Common mechanisms in perception and action. Attention and Performance, vol. XIX, pp. 673–689. Oxford University Press, Oxford (2002)

    Google Scholar 

  20. Heckhausen, H., Beckmann, J.: Intentional action and action slips. Psychological Review 97, 36–48 (1990)

    Article  Google Scholar 

  21. Herbart, J.: Psychologie als Wissenschaft neu gegründet auf Erfahrung, Metaphysik und Mathematik. Zweiter, analytischer Teil. August Wilhem Unzer, Königsberg, Germany (1825)

    Google Scholar 

  22. Hoffmann, J.: Vorhersage und Erkenntnis: Die Funktion von Antizipationen in der menschlichen Verhaltenssteuerung und Wahrnehmung. [Anticipation and cognition: The function of anticipations in human behavioral control and perception.], Hogrefe, Göttingen, Germany (1993)

    Google Scholar 

  23. Hoffmann, J., Sebald, A.: Lernmechanismen zum Erwerb verhaltenssteuernden Wissens [Learning mechanisms for the acquisation of knowledge for behavioral control]. Psychologische Rundschau 51, 1–9 (2000)

    Article  Google Scholar 

  24. Hoffmann, J., Sebald, A., Stöcker, C.: Irrelevant response effects improve serial learning in serial reaction time tasks. Journal of Experimental Psychology: Learning, Memory, and Cognition 27, 470–482 (2001)

    Article  Google Scholar 

  25. Hommel, B.: The cognitive representation of action: Automatic integration of perceived action effects. Psychological Research 59, 176–186 (1996)

    Article  Google Scholar 

  26. Hommel, B.: Perceiving one’s own action — and what it leads to. In: Jordan, J.S. (ed.) Systems theory and apriori aspects of perception, Systems theory and apriori aspects of perception, pp. 143–179. Elesevier Science B.V, Amsterdam (1998)

    Chapter  Google Scholar 

  27. James, W.: The Principles of Psychology, vol. 1. Harvard University Press, Cambridge (1981) (orig.1890)

    Google Scholar 

  28. James, W.: The Principles of Psychology, vol. 2. Harvard University Press, Cambridge (1981) (orig.1890)

    Google Scholar 

  29. Koch, I., Hoffmann, J.: Patterns, chunks, and hierarchies in serial reaction time tasks. Psychological Research 63, 22–35 (2000)

    Article  Google Scholar 

  30. Koch, I., Kunde, W.: Verbal response-effect compatibility. Memory and Cognition (2003) (in press)

    Google Scholar 

  31. Kornblum, S., Hasbroucq, T., Osman, A.: Dimensional overlap: Cognitive basis for stimulus response compatibility: A model and taxonomy. Psychological Review 97, 253–270 (1990)

    Article  Google Scholar 

  32. Kunde, W.: Temporal response-effect compatibility. Psychological Research (2003) (in press)

    Google Scholar 

  33. Kunde, W., Hoffmann, J., Zellmann, P.: The impact of anticipated action effects on action planning. Acta Psychologica 109, 137–155 (2002)

    Article  Google Scholar 

  34. Kunde, W., Koch, I., Hoffmann, J.: Anticipated action effects affect the selection, initiation and execution of actions. The Quarterly Journal of Experimental Psychology. Section A: Human Experimental Psychology (2003) (in press)

    Google Scholar 

  35. Kunde, W.: Response-effect compatibility in manual choice reaction tasks. Journal of Experimental Psychology: Human Perception and Performance 27, 387–394 (2001)

    Article  Google Scholar 

  36. Lewin, K.: Wille, Vorsatz und Bedürfnis. Psychologische Forschung 7, 330–385 (1928)

    Article  Google Scholar 

  37. Lotze, H.: Medizinische Psychologie oder Physiologie der Seele. Weidmann’sche Buchhandlung, Leipzig (1852)

    Google Scholar 

  38. Mandler, G.: Cognitive Psychology. In: An essay in cognitive science, Erlbaum, Hillsdale, NJ (1985)

    Google Scholar 

  39. Münsterberg, H.: Beiträge zur Experimentalpsychologie. Heft 1. J.C.B. Mohr, Freiburg i.B (1889)

    Google Scholar 

  40. Neisser, U.: Cognitive psychology. Appleton, New York (1967)

    Google Scholar 

  41. Nissen, M.J., Bullemer, P.: Attentional requirements of learning: Evidence from performance measures. Cognitive Psychology 19, 1–32 (1987)

    Article  Google Scholar 

  42. Pearce, J.M.: Animal learning and cognition, 2nd edn. Psychology Press, Hove (1997)

    Google Scholar 

  43. Prinz, W.: Ideomotor action. In: Heuer, H., Sanders, A.F. (eds.) Perspectives on perception and action, Erlbaum, Hillsdale, NJ, pp. 47–76 (1987)

    Google Scholar 

  44. Prinz, W.: Perception and action planning. European Journal of Cognitive Psychology 9, 129–154 (1997)

    Article  Google Scholar 

  45. Reber, A.S.: Implicit learning of artificial grammars. Journal of Verbal Learning and Verbal Behavior 6, 855–863 (1967)

    Article  Google Scholar 

  46. Reber, A.S.: Implicit learning and tacit knowledge. Journal of Experimental Psychology: General 118, 219–235 (1989)

    Article  Google Scholar 

  47. Rescorla, R.A.: Evidence for an association between the discriminative stimulus and the response-outcome association in instrumental learning. Journal of Experimental Psychology: Adaptive Behavior Processes 16, 326–334 (1990)

    Article  Google Scholar 

  48. Rescorla, R.A.: Associative relations in instrumental learning: The eighteenth Bartlett memorial lecture. Quarterly Journal of Experimental Psychology 43, 1–23 (1991)

    Google Scholar 

  49. Rescorla, R.A.: Full preservation of a response-outcome association through training with a second outcome. Quarterly Journal of Experimental Psychology 48, 252–261 (1995)

    Google Scholar 

  50. Seger, C.A.: Implicit learning. Psychological Bulletin 115, 163–196 (1994)

    Article  Google Scholar 

  51. Shanks, D.R.: Continuous monitoring of human contingency judgment across trials. Memory and Cognition 13, 158–167 (1985)

    Article  Google Scholar 

  52. Shanks, D.R., Dickinson, A.: Associative accounts of causality judgment. In: Bower, G.H. (ed.) The psychology of learning and motivation, vol. 21, pp. 229–261. Academic Press, San Diego (1987)

    Google Scholar 

  53. Simon, J.R., Rudel, A.P.: Auditory S-R compatibility: The effect of an irrelevant cue on information processing. Journal of Applied Psychology 51, 300–304 (1967)

    Article  Google Scholar 

  54. Stadler, M.A., Frensch, P.A.: Handbook of implicit learning. Sage Publications, Thousand Oaks (1998)

    Google Scholar 

  55. Stock, A., Hoffmann, J.: Intentional fixation of behavioral learning or how R-E learning blocks S-R learning. European Journal of Cognitive Psychology 14, 127–153 (2002)

    Article  Google Scholar 

  56. Stöcker, C., Sebald, A., Hoffmann, J.: The influence of response effect compatibility in a serial reaction time task. Quarterly Journal of Experimental Psychology (2003) (in press)

    Google Scholar 

  57. Stolzmann, W.: Antizipative Classifier Systems [Anticipatory classifier systems]. Shaker Verlag, Aachen (1997)

    Google Scholar 

  58. Stolzmann, W.: An introduction to anticipatory classifier systems. In: Lanzi, P.L., Stolzmann, W., Wilson, S.W. (eds.) Learning Classifier Systems: From Foundations to Applications, pp. 175–194. Springer, Heidelberg (2000)

    Chapter  Google Scholar 

  59. Sutton, R.S., Barto, A.G.: Reinforcement learning: An introduction. MIT Press, Cambridge (1998)

    Google Scholar 

  60. Thorndike, E.L.: Animal intelligence: Experimental studies. Macmillan, New York (1911)

    Google Scholar 

  61. Tolman, E.C.: Purposive Behavior in animals and men. Appleton, New York (1932)

    Google Scholar 

  62. Tolman, E.C.: There is more than one kind of learning. Psychological Review 5b, 144–155 (1949)

    Article  Google Scholar 

  63. Tolman, E.C., Honzik, C.: Introduction and removal of reward, and maze performance in rats. University of California, Publications in Psychology 4, 257–275 (1930)

    Google Scholar 

  64. Wasserman, E.A., Chatlosh, D.L., Neunaber, D.J.: Perception of causal relations in humans: Factors affecting judgments of interevent contingencies under freeoperant procedures. Learning and Motivation 14, 406–432 (1993)

    Article  Google Scholar 

  65. Wasserman, E.A., Elek, S.M., Chatlosh, D.L., Baker, A.G.: Rating causal relations: Role of probability in judgments of response-outcome contingency. Journal of Experimental Psychology: Learning, Memory, and Cognition 19, 174–188 (1993)

    Article  Google Scholar 

  66. Watson, J.B.: Psychology from the standpoint of a behaviorist, Lippincott, Philadelphia, vol. 2 (1924)

    Google Scholar 

  67. Watson, J.: Psychology as a behaviorist views it. Psychological Review 20, 158–177 (1913)

    Article  Google Scholar 

  68. Ziessler, M.: Response-effect learning as a major component of implicit serial learning. Journal of Experimental Psychology: Learning, Memory, and Cognition 24, 962–978 (1998)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Cognitive Psychology, University of Würzburg, Germany

    Joachim Hoffmann

Authors
  1. Joachim Hoffmann
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Department of Psychology, University of Würzburg, Röntgenring 11, 97070, Würzburg, Germany

    Martin V. Butz

  2. Animat Lab, University Paris VI, 104 Av du Président Kennedy, 75016, Paris, France

    Olivier Sigaud

  3. ADAge, LIPN, Univ. de Paris-Nord, 93 430, Villetaneuse, France

    Pierre Gérard

Rights and permissions

Reprints and permissions

Copyright information

© 2003 Springer-Verlag Berlin Heidelberg

About this chapter

Cite this chapter

Hoffmann, J. (2003). Anticipatory Behavioral Control. In: Butz, M.V., Sigaud, O., Gérard, P. (eds) Anticipatory Behavior in Adaptive Learning Systems. Lecture Notes in Computer Science(), vol 2684. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-45002-3_4

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-45002-3_4

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-40429-3

  • Online ISBN: 978-3-540-45002-3

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics

Search

Navigation