Abstract
Hungry rats were trained to press a lever for food pellets prior to an assessment of the effect of a shift in their motivational state on instrumental performance in extinction. The first study replicated the finding that a reduction in the level of food deprivation has no detectable effect on extinction performance unless the animals receive prior experience with the food pellets in the nondeprived state (Balleine, 1992; Balleine & Dickinson, 1994). When tested in the nondeprived state, only animals that were reexposed to the food pellets in this state between training and testing showed a reduction in the level of pressing during the extinction test relative to animals tested in the deprived state. The magnitude of this reexposure effect depended, however, on the amount of instrumental training. Following more extended instrumental training, extinction performance was unaffected by reexposure to the food pellets in the nondeprived state whether or not the animals were food deprived at the time of testing. A second study demonstrated that the resistance to the reexposure treatment engendered by overtraining was due to the animals’ increased experience of the food pellets in the deprived state during training rather than to the more extensive exposure to the instrumental contingency. In contrast to the results of the first two experiments, however, a reliable reexposure effect was detected after overtraining in a final study, in which the animals were given greater reexposure to the food pellets in the nondeprived state.
Article PDF
Similar content being viewed by others
References
Adams, C. D. (1982). Variations in the sensitivity of instrumental responding to reinforcer devaluation.Quarterly Journal of Experimental Psychology,34B, 77–98.
Balleine, B. (1992). Instrumental performance following a shift in primary motivation depends upon incentive learning.Journal of Experimental Psychology: Animal Behavior Processes,18, 236–250.
Balleine, B., Ball, J., &Dickinson, A. (1994). Benzodiazepine-induced outcome revaluation and the motivational control of instrumental action in rats.Behavioral Neuroscience,108, 573–589.
Balleine, B., &Dickinson, A. (1991). Instrumental performance following reinforcer devaluation depends upon incentive learning.Quarterly Journal of Experimental Psychology,43B, 279–296.
Balleine, B., &Dickinson, A. (1994). Role of cholecystokinin in the motivational control of instrumental action.Behavioral Neuroscience,108, 590–605.
Baum, W. M. (1973). The correlational-based law of effect.Journal of the Experimental Analysis of Behavior,20, 137–143.
Boakes, R. A. (1993). The role of repetition in transforming actions into habits: The contribution of John Watson and contemporary research to a persistent theme.Mexican Journal of Behavior Analysis,19, 67–90.
Capaldi, E. D., Davidson, T. L., &Myers, D. E. (1981). Resistance to satiation: Reinforcing effects of food and eating under satiation.Learning & Motivation,12, 171–195.
Capaldi, E. D., &Meyers, D. E. (1978). Resistance to satiation of consummatory and instrumental performance.Learning & Motivation,9, 197–201.
Colwill, R. M., &Rescorla, R. A. (1985). Instrumental responding remains sensitive to reinforcer devaluation after extensive training.Journal of Experimental Psychology: Animal Behavior Processes,11, 520–536.
Colwill, R. M., &Rescorla, R. A. (1988). The role of responsereinforcer associations increases throughout extended instrumental training.Animal Learning & Behavior,16, 105–111.
Dickinson, A. (1985). Actions and habits: The development of behavioural autonomy.Philosophical Transactions of the Royal Society of London: Series B,308, 76–78.
Dickinson, A. (1989). Expectancy theory in animal conditioning. In S. B. Klein & R. R. Mowrer (Eds.),Contemporary learning theories: Pavlovian conditioning and the status of traditional learning theories (pp. 279–308). Hillsdale, NJ: Erlbaum.
Dickinson, A., &Balleine, B. (1994). Motivational control of goaldirected action.Animal Learning & Behavior,22, 1–18.
Dickinson, A., &Dawson, G. R. (1988). Motivational control of instrumental performance: The role of prior experience of the reinforcer.Quarterly Journal of Experimental Psychology,40B, 113–134.
Dickinson, A., &Dawson, G. R. (1989). Incentive learning and the motivational control of instrumental performance.Quarterly Journal of Experimental Psychology,41B, 99–112.
Hull, C. L. (1943).Principles of behavior. New York: Appleton-Century-Crofts.
James, W. (1890).The principles of psychology. New York: Holt.
Lopez, M., Balleine, B., &Dickinson, A. (1992). Incentive learning and the motivational control of instrumental performance by thirst.Animal Learning & Behavior,20, 322–328.
Maier, S. F., &Seligman, M. E. P. (1976). Learned helplessness: Theory and evidence.Journal of Experimental Psychology: General,105, 3–46.
Morgan, M. J. (1974). Resistance to satiation.Animal Behaviour,22, 449–466.
Rescorla, R. A., &Solomon, R. L. (1967). Two-process learning theory: Relationship between Pavlovian conditioning and instrumental learning.Psychological Review,74, 151–182.
Tolman, E. C. (1949a). There is more than one kind of learning.Psychological Review,56, 144–155.
Tolman, E. C. (1949b). The nature and function of wants.Psychological Review,56, 357–369.
Tolman, E. C. (1959). Principles of purposive behavior. In S. Koch (Ed.),Psychology: A study of a science (Vol. 2, pp. 92–157). New York: McGraw-Hill.
Author information
Authors and Affiliations
Additional information
This research was supported by a grant from the SERC to A.D., and a Research Fellowship from Jesus College, Cambridge
—Accepted by previous editor, Vincent M. LoLordo
Rights and permissions
About this article
Cite this article
Dickinson, A., Balleine, B., Watt, A. et al. Motivational control after extended instrumental training. Animal Learning & Behavior 23, 197–206 (1995). https://doi.org/10.3758/BF03199935
Received:
Accepted:
Issue Date:
DOI: https://doi.org/10.3758/BF03199935