Skip to main content
Top
Gepubliceerd in: Psychological Research 4/2015

01-07-2015 | Original Article

Task-specific effects of reward on task switching

Auteurs: Akina Umemoto, Clay B. Holroyd

Gepubliceerd in: Psychological Research | Uitgave 4/2015

Log in om toegang te krijgen
share
DELEN

Deel dit onderdeel of sectie (kopieer de link)

  • Optie A:
    Klik op de rechtermuisknop op de link en selecteer de optie “linkadres kopiëren”
  • Optie B:
    Deel de link per e-mail

Abstract

Although cognitive control and reinforcement learning have been researched extensively over the last few decades, only recently have studies investigated their interrelationship. An important unanswered question concerns how the control system decides what task to execute and how vigorously to carry out the task once selected. Based on a recent theory of control formulated according to principles of hierarchical reinforcement learning, we asked whether rewards can affect top-down control over task performance at the level of task representation. Participants were rewarded for correctly performing only one of two tasks in a standard task-switching experiment. Reaction times and error rates were lower for the reinforced task compared to the non-reinforced task. Moreover, the switch cost in error rates for the non-reinforced task was significantly larger compared to the reinforced task, especially for trials in which the imperative stimulus afforded different responses for the two tasks, resulting in a “non-paradoxical” asymmetric switch cost. These findings suggest that reinforcement at the task level resulted in greater application of top-down control rather than in stronger stimulus–response pathways for the rewarded task.
Bijlagen
Alleen toegankelijk voor geautoriseerde gebruikers
Voetnoten
1
All subject error rates were <20 % except for one participant (20.4 %); the results did not change when his/her data were excluded from the analyses.
 
2
Because the current study was not intended to distinguish between competing accounts of whether the rewards enhance activation of the reinforced task versus inhibit activation of the non-reinforced task, future research is needed to investigate this question.
 
Literatuur
go back to reference Allport, A., Styles, E. A., & Hsieh, S. (1994). Shifting international set: exploring the dynamic control of tasks. In C. Umilta & M. Moscovitch (Eds.), Attention and performance XV (pp. 421–452). Cambridge: MIT Press. Allport, A., Styles, E. A., & Hsieh, S. (1994). Shifting international set: exploring the dynamic control of tasks. In C. Umilta & M. Moscovitch (Eds.), Attention and performance XV (pp. 421–452). Cambridge: MIT Press.
go back to reference Anderson, B. A. (2013). A value-driven mechanism of attentional selection. Journal of Vision, 13, 1–16. Anderson, B. A. (2013). A value-driven mechanism of attentional selection. Journal of Vision, 13, 1–16.
go back to reference Arrington, C. M., & Logan, G. D. (2004). The cost of a voluntary task switch. Psychological Science, 15, 610–615.PubMedCrossRef Arrington, C. M., & Logan, G. D. (2004). The cost of a voluntary task switch. Psychological Science, 15, 610–615.PubMedCrossRef
go back to reference Arrington, C. M., & Logan, G. D. (2005). Voluntary task switching: chasing the elusive homunculus. Journal of Experimental Psychology: Learning, Memory, and Cognition, 31, 683–702.PubMed Arrington, C. M., & Logan, G. D. (2005). Voluntary task switching: chasing the elusive homunculus. Journal of Experimental Psychology: Learning, Memory, and Cognition, 31, 683–702.PubMed
go back to reference Botvinick, M. M. (2007). Conflict monitoring and decision making: reconciling two perspectives on anterior cingulate function. Cognitive, Affective and Behavioral Neuroscience, 7, 356–366.PubMedCrossRef Botvinick, M. M. (2007). Conflict monitoring and decision making: reconciling two perspectives on anterior cingulate function. Cognitive, Affective and Behavioral Neuroscience, 7, 356–366.PubMedCrossRef
go back to reference Botvinick, M. M. (2012). Hierarchical reinforcement learning and decision making. Current Opinion in Neurobiology, 22, 956–962.PubMedCrossRef Botvinick, M. M. (2012). Hierarchical reinforcement learning and decision making. Current Opinion in Neurobiology, 22, 956–962.PubMedCrossRef
go back to reference Botvinick, M. M., Braver, T. S., Barch, D. M., Carter, C. S., & Cohen, J. D. (2001). Conflict monitoring and cognitive control. Psychological Review, 108, 624–652.PubMedCrossRef Botvinick, M. M., Braver, T. S., Barch, D. M., Carter, C. S., & Cohen, J. D. (2001). Conflict monitoring and cognitive control. Psychological Review, 108, 624–652.PubMedCrossRef
go back to reference Botvinick, M. M., Niv, Y., & Barto, A. C. (2009). Hierarchically organized behavior and its neural foundations: a reinforcement learning perspective. Cognition, 113, 262–280.PubMedCentralPubMedCrossRef Botvinick, M. M., Niv, Y., & Barto, A. C. (2009). Hierarchically organized behavior and its neural foundations: a reinforcement learning perspective. Cognition, 113, 262–280.PubMedCentralPubMedCrossRef
go back to reference Braem, S., Verguts, T., Roggerman, C., & Notebaert, W. (2012). Reward modulates adaptations to conflict. Cognition, 125, 324–332.PubMedCrossRef Braem, S., Verguts, T., Roggerman, C., & Notebaert, W. (2012). Reward modulates adaptations to conflict. Cognition, 125, 324–332.PubMedCrossRef
go back to reference Chiew, K. S., & Braver, T. S. (2011). Positive affect versus reward: emotional and motivational influences on cognitive control. Frontiers in Psychology, 2, 1–10. Chiew, K. S., & Braver, T. S. (2011). Positive affect versus reward: emotional and motivational influences on cognitive control. Frontiers in Psychology, 2, 1–10.
go back to reference Cohen, J. D., Dunbar, K., & McClelland, J. L. (1990). On the control of automatic processes: a parallel distributed processing account of the Stroop effect. Psychological Review, 97, 332–361.PubMedCrossRef Cohen, J. D., Dunbar, K., & McClelland, J. L. (1990). On the control of automatic processes: a parallel distributed processing account of the Stroop effect. Psychological Review, 97, 332–361.PubMedCrossRef
go back to reference Dosenbach, N. U., Visscher, K. M., Palmer, E. D., Miezin, F. M., Wenger, K. K., Kang, H. C., et al. (2006). A core system for the implementation of task sets. Neuron, 50(5), 799–812.PubMedCentralPubMedCrossRef Dosenbach, N. U., Visscher, K. M., Palmer, E. D., Miezin, F. M., Wenger, K. K., Kang, H. C., et al. (2006). A core system for the implementation of task sets. Neuron, 50(5), 799–812.PubMedCentralPubMedCrossRef
go back to reference Dreisbach, G., & Fischer, R. (2012). The role of affect and reward in the conflict-triggered adjustment of cognitive control. Frontiers in Human Neuroscience, 6, 342.PubMedCentralPubMedCrossRef Dreisbach, G., & Fischer, R. (2012). The role of affect and reward in the conflict-triggered adjustment of cognitive control. Frontiers in Human Neuroscience, 6, 342.PubMedCentralPubMedCrossRef
go back to reference Dreisbach, G., & Goschke, T. (2004). How positive affect modulates cognitive control: reduced perseveration at the cost of increased distractibility. Journal of Experimental Psychology. Learning, Memory, and Cognition, 30, 343–353.PubMedCrossRef Dreisbach, G., & Goschke, T. (2004). How positive affect modulates cognitive control: reduced perseveration at the cost of increased distractibility. Journal of Experimental Psychology. Learning, Memory, and Cognition, 30, 343–353.PubMedCrossRef
go back to reference Egner, T. (2007). Congruency sequence effects and cognitive control. Cognitive, Affective, & Behavioral Neuroscience, 7, 380–390.CrossRef Egner, T. (2007). Congruency sequence effects and cognitive control. Cognitive, Affective, & Behavioral Neuroscience, 7, 380–390.CrossRef
go back to reference Eriksen, B. A., & Eriksen, C. W. (1974). Effects of noise letters upon the identification of a target letter in a non-search task. Perception and Psychophysics, 16, 143–149.CrossRef Eriksen, B. A., & Eriksen, C. W. (1974). Effects of noise letters upon the identification of a target letter in a non-search task. Perception and Psychophysics, 16, 143–149.CrossRef
go back to reference Forstmann, B. U., Brass, M., Koch, I., & von Cramon, D. Y. (2006). Voluntary selection of task sets revealed by functional magnetic resonance imaging. Journal of Cognitive Neuroscience, 18, 388–398.PubMedCrossRef Forstmann, B. U., Brass, M., Koch, I., & von Cramon, D. Y. (2006). Voluntary selection of task sets revealed by functional magnetic resonance imaging. Journal of Cognitive Neuroscience, 18, 388–398.PubMedCrossRef
go back to reference Gilbert, S. J., & Shallice, T. (2002). Task switching: a PDP model. Cognitive Psychology, 44, 297–337.PubMedCrossRef Gilbert, S. J., & Shallice, T. (2002). Task switching: a PDP model. Cognitive Psychology, 44, 297–337.PubMedCrossRef
go back to reference Gratton, G., Coles, M. G. H., & Donchin, E. (1992). Optimizing the use of information: strategic control of activation of responses. Journal of Experimental Psychology: General, 121, 480–506.CrossRef Gratton, G., Coles, M. G. H., & Donchin, E. (1992). Optimizing the use of information: strategic control of activation of responses. Journal of Experimental Psychology: General, 121, 480–506.CrossRef
go back to reference Holroyd, C. B., & McClure, S. M. (2014). Hierarchical control over effortful behavior by anterior cingulate cortex. Manuscript submitted for publication. Holroyd, C. B., & McClure, S. M. (2014). Hierarchical control over effortful behavior by anterior cingulate cortex. Manuscript submitted for publication.
go back to reference Holroyd, C. B., & Yeung, N. (2012). Motivation of extended behaviors by anterior cingulate cortex. Trends in Cognitive Sciences, 16, 122–128.PubMedCrossRef Holroyd, C. B., & Yeung, N. (2012). Motivation of extended behaviors by anterior cingulate cortex. Trends in Cognitive Sciences, 16, 122–128.PubMedCrossRef
go back to reference Hyafil, A., Summerfield, C., & Koechlin, E. (2009). Two mechanisms for task switching in the prefrontal cortex. Journal of Neuroscience, 29, 5135–5142.PubMedCrossRef Hyafil, A., Summerfield, C., & Koechlin, E. (2009). Two mechanisms for task switching in the prefrontal cortex. Journal of Neuroscience, 29, 5135–5142.PubMedCrossRef
go back to reference Jersild, A. T. (1927). Mental set and shift. Archives of Psychology, 89, 5–89. Jersild, A. T. (1927). Mental set and shift. Archives of Psychology, 89, 5–89.
go back to reference Jung, M. W., Baeg, E. H., Kim, M. J., Kim, Y. B., & Kim, J. J. (2008). Plasticity and memory in the prefrontal cortex. Reviews in the Neurosciences, 19, 29–46.PubMedCrossRef Jung, M. W., Baeg, E. H., Kim, M. J., Kim, Y. B., & Kim, J. J. (2008). Plasticity and memory in the prefrontal cortex. Reviews in the Neurosciences, 19, 29–46.PubMedCrossRef
go back to reference Kahnt, T., Grueschow, M., Speck, O., & Haynes, J.-D. (2011). Perceptual learning and decision-making in human medial frontal cortex. Neuron, 70, 549–559.PubMedCrossRef Kahnt, T., Grueschow, M., Speck, O., & Haynes, J.-D. (2011). Perceptual learning and decision-making in human medial frontal cortex. Neuron, 70, 549–559.PubMedCrossRef
go back to reference Kanske, P., & Kotz, S. A. (2011). Conflict processing is modulated by positive emotion: ERP data from a flanker task. Behavioral Brain Research, 219, 382–386.CrossRef Kanske, P., & Kotz, S. A. (2011). Conflict processing is modulated by positive emotion: ERP data from a flanker task. Behavioral Brain Research, 219, 382–386.CrossRef
go back to reference Kiesel, A., Steinhauser, M., Wendt, M., Falkenstein, M., Jost, K., Philipp, A. M., et al. (2010). Control and interference in task switching—a review. Psychological Bulletin, 136(5), 849.PubMedCrossRef Kiesel, A., Steinhauser, M., Wendt, M., Falkenstein, M., Jost, K., Philipp, A. M., et al. (2010). Control and interference in task switching—a review. Psychological Bulletin, 136(5), 849.PubMedCrossRef
go back to reference Kleinsorge, T., & Rinkenauer, G. (2012). Effects of monetary incentives on task switching. Experimental psychology, 59(4), 216.PubMedCrossRef Kleinsorge, T., & Rinkenauer, G. (2012). Effects of monetary incentives on task switching. Experimental psychology, 59(4), 216.PubMedCrossRef
go back to reference Kouneiher, F., Charron, S., & Koechlin, E. (2009). Motivation and cognitive control in the human prefrontal cortex. Nature Neuroscience, 12, 939–945.PubMedCrossRef Kouneiher, F., Charron, S., & Koechlin, E. (2009). Motivation and cognitive control in the human prefrontal cortex. Nature Neuroscience, 12, 939–945.PubMedCrossRef
go back to reference Krebs, R. M., Boehler, C. N., Appelbaum, L. G., & Woldorff, M. G. (2013). Reward associations reduce behavioral interference by changing the temporal dynamics of conflict processing. PLoS One, 8, e53894.PubMedCentralPubMedCrossRef Krebs, R. M., Boehler, C. N., Appelbaum, L. G., & Woldorff, M. G. (2013). Reward associations reduce behavioral interference by changing the temporal dynamics of conflict processing. PLoS One, 8, e53894.PubMedCentralPubMedCrossRef
go back to reference Krebs, R. M., Boehler, C. N., Egner, T., & Woldorff, M. G. (2011). The neural underpinnings of how reward associations can both guide and misguide attention. Journal of Neuroscience, 31, 9752–9759.PubMedCentralPubMedCrossRef Krebs, R. M., Boehler, C. N., Egner, T., & Woldorff, M. G. (2011). The neural underpinnings of how reward associations can both guide and misguide attention. Journal of Neuroscience, 31, 9752–9759.PubMedCentralPubMedCrossRef
go back to reference Krebs, R. M., Boehler, C. N., & Woldorff, M. G. (2010). The influence of reward associations on conflict processing in the Stroop task. Cognition, 117, 341–347.PubMedCentralPubMedCrossRef Krebs, R. M., Boehler, C. N., & Woldorff, M. G. (2010). The influence of reward associations on conflict processing in the Stroop task. Cognition, 117, 341–347.PubMedCentralPubMedCrossRef
go back to reference Kruglanski, A. W., Shah, J. Y., Fishbach, A., Friedman, R., Chun, W. Y., & Sleeth-Keppler, D. (2002). A theory of goal-systems. Advances in Experimental Social Psychology, 34, 311–378. Kruglanski, A. W., Shah, J. Y., Fishbach, A., Friedman, R., Chun, W. Y., & Sleeth-Keppler, D. (2002). A theory of goal-systems. Advances in Experimental Social Psychology, 34, 311–378.
go back to reference Locke, H. S., & Braver, T. S. (2008). Motivational influences on cognitive control: behavior, brain activation, and individual differences. Cognitive, Affective, & Behavioral Neuroscience, 8, 99–112.CrossRef Locke, H. S., & Braver, T. S. (2008). Motivational influences on cognitive control: behavior, brain activation, and individual differences. Cognitive, Affective, & Behavioral Neuroscience, 8, 99–112.CrossRef
go back to reference Meiran, N. (1996). Reconfiguration of processing mode prior to task performance. Journal of Experimental Psychology. Learning, Memory, and Cognition, 22, 1423–1442.CrossRef Meiran, N. (1996). Reconfiguration of processing mode prior to task performance. Journal of Experimental Psychology. Learning, Memory, and Cognition, 22, 1423–1442.CrossRef
go back to reference Miller, E. K., & Cohen, J. D. (2001). An integrative theory of prefrontal cortex function. Annual Review of Neuroscience, 24, 167–202.PubMedCrossRef Miller, E. K., & Cohen, J. D. (2001). An integrative theory of prefrontal cortex function. Annual Review of Neuroscience, 24, 167–202.PubMedCrossRef
go back to reference Monsell, S., Yeung, N., & Azuma, R. (2000). Reconfiguration of task-set: is it easier to switch to the weaker task? Psychological Research, 63, 250–264.PubMedCrossRef Monsell, S., Yeung, N., & Azuma, R. (2000). Reconfiguration of task-set: is it easier to switch to the weaker task? Psychological Research, 63, 250–264.PubMedCrossRef
go back to reference Norman, D. A., & Shallice, T. (1986). Attention to action: willed and automatic control of behavior. In R. J. Davidson, G. E. Schwartz, & D. Shapiro (Eds.), Consciousness and self-regulation (Vol. 4, pp. 1–18). New York, London: Plenum Press.CrossRef Norman, D. A., & Shallice, T. (1986). Attention to action: willed and automatic control of behavior. In R. J. Davidson, G. E. Schwartz, & D. Shapiro (Eds.), Consciousness and self-regulation (Vol. 4, pp. 1–18). New York, London: Plenum Press.CrossRef
go back to reference Padmala, S., & Pessoa, L. (2011). Reward reduces conflict by enhancing attentional control and biasing visual cortical processing. Journal of Cognitive Neuroscience, 23, 3419–3432.PubMedCentralPubMedCrossRef Padmala, S., & Pessoa, L. (2011). Reward reduces conflict by enhancing attentional control and biasing visual cortical processing. Journal of Cognitive Neuroscience, 23, 3419–3432.PubMedCentralPubMedCrossRef
go back to reference Pelli, D. G. (1997). The VideoToolbox software for visual psychophysics: transforming number into movies. Spatial Vision, 10, 437–442.PubMedCrossRef Pelli, D. G. (1997). The VideoToolbox software for visual psychophysics: transforming number into movies. Spatial Vision, 10, 437–442.PubMedCrossRef
go back to reference Rogers, R. D., & Monsell, S. (1995). The cost of a predictable switch between simple cognitive tasks. Journal of Experimental Psychology: General, 124, 207–231.CrossRef Rogers, R. D., & Monsell, S. (1995). The cost of a predictable switch between simple cognitive tasks. Journal of Experimental Psychology: General, 124, 207–231.CrossRef
go back to reference Ruthruff, E., Remington, R. W., & Johnston, J. C. (2001). Switching between simple cognitive tasks: the interaction of top-down and bottom-up factors. Journal of Experimental Psychology: Human Perception and Performance, 27, 1404–1419.PubMed Ruthruff, E., Remington, R. W., & Johnston, J. C. (2001). Switching between simple cognitive tasks: the interaction of top-down and bottom-up factors. Journal of Experimental Psychology: Human Perception and Performance, 27, 1404–1419.PubMed
go back to reference Shenhav, A., Botvinick, M. M., & Cohen, J. D. (2013). The expected value of control: an integrative theory of anterior cingulated cortex function. Neuron, 79, 217–240.PubMedCentralPubMedCrossRef Shenhav, A., Botvinick, M. M., & Cohen, J. D. (2013). The expected value of control: an integrative theory of anterior cingulated cortex function. Neuron, 79, 217–240.PubMedCentralPubMedCrossRef
go back to reference Spector, A., & Biederman, I. (1976). Mental set and mental shift revisited. American Journal of Psychology, 89, 669–679.CrossRef Spector, A., & Biederman, I. (1976). Mental set and mental shift revisited. American Journal of Psychology, 89, 669–679.CrossRef
go back to reference Stroop, J. R. (1935). Studies of interference in serial verbal reaction. Journal of Experimental Psychology, 18, 643–662.CrossRef Stroop, J. R. (1935). Studies of interference in serial verbal reaction. Journal of Experimental Psychology, 18, 643–662.CrossRef
go back to reference Sturmer, B., Nigbur, R., Schacht, A., & Sommer, W. (2011). Reward and punishment effects on error processing and conflict control. Frontiers in Psychology, 2, 355.CrossRef Sturmer, B., Nigbur, R., Schacht, A., & Sommer, W. (2011). Reward and punishment effects on error processing and conflict control. Frontiers in Psychology, 2, 355.CrossRef
go back to reference Sutton, R. S., & Barto, A. G. (1998). Reinforcement learning: an introduction. Cambridge: MIT Press. Sutton, R. S., & Barto, A. G. (1998). Reinforcement learning: an introduction. Cambridge: MIT Press.
go back to reference Thorndike, E. L. (1911). Animal intelligence. New York: Macmillan. Thorndike, E. L. (1911). Animal intelligence. New York: Macmillan.
go back to reference van Steenbergen, H., Band, G. P. H., & Hommel, B. (2009). Reward counteracts conflict adaptation: evidence for a role of affect in executive control. Psychological Science, 20, 1473–1477.PubMedCrossRef van Steenbergen, H., Band, G. P. H., & Hommel, B. (2009). Reward counteracts conflict adaptation: evidence for a role of affect in executive control. Psychological Science, 20, 1473–1477.PubMedCrossRef
go back to reference van Steenbergen, H., Band, G. P. H., & Hommel, B. (2012). Reward valence modulates conflict-driven attentional adaptation: electrophysiological evidence. Biolodical Psychology, 90, 234–241.CrossRef van Steenbergen, H., Band, G. P. H., & Hommel, B. (2012). Reward valence modulates conflict-driven attentional adaptation: electrophysiological evidence. Biolodical Psychology, 90, 234–241.CrossRef
go back to reference Verguts, T., & Notebaert, W. (2008). Hebbian learning of cognitive control: dealing with specific and nonspecific adaptation. Psychological Review, 115(2), 518.PubMedCrossRef Verguts, T., & Notebaert, W. (2008). Hebbian learning of cognitive control: dealing with specific and nonspecific adaptation. Psychological Review, 115(2), 518.PubMedCrossRef
go back to reference Verguts, T., & Notebaert, W. (2009). Adaptation by binding: a learning account of cognitive control. Trends in cognitive sciences, 13(6), 252–257.PubMedCrossRef Verguts, T., & Notebaert, W. (2009). Adaptation by binding: a learning account of cognitive control. Trends in cognitive sciences, 13(6), 252–257.PubMedCrossRef
go back to reference Yeung, N., & Monsell, S. (2003a). Switching between tasks of unequal familiarity: the role of stimulus-attribute and response-set selection. Journal of Experimental Psychology: Human Perception and Performance, 29, 455–469.PubMed Yeung, N., & Monsell, S. (2003a). Switching between tasks of unequal familiarity: the role of stimulus-attribute and response-set selection. Journal of Experimental Psychology: Human Perception and Performance, 29, 455–469.PubMed
go back to reference Yeung, N., & Monsell, S. (2003b). The effects of recent practice on task switching. Journal of Experimental Psychology: Human Perception and Performance, 29, 919–936.PubMed Yeung, N., & Monsell, S. (2003b). The effects of recent practice on task switching. Journal of Experimental Psychology: Human Perception and Performance, 29, 919–936.PubMed
Metagegevens
Titel
Task-specific effects of reward on task switching
Auteurs
Akina Umemoto
Clay B. Holroyd
Publicatiedatum
01-07-2015
Uitgeverij
Springer Berlin Heidelberg
Gepubliceerd in
Psychological Research / Uitgave 4/2015
Print ISSN: 0340-0727
Elektronisch ISSN: 1430-2772
DOI
https://doi.org/10.1007/s00426-014-0595-z

Andere artikelen Uitgave 4/2015

Psychological Research 4/2015 Naar de uitgave