Top

Gepubliceerd in:

01-07-2012 | Original Article

Bidirectional semantic interference between action and speech

Auteurs: Roman Liepelt, Thomas Dolk, Wolfgang Prinz

Gepubliceerd in: Psychological Research | Uitgave 4/2012

Abstract

Research on embodied cognition assumes that language processing involves modal simulations that recruit the same neural systems that are usually used for action execution. If this is true, one should find evidence for bidirectional crosstalk between action and language. Using a direct matching paradigm, this study tested if action–languages interactions are bidirectional (Experiments 1 and 2), and whether the effect of crosstalk between action perception and language production is due to facilitation or interference (Experiment 3). Replicating previous findings, we found evidence for crosstalk when manual actions had to be performed simultaneously to action–word perception (Experiment 1) and also when language had to be produced during simultaneous perception of hand actions (Experiment 2). These findings suggest a clear bidirectional relationship between action and language. The latter crosstalk effect was due to interference between action and language (Experiment 3). By extending previous research of embodied cognition, the present findings provide novel evidence suggesting that bidirectional functional relations between action and language are based on similar conceptual–semantic representations.

vorige artikel Online prediction of others’ actions: the contribution of the target object, action context and movement kinematics

volgende artikel Language-induced modulation during the prediction of others’ actions

Barsalou, L. W. (2007). Grounding symbolic operations in the brain’s modal systems. In G. R. Semin & E. R. Smith (Eds.), Embodied grounding: Social, cognitive, affective, and neuroscientific approaches (pp. 9–42). New York: Cambridge University Press.

Barsalou, L. W. (2008). Grounded cognition. Annual Review of Psychology, 59, 617–645.PubMedCrossRef

Barsalou, L. W., & Wiemer-Hastings, K. (2005). Situating abstract concepts. In D. Pecher & R. Zwaan (Eds.), Grounding cognition: The role of perception and action in memory, language, and thought (pp. 129–163). New York: Cambridge University Press.CrossRef

Beringer, J. (2000). Experimental Runtime System (Version 3.32). [Computer software]. Frankfurt am Main, Germany: BeriSoft Corporation.

Bernardis, P., & Gentilucci, M. (2005). Speech and gesture share the same communication system. Neuropsychologia, 44, 178–190.PubMedCrossRef

Bertenthal, B. I., Longo, M. R., & Kosobud, A. (2006). Imitative response tendencies following observation of intransitive actions. Journal of Experimental Psychology: Human Perception and Performance, 32, 210–225.PubMedCrossRef

Blakemore, S. J., & Frith, C. (2005). The role of motor contagion in the prediction of action. Neuropsychologia, 43, 260–267.PubMedCrossRef

Boulenger, V., Roy, A. C., Paulignan, Y., Déprez, V., Jeannerod, M., & Nazir, T. A. (2006). Cross-talk between language processes and overt motor behaviour in the first 200 ms of processing. Journal of Cognitive Neuroscience, 18, 1607–1615.PubMedCrossRef

Brass, M., Bekkering, H., Wohlschläger, A., & Prinz, W. (2000). Compatibility between observed and executed finger movements: Comparing symbolic, spatial, and imitative cues. Brain Cognition, 44, 124–143.CrossRef

Buccino, G., Riggio, L., Melli, G., Binkofski, F., Gallese, B., & Rizzolatti, G. (2005). Listening to action-related sentences modulates the activity of the motor system: A combined TMS and behavioral study. Cognitive Brain Research, 24, 355–363.PubMedCrossRef

Chersi, F., Thill, S., Ziemke, T., & Borghi, A. M. (2010). Sentence processing: linking language to motor chains. Frontiers in neurorobotics, 4, 4.PubMedCrossRef

D’Ausilio, A., Pulvermüller, F., Salmas, P., et al. (2009). The motor somatotopy of speech perception. Current Biology, 19, 381–385.PubMedCrossRef

Decety, J., Perani, D., Jeannerod, M., Bettinardi, V., Tadardy, B., Woods, R., et al. (1994). Mapping motor representations with positron emission tomography. Nature, 371, 600–602.PubMedCrossRef

Fadiga, L., Craighero, L., Buccino, G., & Rizzolatti, G. (2002). Speech listening specifically modulates the excitability of tongue muscles: a TMS study. European Journal of Neuroscience, 15, 399–402.PubMedCrossRef

Fodor, J. A. (1983). Modularity of mind: An essay on faculty psychology. Cambridge: MIT Press.

Gallese, V., Fadiga, L., Fogassi, L., & Rizzolatti, G. (1996). Action recognition in the premotor cortex. Brain, 119, 593–609.PubMedCrossRef

Gentilucci, M., & Dalla Volta, R. (2008). Spoken language and arm gesture are controlled by the same motor control system. Quarterly Journal of Experimental Psychology, 61, 944–957.CrossRef

Gentilucci, M., Dalla Volta, R., & Gianelli, C. (2008). When the hand speak. Journal of Physiology–Paris, 102, 21–30.

Glenberg, A. M., & Kaschak, M. P. (2002). Grounding language in action. Psychonomic Bulletin & Review, 9, 558–565.CrossRef

Glenberg, A. M., Sato, M., & Cattaneo, L. (2008a). Use-induced motor plasticity affects the processing of abstract and concrete language. Current Biology, 18, R290–R291.PubMedCrossRef

Glenberg, A. M., Sato, M., Cattaneo, L., Riggio, L., Palumbo, D., & Buccino, G. (2008b). Processing abstract language modulates motor system activity. Quarterly Journal of Experimental Psychology, 61, 905–919.CrossRef

Grèzes, J., Armony, J. L., Rowe, J., & Passingham, R. E. (2003). Activations related to “mirror” and “canonical” neurones in the human brain: An fMRI study. Neuroimage, 18, 928–937.PubMedCrossRef

Heyes, C. (2001). Causes and consequences of imitation. Trends in Cognitive Sciences, 5, 253–261.PubMedCrossRef

Iacoboni, M., & Wilson, S. M. (2006). Beyond a single area: Motor control and language within a neural architecture encompassing Broca’s area. Cortex, 42, 503–506.PubMedCrossRef

Iacoboni, M., Woods, R. P., Brass, M., Bekkering, H., Mazziotta, J. C., & Rizzolatti, G. (1999). Cortical mechanisms of human imitation. Science, 286, 2526–2528.PubMedCrossRef

Kaschak, M. P., & Glenberg, A. M. (2000). Constructing meaning: The role of affordances and grammatical constructions in sentence comprehension. Journal of Memory and Language, 43, 508–529.CrossRef

Koski, L., Wohlschläger, A., Bekkering, H., Woods, R. P., Dubeau, M.-C., Mazziotta, J. C., et al. (2002). Modulation of motor and premotor activity during imitation of target-directed actions. Cerebral Cortex, 12, 847–855.PubMedCrossRef

Krauss, R. M., Dushay, R. A., Chen, Y. S., & Rauscher, F. (1995). The communicative value of conversational hand gestures. Journal of Experimental Social Psychology, 31(6), 533–552.CrossRef

Krauss, R. M., Morrel-Samuels, P., & Colasante, C. (1991). Do conversational hand gestures communicate? Journal of Personality and Social Psychology, 61(5), 743–754.PubMedCrossRef

Levelt, W. J., Richardson, G., & La Heij, W. (1985). Pointing and voicing in deictic expressions. Journal of Memory and Language, 24, 133–164.CrossRef

Liepelt, R., von Cramon, D. Y., & Brass, M. (2008a). What is matched in direct matching? Intention attribution modulates motor priming. Journal of Experimental Psychology: Human Perception and Performance, 34, 578–591.PubMedCrossRef

Liepelt, R., von Cramon, D. Y., & Brass, M. (2008b). How do we infer others’ goals from non-stereotypic actions? The outcome of context-sensitive inferential processing in right inferior parietal and posterior temporal cortex. NeuroImage, 43, 784–792.PubMedCrossRef

Mahon, B. Z., & Caramazza, A. (2008). A critical look at the embodied cognition hypothesis and a new proposal for grounding conceptual content. Journal of Physiology–Paris, 102, 59–70.

McNeill, D. (1992). Hand and Mind: What Gestures Reveal about Thought. Chicago: University of Chicago Press.

Meltzoff, A. N., & Moore, M. K. (1997). Explaining facial imitation: A theoretical model. Early Development and Parenting, 6, 179–192.CrossRef

Nishitani, N., Schürmann, M., Amunts, K., & Hari, R. (2005). Broca’s region: From action to language. Physiology, 20, 60–69.PubMedCrossRef

Oldfield, R. C. (1971). The assessment and analysis of handedness: The Edinburgh Inventory. Neuropsychologia, 9, 97–113.PubMedCrossRef

Press, C., Bird, G., Flach, R., & Heyes, C. (2005). Robotic movement elicits automatic imitation. Cognitive Brain Research, 25, 632–640.PubMedCrossRef

Pulvermüller, F. (2005). Brain mechanisms linking language and action. Nature Reviews Neuroscience, 6, 576–582.PubMedCrossRef

Pulvermüller, F., & Fadiga, L. (2010). Active perception: sensorimotor circuits as a cortical basis for language. Nature Reviews Neuroscience, 11, 351–360.PubMedCrossRef

Rizzolatti, G., & Arbib, M. A. (1998). Language within our grasp. Trends in Neurosciences, 21, 188–194.PubMedCrossRef

Rizzolatti, G., & Arbib, M. A. (1999). From grasping to speech: Imitation might provide a missing link: Reply. Trends in Neurosciences, 22, 152.PubMedCrossRef

Rizzolatti, G., & Craighero, L. (2004). The mirror-neuron system. Annual Review of Neuroscience, 27, 169–192.PubMedCrossRef

Rizzolatti, G., Fadiga, L., Gallese, V., & Fogassi, L. (1996). Premotor cortex and the recognition of motor actions. Brain Research. Cognitive Brain Research, 3, 131–141.PubMedCrossRef

Rizzolatti, G., Fogassi, L., & Gallese, V. (2001). Neurophysiological mechanisms underlying the understanding and imitation of action. Nature Reviews Neuroscience, 2, 661–670.PubMedCrossRef

Rueschemeyer, S.-A., Lindemann, O., van Rooij, D., van Dam, W., & Bekkering, H. (2010). Effects of intentional motor actions on embodied language processing. Experimental Psychology, 57, 260–266.PubMedCrossRef

Sato, M., Mengarelli, M., Riggio, L., Gallese, V., & Buccino, G. (2008). Task related modulation of the motor system during language processing. Brain and Language, 105, 83–90.PubMedCrossRef

Springer, A., & Prinz, W. (2010). Action semantics modulate action prediction. The Quarterly Journal of Experimental Psychology, 63, 2141–2158.PubMedCrossRef

Stürmer, B., Aschersleben, G., & Prinz, W. (2000). Correspondence effects with manual gestures and postures: A study of imitation. Journal of Experimental Psychology, 26, 1746–1759.

Tettamanti, M., Buccino, G., Saccuman, M. C., Gallese, V., Danna, M., Scifo, P., et al. (2005). Listening to action-related sentences activates fronto-parietal motor circuits. Journal of Cognitive Neuroscience, 17, 273–281.PubMedCrossRef

Titel: Bidirectional semantic interference between action and speech
Auteurs: Roman Liepelt
Thomas Dolk
Wolfgang Prinz
Publicatiedatum: 01-07-2012
Uitgeverij: Springer-Verlag
Gepubliceerd in: Psychological Research / Uitgave 4/2012
Print ISSN: 0340-0727
Elektronisch ISSN: 1430-2772
DOI: https://doi.org/10.1007/s00426-011-0390-z

Bohn Stafleu van Loghum

Deel dit onderdeel of sectie (kopieer de link)

Abstract

Log in om toegang te krijgen

Andere artikelen Uitgave 4/2012

Language-induced modulation during the prediction of others’ actions

Expecting to lift a box together makes the load look lighter

How does visuomotor priming differ for biological and non-biological stimuli? A review of the evidence

Simulating and predicting others’ actions

EEG correlates of Fitts’s law during preparation for action

Neural theory for the perception of causal actions