Hostname: page-component-848d4c4894-pftt2 Total loading time: 0 Render date: 2024-05-03T00:13:12.233Z Has data issue: false hasContentIssue false

Forming associations between language and sensorimotor traces during novel word learning

Published online by Cambridge University Press:  03 March 2016

BIRGIT ÖTTL*
Affiliation:
Department of Psychology, Eberhard Karls University, Tübingen, Germany
CAROLIN DUDSCHIG
Affiliation:
Department of Psychology, Eberhard Karls University, Tübingen, Germany
BARBARA KAUP
Affiliation:
Department of Psychology, Eberhard Karls University, Tübingen, Germany
*
Address for correspondence: Birgit Öttl, Department of Psychology, Eberhard Karls University, Schleichstraße 4, 72076 Tübingen, Germany. tel: +49-7071-29-75604; e-mail: birgit.oettl@uni-tuebingen.de

Abstract

Embodied models of language comprehension are based on the assumption that words become associated with sensorimotor experiences during initial word learning. To test this hypothesis, adult participants learned artificial words as labels for novel objects in a multisensory environment. In a word learning phase, novel objects were located in the participant’s upper or lower visual field and participants learned the objects’ names by interacting with them. In a test phase, participants responded to the color of the words with either an upwards or a downwards directed arm movement in a Stroop-like paradigm. Responses were fastest when the movement direction was compatible with the word’s referent location (i.e., the location of the novel object in vertical space) during the learning phase. This finding suggests that sensorimotor experiences become associated with words during initial word learning. The results of the current study and implications for language learning are discussed.

Type
Research Article
Copyright
Copyright © UK Cognitive Linguistics Association 2016 

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

references

Bergen, B., Lau, T.-T., Narayan, S., Stojanovic, D., & Wheeler, K. (2010). Body part representations in verbal semantics. Memory & Cognition, 38, 969981.Google Scholar
Borghi, A., Glenberg, A., & Kaschak, M. (2004). Putting words in perspective. Memory & Cognition, 32, 863873.Google Scholar
Boulenger, V., Silber, B. Y., Roy, A. C., Paulignan, Y., Jeannerod, M., & Nazir, T. A. (2008). Subliminal display of action words interferes with motor planning: a combined EEG and kinematic study. Journal of Physiology-Paris, 102, 130136.CrossRefGoogle ScholarPubMed
Bowerman, M. (1996). The origins of children’s spatial semantic categories: cognitive versus linguistic determinants. In Gumperz, J. J. & Levinson, S. C. (Eds.), Rethinking linguistic relativity (pp. 145176). Cambridge: Cambridge University Press.Google Scholar
Bub, D. N., Masson, M. E., & Cree, G. S. (2008). Evocation of functional and volumetric gestural knowledge by objects and words. Cognition, 106, 2758.Google Scholar
Cartmill, E. A., Hunsicker, D., & Goldin-Meadow, S. (2014). Pointing and naming are not redundant: children use gesture to modify nouns before they modify nouns in speech. Developmental Psychology, 50, 16601666.Google Scholar
Casasanto, D., & Chrysikou, E. G. (2011). When left is ‘right’: motor fluency shapes abstract concepts. Psychological Science, 22, 419422.Google Scholar
de Grauwe, S., Willems, R. M., Rueschemeyer, S.-A., Lemhöfer, K., & Schriefers, H. (2014). Embodied language in first- and second-language speakers: neural correlates of processing motor verbs. Neuropsychologia, 56, 334349.Google Scholar
Dudschig, C., de la Vega, I., & Kaup, B. (2014). Embodiment and second-language: automatic activation of motor responses during processing spatially associated L2 words and emotion L2 words in a vertical Stroop paradigm. Brain and Language, 132, 1421.Google Scholar
Dudschig, C., Souman, J., Lachmair, M., de la Vega, I., & Kaup, B. (2013). Reading ‘sun’ and looking up: the influence of language on saccadic eye movements in the vertical dimension. PLoS ONE 8: e56872. doi:10.1371/journal.pone.0056872.Google Scholar
Dunn, B. M., Kamide, Y., & Scheepers, C. (2014). Hearing ‘moon’ and looking up: word-related spatial associations facilitate saccades to congruent locations. Proceedings of the Cognitive Science Meeting. Online: <https://www.researchgate.net/profile/Ben_Dunn2/publication/269275729_Hearing_moon_and_looking_up_Word-related_spatial_associations_facilitate_saccades_to_congruent_locations/links/548596800cf24356db610366.pdf>..>Google Scholar
Engelen, J. A. A., Bouwmeester, S., de Bruin, A. B. H., & Zwaan, R. A. (2011). Perceptual simulation in developing language comprehension. Journal of Experimental Child Psychology, 110, 659675.Google Scholar
Fargier, R., Paulignan, Y., Boulenger, V., Monaghan, P., Reboul, A., & Nazir, T. A. (2012). Learning to associate novel words with motor actions: language-induced motor activity following short training. Cortex, 48, 888899.CrossRefGoogle ScholarPubMed
Fischer, M. H., & Zwaan, R. A. (2008). Embodied language: a review of the role of the motor system in language comprehension. Quarterly Journal of Experimental Psychology, 61, 825850.Google Scholar
Goodhew, S. C., McGaw, B., & Kidd, E. (2014). Why is the sunny side always up? Explaining the spatial mapping of concepts by language use. Psychonomic Bulletin & Review, 21, 12871293.Google Scholar
Hald, L. A., van den Hurk, M., & Bekkering, H. (2015). Learning verbs more effectively through meaning congruent action animations. Learning and Instruction, 39, 107122.Google Scholar
Hostetter, A., & Alibali, M. (2008). Visible embodiment: gestures as simulated action. Psychonomic Bulletin & Review, 15, 495514.Google Scholar
Hutchinson, S., & Louwerse, M. (2014). Language statistics explain the spatial–numerical association of response codes. Psychonomic Bulletin & Review, 21, 470478.Google Scholar
Iverson, J. M., & Goldin-Meadow, S. (2005). Gesture paves the way for language development. Psychological Science, 16, 367371.Google Scholar
Jared, D., Pei Yun Poh, R., & Paivio, A. (2013). L1 and L2 picture naming in Mandarin–English bilinguals: a test of Bilingual Dual Coding Theory. Bilingualism: Language and Cognition, 16, 383396.Google Scholar
Lachmair, M., Dudschig, C., De Filippis, M., de la Vega, I., & Kaup, B. (2011). Root versus roof: automatic activation of location information during word processing. Psychonomic Bulletin & Review, 18, 11801188.Google Scholar
Lebois, L. A. M., Wilson-Mendenhall, C. D., & Barsalou, L. W. (2015). Are automatic conceptual cores the gold standard of semantic processing? The context-dependence of spatial meaning in grounded congruency effects. Cognitive Science, 39(8), 17641801.Google Scholar
Loftus, G., & Masson, M. J. (1994). Using confidence intervals in within-subject designs. Psychonomic Bulletin & Review, 1, 476490.CrossRefGoogle ScholarPubMed
Louwerse, M. M. (2008). Embodied relations are encoded in language. Psychonomic Bulletin & Review, 15, 838844.Google Scholar
Louwerse, M. M., & Jeuniaux, P. (2010). The linguistic and embodied nature of conceptual processing. Cognition, 114, 96104.Google Scholar
Macedonia, M. (2014). Bringing back the body into the mind: gestures enhance word learning in foreign language. Frontiers in Psychology, 5, 1467.Google Scholar
Mahon, B. Z. (2014). What is embodied about cognition? Language, Cognition and Neuroscience, 30, 420429.Google Scholar
Mahon, B. Z., & Caramazza, A. (2008). A critical look at the embodied cognition hypothesis and a new proposal for grounding conceptual content. Journal of Physiology-Paris, 102, 5970.Google Scholar
Mayer, K. M., Yildiz, I. B., Macedonia, M., & von Kriegstein, K. (2015). Visual and motor cortices differentially support the translation of foreign language words. Current Biology, 25, 530535.Google Scholar
Needham, A., & Baillargeon, R. (1993). Intuitions about support in 4.5-month-old infants. Cognition, 47, 121148.Google Scholar
Pouw, W. T. J. L., De Nooijer, J. A., van Gog, T., Zwaan, R. A., & Paas, F. (2014). Towards a more embedded/extended perspective on the cognitive function of gestures. Frontiers in Psychology, 5.Google Scholar
Richter, T., Zwaan, R., & Hoever, I. (2009). Acquiring experiential traces in word–referent learning. Memory & Cognition, 37, 11871196.Google Scholar
Stanfield, R. A., & Zwaan, R. A. (2001). The effect of implied orientation derived from verbal context on picture recognition. Psychological Science, 12, 153156.Google Scholar
Stroop, J. R. (1935). Studies of interference in serial verbal reactions. Journal of Experimental Psychology, 18, 643662.Google Scholar
Willems, R. M., & Casasanto, D. (2011). Flexibility in embodied language understanding. Frontiers in Psychology, 2. Online: doi: 10.3389/fpsyg.2011.00116.Google Scholar
Yu, C., & Smith, L. B. (2012). Embodied attention and word learning by toddlers. Cognition, 125, 244262.Google Scholar
Zwaan, R. A., & Madden, C. J. (2005). Embodied sentence comprehension. In Pecher, D. & Zwaan, R. A. (Eds.), Grounding cognition: the role of perception and action in memory, language, and thinking (pp. 224245). Cambridge: Cambridge University Press.CrossRefGoogle Scholar