Abstract
It has been proposed that articulatory gestures are shaped by tight integration in planning mouth and hand acts. This hypothesis is supported by recent behavioral evidence showing that response selection between the precision and power grip is systematically influenced by simultaneous articulation of a syllable. For example, precision grip responses are performed relatively fast when the syllable articulation employs the tongue tip (e.g., [te]), whereas power grip responses are performed relatively fast when the syllable articulation employs the tongue body (e.g., [ke]). However, this correspondence effect, and other similar effects that demonstrate the interplay between grasping and articulatory gestures, has been found when the grasping is performed during overt articulation. The present study demonstrates that merely reading the syllables silently (Experiment 1) or hearing them (Experiment 2) results in a similar correspondence effect. The results suggest that the correspondence effect is based on integration in planning articulatory gestures and grasping rather than requiring an overt articulation of the syllables. We propose that this effect reflects partially overlapped planning of goal shapes of the two distal effectors: a vocal tract shape for articulation and a hand shape for grasping. In addition, the paper shows a pitch–grip correspondence effect in which the precision grip is associated with a high-pitched vocalization of the auditory stimuli and the power grip is associated with a low-pitched vocalization. The underlying mechanisms of this phenomenon are discussed in relation to the articulation–grip correspondence.
Similar content being viewed by others
References
Bakan P, Alperson B (1967) Pronounceability, attensity, and interference in the color-word test. Am J Psychol 80:416–420
Barch DM, Sabb FW, Carter CS, Braver TS, Noll DC, Cohen JD (1999) Overt verbal responding during fMRI scanning: empirical investigations of problems and potential solutions. NeuroImage 10:642–657
Binkofski P, Buccino G (2004) Motor functions of the Broca’s region. Brain Lang 89:362–369
Browman CP, Goldstein L (1989) Articulatory gestures as phonological units. Phonology 6:201–251
Corballis MC (2002) From hand to mouth. Princeton University Press, Princeton, The origins of language
Dennis I, Newstead SE (1981) Is phonological recoding under strategic control? Mem Cognit 9:472–477
Devlin JT, Aydelott J (2009) Speech perception: motoric contributions versus the motor theory. Curr Biol 19:198–200
Doupe AJ, Kuhl PK (1999) Birdsong and human speech: common themes and mechanisms. Annu Rev Neurosci 22:567–631
Eiter BM, Inhoff AW (2008) Visual word recognition is accompanied by covert articulation: evidence for a speech-like phonological representation. Psychol Res 72:666–674
Ellis R, Tucker M (2000) Micro-affordance: the potentiation of components of action by seen objects. Br J Psychol 9:451–471
Ellis R, Tucker M, Symes E, Vainio L (2007) Does selecting one visual object from several require inhibition of the actions associated with nonselected objects? J Exp Psychol Hum Percept Perform 33:670–691
Fadiga L, Craighero L, Buccino G, Rizzolatti G (2002) Speech listening specifically modulates the excitability of tongue muscles: a TMS study. Eur J Neurosci 15:399–402
Fazio P, Cantagallo A, Craighero L, D’Ausilio A, Roy AC, Pozzo T, Calzolari F, Granieri E, Fadiga L (2009) Encoding of human action in Broca’s area. Brain 132:1080–1988
Floel A, Ellger T, Breitenstein C, Knecht S (2003) Language perception activates the hand motor cortex: implications for motor theories of speech perception. Eur J Neurosci 18:704–708
Fogassi L, Ferrari PF, Gesierich B, Rozzi S, Chersi F, Rizzolatti G (2005) Parietal lobe: from action to understanding. Science 308:662–667
Gentilucci M, Campione GC (2011) Do postures of distal effectors affect the control of actions of other distal effectors? Evidence for a system of interactions between hand and mouth. PLoS ONE 6(5):e19793
Gentilucci M, Corballis MC (2006) From manual gesture to speech: a gradual transition. Neurosci Biobehav Rev 30:949–960
Gentilucci M, Benuzzi F, Bertolani L, Daprati E, Gangitano M (2000) Language and motor control. Exp Brain Res 133:468–490
Gentilucci M, Benuzzi F, Gangitano M, Grimaldi S (2001) Grasping with hand and mouth: a kinematic study on healthy subjects. J Neurophysiol 86:1685–1699
Gentilucci M, Campione GC, Dalla Volta R, Bernardis P (2009) The observation of manual grasp actions affects the control of speech: a combined behavioral and transcranial magnetic stimulation study. Neuropsychologia 47:3190–3202
Glover S, Dixon P (2002) Semantics affects the planning but not the control of grasping. Exp Brain Res 146:383–387
Gracco VL (1997) A neuromotor perspective on speech production. In: Hulstijn W, Peters HFM, Van Lieshout PHHM (eds) Speech Production: Motor Control Brain Research and Fluency Disorders. Elsevier, Amsterdam, pp 38–56
Grafton ST (2010) The cognitive neuroscience of prehension: recent developments. Exp Brain Res 204:475–491
Greenfield PM (1991) Language, tools, and brain: the ontogeny and phylogeny of hierarchically organized sequential behavior. Behav Brain Sci 14:531–551
Hewes GW (1973) Primate communication and the gestural origins of language. Curr Anthropol 14:5–24
Hickok G, Poeppel D (2004) Dorsal and ventral streams: a framework for understanding aspects of the functional anatomy of language. Cognition 92:67–99
Higginbotham DR, Isaak MI, Domingue JM (2008) The exaptation of manual dexterity for articulate speech: an electromyogram investigation. Exp Brain Res 186:603–609
Kendon A (2004) Gesture: Visible Action as Utterance. Cambridge University Press, Cambridge
Krauss RM, Hadar U (1999) The role of speech-related arm/hand gestures in word retrieval. In: Campbell R, Messing L (eds) Gesture, speech, and sign. Oxford University Press, Oxford, pp 93–116
Levelt WJM, Richardson G, La Heij W (1985) Pointing and voicing in deictic expressions. J Mem Lang 24:133–164
Liberman M, Cooper FS, Shankweiler DS, Studdert-Kennedy M (1967) Perception of the speech code. Psychol Rev 74:431–461
Makris S, Grant S, Hadar AA, Yarrow K (2013) Binocular vision enhances a rapidly evolving affordance priming effect: behavioural and TMS evidence. Brain Cognit 83:279–287
Mayer EA (1869) Zur Tonbewegung des Vokals im gesprochenen and gesungenen einzelwort. Phonetische Studien (Beiblatt zu der Zeitschrift Die Neuren Sprachen) 10:1–21
McGuigan FJ (1970) Covert oral behavior during the silent performance of language tasks. Psychol Bull 74:309–326
McNeill D (1992) Hand and Mind. University of Chicago Press, Chicago
Meister IG, Boroojerdi B, Foltys H, Sparing R, Huber W, Topper R (2003) Motor cortex hand area and speech: implications for the development of language. Neuropsychologia 41:401–406
Möttönen R, Watkins KE (2012) Using TMS to study the role of the articulatory motor system in speech perception. Aphasiology 26:1103–1118
Palmer ED, Rosen HJ, Ojemann JG, Buckner RL, Kelley WM, Petersen SE (2001) An event-related fMRI study of overt and covert word stem completion. NeuroImage 14:182–193
Parise CV, Spence C (2009) When birds of a feather flock together: synesthetic correspondences modulate audiovisual integration in non-synesthetes. PLoS ONE 4(5):e5664
Pulvermüller F, Huss M, Kherif F, Martin F, Hauk O, Shtyrov Y (2006) Motor cortex maps articulatory features of speech sounds. Proc Natl Acad Sci USA 103:7865–7870
Ramachandran VS, Hubbard EM (2001) Synaesthesia—a window into perception, thought and language. J Conscious Stud 8:3–34
Rizzolatti G, Gentilucci M, Fogassi L, Luppino G, Matelli M, Ponzoni-Maggi S (1987) Neurons related to goal-directed motor acts in inferior area 6 of the macaque monkey. Exp Brain Res 67:220–224
Rizzolatti G, Camarda R, Fogassi L, Gentilucci M, Luppino G, Matelli M (1988) Functional organization of inferior area 6 in the macaque monkey: II. Area F5 and the control of distal movements. Exp Brain Res 71:491–507
Salmelin R, Sams M (2002) Motor cortex involvement during verbal versus non-verbal lip and tongue movements. Hum Brain Mapp 16:81–91
Spence C (2011) Crossmodal correspondence: a tutorial review. Atten Percept Psychophys 73:971–995
Stout D, Chaminade T (2012) Stone tools, language and the brain in human evolution. Philos Trans R Soc Lond B 367:75–87
Tokimura H, Tokimura Y, Oliviero A, Asakura T, Rothwell JC (1996) Speech-induced changes in corticospinal excitability. Ann Neurol 40:628–634
Vainio L, Schulman M, Tiippana K, Vainio M (2013) Effect of syllable articulation on precision and power grip performance. PLoS ONE 8(1):e53061
Watkins KE, Strafella AP, Paus T (2003) Seeing and hearing speech excites the motor system involved in speech production. Neuropsychologia 41:989–994
Whalen DH, Levitt AG (1995) The universality of intrinsic F0 of vowels. J Phon 23:349–366
Xiang HD, Fonteijn HM, Norris DG, Hagoort P (2010) Topographical functional connectivity pattern in the perisylvian language networks. Cereb Cortex 20:549–560
Acknowledgments
We would like to thank undergraduate students Silja Heikkinen, Ira Homi, Veera Paananen, Minna Parkkila and Karoliina Wilska for their contribution in planning and carrying out Experiment 2. The research leading to these results has received funding from the Academy of Finland under Grant agreement numbers 1265610 and 125940.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Vainio, L., Tiainen, M., Tiippana, K. et al. Shared processing of planning articulatory gestures and grasping. Exp Brain Res 232, 2359–2368 (2014). https://doi.org/10.1007/s00221-014-3932-y
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00221-014-3932-y