Swipe om te navigeren naar een ander artikel
Wim Pouw and Stephanie I. Wassenburg shared first authorship.
Open Data & Pre-registration: Pre-registration form, raw data, and analyses supporting this research report can be retrieved from The Open Science Framework (https://www.osf.io/9uh6q/). Due to privacy concerns, the video data cannot be shared publicly.
Note that substantial parts of this manuscript’s content may overlap with the pre-registration form (https://www.osf.io/9uh6q/).
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Co-speech gestures have been proposed to strengthen sensorimotor knowledge related to objects’ weight and manipulability. This pre-registered study (https://www.osf.io/9uh6q/) was designed to explore how gestures affect memory for sensorimotor information through the application of the visual-haptic size-weight illusion (i.e., objects weigh the same, but are experienced as different in weight). With this paradigm, a discrepancy can be induced between participants’ conscious illusory perception of objects’ weight and their implicit sensorimotor knowledge (i.e., veridical motor coordination). Depending on whether gestures reflect and strengthen either of these types of knowledge, gestures may respectively decrease or increase the magnitude of the size-weight illusion. Participants (N = 159) practiced a problem-solving task with small and large objects that were designed to induce a size-weight illusion, and then explained the task with or without co-speech gesture or completed a control task. Afterwards, participants judged the heaviness of objects from memory and then while holding them. Confirmatory analyses revealed an inverted size-weight illusion based on heaviness judgments from memory and we found gesturing did not affect judgments. However, exploratory analyses showed reliable correlations between participants’ heaviness judgments from memory and (a) the number of gestures produced that simulated actions, and (b) the kinematics of the lifting phases of those gestures. These findings suggest that gestures emerge as sensorimotor imaginings that are governed by the agent’s conscious renderings about the actions they describe, rather than implicit motor routines.
Alaerts, K., de Beukelaar, T. T., Swinnen, S. P., & Wenderoth, N. (2012). Observing how others lift light or heavy objects: time-dependent encoding of grip force in the primary motor cortex. Psychological Research Psychologische Forschung, 76(4), 503–513. CrossRef
Amazeen, E. L., & Turvey, M. T. (1996). Weight perception and the haptic size–weight illusion are functions of the inertia tensor. Journal of Experimental Psychology: Human Perception and Performance, 22(1), 213–232. https://doi.org/10.1037/0096-15184.108.40.206. CrossRefPubMed
Bernstein, N. (1966). The co-ordination and regulation of movements. London: Pergamom Press.
Boncoddo, R., Dixon, J. A., & Kelley, E. (2010). The emergence of a novel representation from action: evidence from preschoolers. Developmental Science, 13(2), 370–377. https://doi.org/10.1111/j.1467-7687.2009.00905.x. CrossRefPubMed
Chu, M., Meyer, A., Foulkes, L., & Kita, S. (2014). Individual differences in frequency and saliency of speech-accompanying gestures: The role of cognitive abilities and empathy. Journal of Experimental Psychology: General, 143(2), 694. CrossRef
Cook, S. W., & Goldin-Meadow, S. (2006). The role of gesture in learning: Do children use their hands to change their minds? Journal of Cognition and Development, 7(2), 211–232. CrossRef
Cook, S. W., & Tanenhaus, M. K. (2009). Embodied communication: Speakers’ gestures affect listeners’ actions. Cognition, 113(1), 98–104. https://doi.org/10.1016/j.cognition.2009.06.006. CrossRefPubMedPubMedCentral
Cooperrider, K., Wakefield, E., & Goldin-Meadow, S. (2015). More than meets the eye: Gesture changes thought, even without visual feedback. In Proceedings of the 36th Annual Meeting of the Cognitive Science Society. Austin, TX: Cognitive Science Society.
Eielts, C., Pouw, W., Ouwehand, K., van Gog, T., Zwaan, R. A., & Paas, F. (2018). Co-thought gesturing supports more complex problem solving in subjects with lower visual working-memory capacity. Psychological Research Psychologische Forschung. https://doi.org/10.1007/s00426-018-1065-9. (advance online publication). CrossRefPubMed
Flanagan, J. R., Bittner, J. P., & Johansson, R. S. (2008). Experience can change distinct size–weight priors engaged in lifting objects and judging their weights. Current Biology, 18(22), 1742–1747. https://doi.org/10.1016/j.cub.2008.09.042. CrossRefPubMed
Goodale, M. A., Jakobson, L. S., & Keillor, J. M. (1994). Differences in the visual control of pantomimed and natural grasping movements. Neuropsychologia, 32(10), 1159–1178. CrossRef
Goodale, M. A., & Milner, A. D. (1992). Separate visual pathways for perception and action. Trends in neurosciences, 15(1), 20–25. CrossRef
Hallgren, K. A. (2012). Computing inter-rater reliability for observational data: an overview and tutorial. Tutorials in Quantitative Methods for Psychology, 8(1), 23–24. CrossRef
Hostetter, A. B., Alibali, M. W., & Kita, S. (2007). Does sitting on your hands make you bite your tongue? The effects of gesture prohibition on speech during motor descriptions. In Proceedings of the Annual Meeting of the Cognitive Science Society (vol. 29, No. 29).
Hostetter, A. B., & Boncoddo, R. (2017). Gestures highlight perceptual-motor representations in thinking. In R. B. Church, M. W. Alibali & S. D. Kelley (Eds.), Why gesture? How the hands function in speaking, thinking, and communicating (pp. 155–174). Amsterdam: John Benjamins Publishing Company. CrossRef
Jeffreys, H. (1961). Theory of probability. Oxford, UK: Oxford University Press.
Kamermans, K. L., Pouw, W., Fassi, L., Aslanidou, A., Paas, F., & Hostetter, A. Reinterpretation in multimodal imagery and the role of manual enactment. https://doi.org/10.31234/osf.io/esk6v. ( under review).
Kelso, J. S., Tuller, B., Vatikiotis-Bateson, E., & Fowler, C. A. (1984). Functionally specific articulatory cooperation following jaw perturbations during speech: Evidence for coordinative structures. Journal of Experimental Psychology: Human Perception and Performance, 10(6), 812–832. PubMed
Klatzky, R. L., Lederman, S. J., & Matula, D. E. (1991). Imagined haptic exploration in judgments of object properties. Journal of Experimental Psychology: Learning, Memory, and Cognition, 17(2), 314–322. https://doi.org/10.1037/0278-73220.127.116.114. CrossRefPubMed
Laimgruber, K., Goldenberg, G., & Hermsdörfer, J. (2005). Manual and hemispheric asymmetries in the execution of actual and pantomimed prehension. Neuropsychologia, 43(5), 682–692. https://doi.org/10.1016/j.neuropsychologia.2004.09.004. CrossRefPubMed
Lausberg, H., & Sloetjes, H. (2009). Coding gestural behavior with the NEUROGES-ELAN system. Behavior Research Methods, Instruments, & Computers, 41(3), 841–849. CrossRef
Mangelsdorf, H. H., Cooperrider, K., & Goldin-Meadow, S. (2017). Gestures represent action information about force. Poster session presented at the 29th Annual Convention of the Association for Psychological Science. Boston, MA
Pouw, W., Aslanidou, A., Kamermans, K., & Paas, F. (2017). Is ambiguity detection in haptic imagery possible? Evidence for enactive imaginings. In Proceedings of the 39th Annual Meeting of the Cognitive Science Society, London, UK.
Pouw, W. T. J. L., Trujillo, J., & Dixon, J. A. (2018). The Quantification of gesture-speech synchrony: a tutorial and validation of multi-modal data acquisition using device-based and video-based motion tracking. https://doi.org/10.31234/osf.io/jm3hk
R Core Team. (2017). R: A language and environment for statistical computing. Vienna: R Foundation for Statistical Computing. https://www.R-project.org/. Accessed Dec 2018.
Romero, V., Amaral, J., Fitzpatrick, P., Schmidt, R. C., Duncan, A. W., & Richardson, M. J. (2017). Can low-cost motion-tracking systems substitute a Polhemus system when researching social motor coordination in children? Behavior Research Methods, 49(2), 588–601. CrossRef
Runeson, S., & Frykholm, G. (1983). Kinematic specification of dynamics as an informational basis for person-and-action perception: expectation, gender recognition, and deceptive intention. Journal of Experimental Psychology: General, 112(4), 585. CrossRef
Trofatter, C., Kontra, C., Beilock, S., & Goldin-Meadow, S. (2015). Gesturing has a larger impact on problem-solving than action, even when action is accompanied by words. Language, Cognition and Neuroscience, 30(3), 251–260. https://doi.org/10.1080/23273798.2014.905692. CrossRefPubMedPubMedCentral
van Gog, T. (2011). Effects of identical example–problem and problem–example pairs on learning. Computers & Education, 57(2), 1775–1779. https://doi.org/10.1016/j.compedu.2011.03.019. CrossRef
Wassenburg, S. I., de Koning, B. B., & van der Schoot, M. (2018). In which direction to move? Facilitative and interference effects of gestures on problem solver’s thinking. Journal of Cognitive Psychology, 30(3), 307–313. https://doi.org/10.1080/20445911.2018.1432628. CrossRef
Weiss, P. H., Jeannerod, M., Paulignan, Y., & Freund, H. J. (2000). Is the organisation of goal-directed action modality specific? A common temporal structure. Neuropsychologia, 38, 1136–1147. https://doi.org/10.1016/S0028-3932(00)00029-4. CrossRefPubMed
Zhu, Q., & Bingham, G. P. (2011). Human readiness to throw: The size–weight illusion is not an illusion when picking the best objects to throw. Evolution and Human Behavior, 32(4), 288–293. https://doi.org/10.1016/j.evolhumbehav.2010.11.005. CrossRef
- Does gesture strengthen sensorimotor knowledge of objects? The case of the size-weight illusion
Stephanie I. Wassenburg
Autumn B. Hostetter
Bjorn B. de Koning
- Springer Berlin Heidelberg
An International Journal of Perception, Attention, Memory, and Action
Print ISSN: 0340-0727
Elektronisch ISSN: 1430-2772