Top

Gepubliceerd in:

11-02-2023 | Original Article

Sensorimotor synchronization with visual, auditory, and tactile modalities

Auteurs: Simon Andrew Whitton, Fang Jiang

Gepubliceerd in: Psychological Research | Uitgave 7/2023

Abstract

While it is well known that humans are highly responsive to rhythm, the factors that influence our ability to synchronize remain unclear. In the current study, we examined how stimulus modality and rhythmic deviation, along with the synchronizer’s level of musicality, impacted sensorimotor synchronization (SMS). Utilizing a finger-tapping task and three sensory modalities (visual, auditory, and tactile), we manipulated rhythmic deviation by varying the temporal position, intensity, and availability of cues across four deviation levels. Additionally, to determine our participants’ musical familiarity and aptitude, we administered the Goldsmiths Musical Sophistication Index (Gold-MSI) questionnaire. We found that SMS to external rhythmic stimuli was significantly more precise for auditory and tactile than for visual sequences. Further, we found SMS consistency significantly decreased in all modalities with increased rhythmic deviation, suggesting rhythmic deviation directly relates to SMS difficulty. Moreover, a significant correlation was found between Gold-MSI scores and SMS consistency in the most rhythmically deviant level, such that the higher one’s musical general sophistication score, the greater one’s SMS ability. This held for all three modalities. Combined, these findings suggest that rhythmic synchronization performance is affected not only by the modality and rhythmic deviation of the stimuli but also by the musical general sophistication of the synchronizer.

vorige artikel A comparative study of the cognitive load of basic-level category, superordinate category and subordinate category

volgende artikel Beta and gamma binaural beats enhance auditory sentence comprehension

Alleen toegankelijk voor geautoriseerde gebruikers

Ammirante, P., Patel, A. D., & Russo, F. A. (2016). Synchronizing to auditory and tactile metronomes: a test of the auditory-motor enhancement hypothesis. Psychonomic Bulletin & Review, 23(6), 1882–1890. https://doi.org/10.3758/s13423-016-1067-9CrossRef

Armstrong, A., & Issartel, J. (2014). Sensorimotor synchronization with audio-visual stimuli: limited multisensory integration. Experimental Brain Research, 232(11), 3453–3463. https://doi.org/10.1007/s00221-014-4031-9CrossRefPubMed

Aschersleben, G. (2003). Effects of training on the timing of simple repetitive movements. Advances in psychology research (Vol. 23, pp. 15–30). New York: Nova Science Publishers.

Aschersleben, G. (2002). Temporal control of movements in sensorimotor synchronization. Brain and Cognition, 48(1), 66–79. https://doi.org/10.1006/brcg.2001.1304CrossRefPubMed

Bartlett, N. R., & Bartlett, S. C. (1959). Synchronization of a motor response with an anticipated sensory event. Psychological Review, 66, 203–218. https://doi.org/10.1037/h0046490CrossRefPubMed

Białuńska, A., & Dalla Bella, S. (2017). Music and speech distractors disrupt sensorimotor synchronization: effects of musical training. Experimental Brain Research, 235(12), 3619–3630. https://doi.org/10.1007/s00221-017-5080-7CrossRefPubMed

Bouwer, F. L., Burgoyne, J. A., Odijk, D., Honing, H., & Grahn, J. A. (2018). What makes a rhythm complex? The influence of musical training and accent type on beat perception. PLoS ONE, 13(1), e0190322. https://doi.org/10.1371/journal.pone.0190322CrossRefPubMedPubMedCentral

Box, G. E. P., Jenkins, G. M., & Reinsel, G. C. (1994). Time series analysis; forecasting and control (3rd ed.). Englewood Cliffs, New Jersey: Prentice Hall

Brainard, D. H. (1997). The psychophysics toolbox. Spatial Vision, 10(4), 433–436. https://doi.org/10.1163/156856897X00357CrossRefPubMed

Brochard, R., Touzalin, P., Després, O., & Dufour, A. (2008). Evidence of beat perception via purely tactile stimulation. Brain Research, 1223, 59–64. https://doi.org/10.1016/j.brainres.2008.05.050CrossRefPubMed

Chatzihidiroglou, P., Chatzopoulos, D., Lykesas, G., & Doganis, G. (2018). Dancing effects on preschoolers’ sensorimotor synchronization, balance, and movement reaction time. Perceptual and Motor Skills, 125(3), 3. https://doi.org/10.1177/0031512518765545.CrossRef

Chen, Y., Repp, B. H., & Patel, A. D. (2002). Spectral decomposition of variability in synchronization and continuation tapping: Comparisons between auditory and visual pacing and feedback conditions. Human Movement Science, 21(4), 515–532. https://doi.org/10.1016/S0167-9457(02)00138-0CrossRefPubMed

D’Andrea-Penna, G. M., Iversen, J. R., Chiba, A. A., Khalil, A. K., & Minces, V. H. (2020). One tap at a time: correlating sensorimotor synchronization with brain signatures of temporal processing. Cerebral Cortex Communications, 1(1), tgaa036. https://doi.org/10.1093/texcom/tgaa036CrossRefPubMedPubMedCentral

Delignières, D., & Torre, K. (2011). Event-based and emergent timing: dichotomy or continuum? A reply to Repp and Steinman (2010). Journal of Motor Behavior, 43(4), 311–318. https://doi.org/10.1080/00222895.2011.588274CrossRefPubMed

Elliott, M. T., Wing, A. M., & Welchman, A. E. (2010). Multisensory cues improve sensorimotor synchronisation. European Journal of Neuroscience, 31(10), 1828–1835. https://doi.org/10.1111/j.1460-9568.2010.07205.xCrossRefPubMed

Fisher, N. I. (1995). Statistical analysis of circular data. Cambridge: Cambridge University Press.

Gan, L., Huang, Y., Zhou, L., Qian, C., & Wu, X. (2015). Synchronization to a bouncing ball with a realistic motion trajectory. Scientific Reports, 5, 11974. https://doi.org/10.1038/srep11974CrossRefPubMedPubMedCentral

Grahn, J. A. (2012). See what I hear? Beat perception in auditory and visual rhythms. Experimental Brain Research, 220(1), 51–61. https://doi.org/10.1007/s00221-012-3114-8CrossRefPubMed

Grahn, J. A., Henry, M. J., & McAuley, J. D. (2011). FMRI investigation of cross-modal interactions in beat perception: audition primes vision, but not vice versa. NeuroImage, 54(2), 1231–1243. https://doi.org/10.1016/j.neuroimage.2010.09.033CrossRefPubMed

Guérin, S. M. R., Boitout, J., & Delevoye-Turrell, Y. N. (2021). Attention guides the motor-timing strategies in finger-tapping tasks when moving fast and slow. Frontiers in Psychology. https://doi.org/10.3389/fpsyg.2020.574396CrossRefPubMedPubMedCentral

Hawkins, J., Ahmad, S., & Cui, Y. (2017). A theory of how columns in the neocortex enable learning the structure of the world. Frontiers in Neural Circuits, 11, 81. https://doi.org/10.3389/fncir.2017.00081CrossRefPubMedPubMedCentral

Hinwar, R. P., & Lambert, A. J. (2021). Anauralia: the silent mind and its association with aphantasia. Frontiers in Psychology. https://doi.org/10.3389/fpsyg.2021.744213CrossRefPubMedPubMedCentral

Hove, M. J., & Keller, P. E. (2010). Spatiotemporal relations and movement trajectories in visuomotor synchronization. Music Perception, 28(1), 15–26. https://doi.org/10.1525/mp.2010.28.1.15CrossRef

Hove, M. J., Spivey, M. J., & Krumhansl, C. L. (2010). Compatibility of motion facilitates visuomotor synchronization. Journal of Experimental Psychology, 36(6), 1525–1534. https://doi.org/10.1037/a0019059CrossRefPubMed

Iversen, J. R., & Balasubramaniam, R. (2016). Synchronization and temporal processing. Current Opinion in Behavioral Sciences, 8, 175–180. https://doi.org/10.1016/j.cobeha.2016.02.027CrossRef

Iversen, J. R., Patel, A. D., Nicodemus, B., & Emmorey, K. (2015). Synchronization to auditory and visual rhythms in hearing and deaf individuals. Cognition, 134, 232–244. https://doi.org/10.1016/j.cognition.2014.10.018CrossRefPubMed

Ivry, R. B., Spencer, R. M., Zelaznik, H. N., & Diedrichsen, J. (2002). The cerebellum and event timing. Annals of the New York Academy of Sciences, 978(1), 302–317. https://doi.org/10.1111/j.1749-6632.2002.tb07576.xCrossRefPubMed

Junkai, Y., Feiyi, O., Linus, H., Yingyu, H., Lingyu, G., Zhou, L., Huizhen, C., Mengye, W., Mengxue, H., Zhang, S., Yang, B., Junhao, P., & Wu, X. (2020). Tapping ahead of time: its association with timing variability. Psychological Research Psychologische Forschung, 84(2), 343–351. https://doi.org/10.1007/s00426-018-1043-2CrossRef

Kapodistria, L., Chatzopoulos, D., Chomoriti, K., Lykesas, G., & Lola, A. (2021). Effects of a Greek traditional dance program on sensorimotor synchronization and response time of young children. International Electronic Journal of Elementary Education, 14, 1–8. https://doi.org/10.26822/iejee.2021.224CrossRef

Kiparsky, P. (2018). Indo-European origins of the Greek hexameter (pp. 77–128). Leiden: Brill. https://doi.org/10.1163/9789004357778_006CrossRef

Kung, S.-J., Chen, J. L., Zatorre, R. J., & Penhune, V. B. (2013). Interacting cortical and basal ganglia networks underlying finding and tapping to the musical beat. Journal of Cognitive Neuroscience, 25(3), 401–420. https://doi.org/10.1162/jocn_a_00325CrossRefPubMed

Lagrois, M. -É., Palmer, C., & Peretz, I. (2019). Poor synchronization to musical beat generalizes to speech. Brain Sciences, 9(7), E157. https://doi.org/10.3390/brainsci9070157CrossRef

London, J. (2012). Hearing in time: psychological aspects of musical meter. Oxford: Oxford University Press.CrossRef

Lorås, H., Sigmundsson, H., Talcott, J. B., Öhberg, F., & Stensdotter, A. K. (2012). Timing continuous or discontinuous movements across effectors specified by different pacing modalities and intervals. Experimental Brain Research, 220(3), 335–347. https://doi.org/10.1007/s00221-012-3142-4CrossRefPubMed

Maes, P.-J. (2016). Sensorimotor grounding of musical embodiment and the role of prediction: a review. Frontiers in Psychology, 7, 308. https://doi.org/10.3389/fpsyg.2016.00308CrossRefPubMedPubMedCentral

Manning, F. C., & Schutz, M. (2016). Trained to keep a beat: Movement-related enhancements to timing perception in percussionists and non-percussionists. Psychological Research Psychologische Forschung, 80(4), 532–542. https://doi.org/10.1007/s00426-015-0678-5CrossRefPubMed

Matthews, T. E., Thibodeau, J. N. L., Gunther, B. P., & Penhune, V. B. (2016). The impact of instrument-specific musical training on rhythm perception and production. Frontiers in Psychology. https://doi.org/10.3389/fpsyg.2016.00069CrossRefPubMedPubMedCentral

McAuley, J. D., & Semple, P. (1999). The effect of tempo and musical experience on perceived beat. Australian Journal of Psychology, 51(3), 176–187. https://doi.org/10.1080/00049539908255355CrossRef

Merchel, S., & Altinsoy, M. E. (2020). Psychophysical comparison of the auditory and tactile perception: a survey. Journal on Multimodal User Interfaces, 14(3), 271–283. https://doi.org/10.1007/s12193-020-00333-zCrossRef

Müllensiefen, D., Gingras, B., Musil, J., & Stewart, L. (2014). The musicality of non-musicians: an index for assessing musical sophistication in the general population. PLoS ONE, 9(2), e89642. https://doi.org/10.1371/journal.pone.0089642CrossRefPubMedPubMedCentral

Navarro-Alarcon, D., Qi, J., Zhu, J., & Cherubini, A. (2020). A Lyapunov-stable adaptive method to approximate sensorimotor models for sensor-based control. Frontiers in Neurorobotics, 14, 59. https://doi.org/10.3389/fnbot.2020.00059CrossRefPubMedPubMedCentral

Nozaradan, S., Peretz, I., & Keller, P. E. (2016). Individual differences in rhythmic cortical entrainment correlate with predictive behavior in sensorimotor synchronization. Scientific Reports, 6(1), 20612. https://doi.org/10.1038/srep20612CrossRefPubMedPubMedCentral

Patel, A. D., Iversen, J. R., Chen, Y., & Repp, B. H. (2005). The influence of metricality and modality on synchronization with a beat. Experimental Brain Research, 163(2), 226–238. https://doi.org/10.1007/s00221-004-2159-8CrossRefPubMed

Pecenka, N., & Keller, P. E. (2009). Auditory pitch imagery and its relationship to musical synchronization. Annals of the New York Academy of Sciences, 1169(1), 282–286. https://doi.org/10.1111/j.1749-6632.2009.04785.xCrossRefPubMed

Pelli, D. G. (1997). The videotoolbox software for visual psychophysics: transforming numbers into movies. Spatial Vision, 10(4), 437–442. https://doi.org/10.1163/156856897X00366CrossRefPubMed

Pezzulo, G., Donnarumma, F., Dindo, H., D’Ausilio, A., Konvalinka, I., & Castelfranchi, C. (2019). The body talks: sensorimotor communication and its brain and kinematic signatures. Physics of Life Reviews, 28, 1–21. https://doi.org/10.1016/j.plrev.2018.06.014CrossRefPubMed

Repp, B. H. (2003). Rate limits in sensorimotor synchronization with auditory and visual sequences: the synchronization threshold and the benefits and costs of interval subdivision. Journal of Motor Behavior, 35(4), 355–370. https://doi.org/10.1080/00222890309603156CrossRefPubMed

Repp, B. H. (2005). Sensorimotor synchronization: a review of the tapping literature. Psychonomic Bulletin & Review, 12(6), 969–992. https://doi.org/10.3758/BF03206433CrossRef

Repp, B. H., & Keller, P. E. (2004). Adaptation to tempo changes in sensorimotor synchronization: effects of intention, attention, and awareness. The Quarterly Journal of Experimental Psychology Section A, 57(3), 499–521. https://doi.org/10.1080/02724980343000369CrossRef

Repp, B. H., London, J., & Keller, P. E. (2005). Production and synchronization of uneven rhythms at fast tempi. Music Perception, 23, 61–78. https://doi.org/10.1525/mp.2005.23.1.61CrossRef

Repp, B. H., & Penel, A. (2002). Auditory dominance in temporal processing: new evidence from synchronization with simultaneous visual and auditory sequences. Journal of Experimental Psychology, 28(5), 1085–1099. https://doi.org/10.1037/0096-1523.28.5.1085CrossRefPubMed

Repp, B. H., & Penel, A. (2004). Rhythmic movement is attracted more strongly to auditory than to visual rhythms. Psychological Research Psychologische Forschung, 68(4), 252–270. https://doi.org/10.1007/s00426-003-0143-8CrossRefPubMed

Repp, B. H., & Su, Y.-H. (2013). Sensorimotor synchronization: a review of recent research (2006–2012). Psychonomic Bulletin & Review, 20(3), 403–452. https://doi.org/10.3758/s13423-012-0371-2CrossRef

Ruxton, G. D. (2017). Testing for departure from uniformity and estimating mean direction for circular data. Biology Letters, 13(1), 20160756. https://doi.org/10.1098/rsbl.2016.0756CrossRefPubMedPubMedCentral

Schiavio, A., Menin, D., & Matyja, J. (2015). Music in the flesh: embodied simulation in musical understanding. Psychomusicology. https://doi.org/10.1037/pmu0000052CrossRef

Sioros, G., Davies, M. E. P., & Guedes, C. (2018). A generative model for the characterization of musical rhythms. Journal of New Music Research, 47(2), 114–128. https://doi.org/10.1080/09298215.2017.1409769CrossRef

Slater, J., Tierney, A., & Kraus, N. (2013). At-risk elementary school children with one year of classroom music instruction are better at keeping a beat. PLoS ONE, 8(10), e77250. https://doi.org/10.1371/journal.pone.0077250CrossRefPubMedPubMedCentral

Strait, D. L., Parbery-Clark, A., Hittner, E., & Kraus, N. (2012). Musical training during early childhood enhances the neural encoding of speech in noise. Brain and Language, 123(3), 191–201. https://doi.org/10.1016/j.bandl.2012.09.001CrossRefPubMedPubMedCentral

Stupacher, J. (2019). The experience of flow during sensorimotor synchronization to musical rhythms. Musicae Scientiae, 23(3), 348–361. https://doi.org/10.1177/1029864919836720CrossRef

Su, Y.-H. (2016). Sensorimotor synchronization with different metrical levels of point-light dance movements. Frontiers in Human Neuroscience, 10, 186. https://doi.org/10.3389/fnhum.2016.00186CrossRefPubMedPubMedCentral

Team, R. C. (2013). R: a language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria. http://www.R-project.org/. Accessed 18 May 2022

Van Der Steen, M., & Keller, P. (2013). The adaptation and anticipation model (ADAM) of sensorimotor synchronization. Frontiers in Human Neuroscience. https://doi.org/10.3389/fnhum.2013.00253CrossRefPubMedPubMedCentral

Varlet, M., Marin, L., Issartel, J., Schmidt, R. C., & Bardy, B. G. (2012). Continuity of visual and auditory rhythms influences sensorimotor coordination. PLoS ONE, 7(9), e44082. https://doi.org/10.1371/journal.pone.0044082CrossRefPubMedPubMedCentral

von Schnehen, A., Hobeika, L., Huvent-Grelle, D., & Samson, S. (2022). Sensorimotor synchronization in healthy aging and neurocognitive disorders. Frontiers in Psychology. https://doi.org/10.3389/fpsyg.2022.838511CrossRef

Vorberg, D., & Hambuch, R. (1978). On the temporal control of rhythmic performance. Attention and performance VII (pp. 535–555). New York: Routledge.

Vorberg, D., & Wing, A. (1996). Modeling variability and dependence in timing. Handbook of perception and action (Vol. 2, pp. 181–262). Cambridge: Academic Press.

Wing, A. M. (2002). Voluntary timing and brain function: an information processing approach. Brain and Cognition, 48(1), 7–30. https://doi.org/10.1006/brcg.2001.1301CrossRefPubMed

Zelaznik, H. N., Spencer, R. M. C., & Ivry, R. B. (2002). Dissociation of explicit and implicit timing in repetitive tapping and drawing movements. Journal of Experimental Psychology, 28(3), 575–588. https://doi.org/10.1037/0096-1523.28.3.575CrossRefPubMed

Titel: Sensorimotor synchronization with visual, auditory, and tactile modalities
Auteurs: Simon Andrew Whitton
Fang Jiang
Publicatiedatum: 11-02-2023
Uitgeverij: Springer Berlin Heidelberg
Gepubliceerd in: Psychological Research / Uitgave 7/2023
Print ISSN: 0340-0727
Elektronisch ISSN: 1430-2772
DOI: https://doi.org/10.1007/s00426-023-01801-3

Bohn Stafleu van Loghum

Deel dit onderdeel of sectie (kopieer de link)

Abstract

Log in om toegang te krijgen

Andere artikelen Uitgave 7/2023

The effect of age on task switching: updated and extended meta-analyses

Octave illusion: stimulation frequencies can modulate perception

Visuospatial working memory abilities in children analyzed by the bricks game task (BGT)

Using synchronized eye movements to assess attentional engagement

Working memory load impairs transfer learning in human adults

Preparing auditory task switching in a task with overlapping and non-overlapping response sets