Abstract
Research on rhythm perception has mostly been focused on the auditory and visual modalities. Previous studies have shown that the auditory modality dominates rhythm perception. Rhythms can also be perceived through the tactile senses, for example, as vibrations, but only few studies exist. We investigated unimodal and crossmodal rhythm perception with auditory, tactile, and visual modalities. Pairs of rhythm patterns were presented to the subject who made a same-different judgment. We used all possible combinations of the three modalities. The results showed that the unimodal auditory condition had the highest rate (79.2%) of correct responses. The unimodal tactile condition (75.0%) and the auditory-tactile condition (74.2%) were close. The average rate remained under 61.7% when the visual modality was involved. The results confirmed that auditory and tactile modalities are suitable for presenting rhythmic information, and they are also preferred by the users.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Brewster, S., Brown, L.M.: Tactons: Structured Tactile Messages for Non-Visual Information Display. In: Proc. 5th conference on Australasian user interface, vol. 28, pp. 15–23. ACM Press, New York (2004)
Brewster, S.A., King, A.: The Design and Evaluation of a Vibrotactile Progress Bar. In: Proc. worldHAPTICS 2005, pp. 499–500. IEEE Press, Los Alamitos (2005)
Brown, L.M., Brewster, S.A., Purchase, H.C.: A First Investigation into the Effectiveness of Tactons. In: Proc. worldHAPTICS 2005, pp. 167–176. IEEE Press, Los Alamitos (2005)
Collier, G.L., Logan, G.: Modality differences in short-term memory for rhythms. Memory & Cognition 28, 529–538 (2000)
Glenberg, A.M., Jona, M.: Temporal coding in rhythm tasks revealed by modality effects. Memory & Cognition 19, 514–522 (1991)
Glenberg, A.M., Mann, S., Altman, L., Forman, T., Procise, S.: Modality effects in the coding and reproduction of rhythms. Memory & Cognition 17, 373–383 (1989)
Kosonen, K., Raisamo, R.: Rhythm perception through different modalities. In: Proc. EuroHaptics 2006, pp. 365–370 (2006)
Miura, S., Sugimoto, M.: T-RHYTHM: A System for Supporting Rhythm Learning by Using Tactile Devices. In: Proceedings of IEEE International Workshop on Wireless and Mobile Technologies in Education, pp. 264–268. IEEE Press, Los Alamitos (2005)
NASA TLX, NASA Task Load Index, http://humansystems.arc.nasa.gov/groups/TLX/
Raisamo, J., Raisamo, R., Kosonen, K.: Distinguishing Vibrotactile Effects with Tactile Mouse and Trackball. In: Proc. HCI 2005, pp. 337–348. Springer, Heidelberg (2005)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2008 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Jokiniemi, M., Raisamo, R., Lylykangas, J., Surakka, V. (2008). Crossmodal Rhythm Perception. In: Pirhonen, A., Brewster, S. (eds) Haptic and Audio Interaction Design. HAID 2008. Lecture Notes in Computer Science, vol 5270. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-87883-4_12
Download citation
DOI: https://doi.org/10.1007/978-3-540-87883-4_12
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-87882-7
Online ISBN: 978-3-540-87883-4
eBook Packages: Computer ScienceComputer Science (R0)