Hostname: page-component-76fb5796d-9pm4c Total loading time: 0 Render date: 2024-04-25T13:11:28.526Z Has data issue: false hasContentIssue false

Multimodal infant-directed communication: how caregivers combine tactile and linguistic cues*

Published online by Cambridge University Press:  30 August 2016

RANA ABU-ZHAYA*
Affiliation:
Purdue University
AMANDA SEIDL
Affiliation:
Purdue University
ALEJANDRINA CRISTIA
Affiliation:
Laboratoire de Sciences Cognitives et Psycholinguistique, CNRS, DEC-ENS, EHESS
*
[*]Address for correspondence: Rana Abu-Zhaya, Purdue University, Lyles-Porter Hall, West Lafayette, IN 47907. e-mail: rabuzhay@purdue.edu

Abstract

Both touch and speech independently have been shown to play an important role in infant development. However, little is known about how they may be combined in the input to the child. We examined the use of touch and speech together by having mothers read their 5-month-olds books about body parts and animals. Results suggest that speech+touch multimodal events are characterized by more exaggerated touch and speech cues. Further, our results suggest that maternal touches are aligned with speech and that mothers tend to touch their infants in locations that are congruent with names of body parts. Thus, our results suggest that tactile cues could potentially aid both infant word segmentation and word learning.

Type
Articles
Copyright
Copyright © Cambridge University Press 2016 

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

REFERENCES

Anisfeld, E., Casper, V., Nozyce, M. & Cunningham, N. (1990). Does infant carrying promote attachment? An experimental study of the effects of increased physical contact on the development of attachment. Child Development 61(5), 1617–27.CrossRefGoogle ScholarPubMed
Bergelson, E. & Swingley, D. (2012). At 6–9 months, human infants know the meanings of many common nouns. Proceedings of the National Academy of Sciences of the United States of America 109(9), 3253–8.CrossRefGoogle ScholarPubMed
Boersma, P. & Weenink, D. (2013). Praat: doing phonetics by computer [Computer program], Version 5.3·45, online: <http://www.praat.org/> (retrieved 30 December 2013).+(retrieved+30+December+2013).>Google Scholar
Bortfeld, H., Morgan, J., Golinkoff, R. M. & Rathbun, K. (2005). Mommy and Me: familiar names help launch babies into speech-stream segmentation. Psychological Science 16(4), 298304.CrossRefGoogle ScholarPubMed
Brand, R. J., Baldwin, D. A. & Ashburn, L. A. (2002). Evidence for ‘motionese’: modifications in mothers’ infant-directed action. Developmental Science 5(1), 7283.CrossRefGoogle Scholar
Brand, R. J. & Shallcross, W. L. (2008). Infants prefer motionese to adult-directed action. Developmental Science 11(6), 853–61.CrossRefGoogle ScholarPubMed
Brand, R. J., Shallcross, W. L., Sabatos, M. G. & Massie, K. P. (2007). Fine-grained analysis of motionese: eye gaze, object exchanges, and action units in infant- versus adult-directed action. Infancy 11(2), 203–14.CrossRefGoogle Scholar
Brugman, H. & Russel, A. (2004). Annotating multimedia/multi-modal resources with ELAN. In Proceedings of LREC 2004, Fourth International Conference on Language Resources and Evaluation. Nijmegen: The Language Archive, Max Planck Institute for Psycholinguistics Online: <http://tla.mpi.nl/tools/tla-tools/elan/>..>Google Scholar
Cohen, J. (1960). A coefficient of agreement for nominal scales. Educational and Psychological Measurement 20(1), 3746.CrossRefGoogle Scholar
Falk, D. (2004). Prelinguistic evolution in early hominins: Whence motherese? Behavioral and Brain Sciences 27(4), 491541.CrossRefGoogle ScholarPubMed
Feldman, R., Singer, M. & Zagoory, O. (2010). Touch attenuates infants’ physiological reactivity to stress. Developmental Science 13(2), 271–8.CrossRefGoogle ScholarPubMed
Fenson, L., Dale, P., Reznick, S., Thal, D., Bates, E., Hartung, J., … Reilly, J. (1993). The MacArthur Communicative Development Inventories. San Diego, CA: Singular Publishing Group.Google Scholar
Ferber, S. G. (2004). The nature of touch in mothers experiencing maternity blues: the contribution of parity. Early Human Development 79(1), 6575.CrossRefGoogle ScholarPubMed
Ferber, S. G., Feldman, R. & Makhoul, I. R. (2008). The development of maternal touch across the first year of life. Early Human Development 84(6), 363–70.CrossRefGoogle ScholarPubMed
Fernald, A. & Simon, T. (1984). Expanded intonation contours in mothers’ speech to newborns. Developmental Psychology 20(1), 104–13.CrossRefGoogle Scholar
Fernald, A., Taeschner, T., Dunn, J., Papousek, M., de Boysson-Bardies, B. & Fukui, I. (1989). A cross-language study of prosodic modifications in mothers’ and fathers’ speech to preverbal infants. Journal of Child Language 16(03), 477501.CrossRefGoogle ScholarPubMed
Fisher, C. & Tokura, H. (1996). Acoustic cues to grammatical structure in infant-directed speech: cross-linguistic evidence. Child Development 67(6), 3192–218.CrossRefGoogle ScholarPubMed
Fisher, R. A. (1935). The design of experiments. Edinburgh: Oliver and Boyd.Google Scholar
Franco, F., Fogel, A., Messinger, D. S. & Frazier, C. A. (1996). Cultural differences in physical contact between Hispanic and Anglo mother–infant dyads living in the United States. Early Development and Parenting 5(3), 119–27.3.0.CO;2-Y>CrossRefGoogle Scholar
Gamer, M., Lemon, J., Fellows, I. & Singh, P. (2015). irr: Various Coefficients of Interrater Reliability and Agreement. Online: <http://CRAN.R-project.org/package=irr> (retrieved 3 June 2015).+(retrieved+3+June+2015).>Google Scholar
Gogate, L. J., Bahrick, L. E. & Watson, J. D. (2000). A study of multimodal motherese: the role of temporal synchrony between verbal labels and gestures. Child Development 71(4), 878–94.CrossRefGoogle ScholarPubMed
Graf Estes, K., Evans, J. L., Alibali, M. W. & Saffran, J. R. (2007). Can infants map meaning to newly segmented words? Psychological Science 18(3), 254–9.CrossRefGoogle ScholarPubMed
Graf Estes, K. & Hurley, K. (2013). Infant-directed prosody helps infants map sounds to meanings. Infancy 18(5), 797824.CrossRefGoogle Scholar
Herrera, E., Reissland, N. & Shepherd, J. (2004). Maternal touch and maternal child-directed speech: effects of depressed mood in the postnatal period. Journal of Affective Disorders 81(1), 2939.CrossRefGoogle ScholarPubMed
Hertenstein, M. J. (2002). Touch: its communicative functions in infancy. Human Development 45(2), 7094.CrossRefGoogle Scholar
Hills, T. (2012). The company that words keep: comparing the statistical structure of child- versus adult-directed language. Journal of Child Language 40(3), 119.Google ScholarPubMed
Jean, A. D. L. & Stack, D. M. (2009). Functions of maternal touch and infants’ affect during face-to-face interactions: new directions for the still-face. Infant Behavior & Development 32(1), 123–8.CrossRefGoogle ScholarPubMed
Jean, A. D. L. & Stack, D. M. (2012). Full-term and very-low-birth-weight preterm infants’ self-regulating behaviors during a still-face interaction: influences of maternal touch. Infant Behavior & Development 35(4), 779–91.CrossRefGoogle ScholarPubMed
Jean, A. D. L., Stack, D. M. & Fogel, A. (2009). A longitudinal investigation of maternal touching across the first 6 months of life: age and context effects. Infant Behavior & Development 32(3), 344–9.CrossRefGoogle ScholarPubMed
Junge, C., Kooijman, V., Hagoort, P. & Cutler, A. (2012). Rapid recognition at 10 months as a predictor of language development. Developmental Science 15(4), 463–73.CrossRefGoogle ScholarPubMed
Jusczyk, P. W. (1999). How infants begin to extract words from speech. Trends in Cognitive Sciences 3(9), 323–8.CrossRefGoogle ScholarPubMed
Kooijman, V., Junge, C., Johnson, E. K., Hagoort, P. & Cutler, A. (2013). Predictive brain signals of linguistic development. Frontiers in Psychology 4(25), 113.CrossRefGoogle ScholarPubMed
Landis, J. R. & Koch, G. G. (1977). The measurement of observer agreement for categorical data. Biometrics 33(1), 159–74.CrossRefGoogle ScholarPubMed
Lewkowicz, D. J. (1996). Perception of auditory-visual temporal synchrony in human infants. Journal of Experimental Psychology: Human Perception and Performance 22(5), 1094–106.Google ScholarPubMed
Makin, L. (2006). Literacy 8–12 months: What are babies learning? Early Years 26(3), 267–77.CrossRefGoogle Scholar
McNeill, D. (2012). How language began. New York: Cambridge University Press.CrossRefGoogle Scholar
Meyer, M., Hard, B., Brand, R. J., McGarvey, M. & Baldwin, D. A. (2011). Acoustic packaging: maternal speech and action synchrony. IEEE Transactions on Autonomous Mental Development 3(2), 154–62.CrossRefGoogle Scholar
Mol, S. E., Bus, A. G., de Jong, M. T. & Smeets, D. J. H. (2008). Added value of dialogic parent–child book readings: a meta-analysis. Early Education and Development 19(1), 726.CrossRefGoogle Scholar
Moszkowski, R. J. & Stack, D. M. (2007). Infant touching behavior during mother–infant face-to-face interactions. Infant and Child Development , 16(3) 307–19.CrossRefGoogle Scholar
Muir, D. W. (2002). Adult communications with infants through touch: the forgotten sense. Human Development 45(2), 95–9.CrossRefGoogle Scholar
Nakata, T. & Trehub, S. E. (2004). Infants’ responsiveness to maternal speech and singing. Infant Behavior and Development 27(4), 455–64.CrossRefGoogle Scholar
Newman, R., Ratner, N. B., Jusczyk, A. M., Jusczyk, P. W. & Dow, K. A. (2006). Infants’ early ability to segment the conversational speech signal predicts later language development: a retrospective analysis. Developmental Psychology 42(4), 643–55.CrossRefGoogle ScholarPubMed
Nomikou, I. & Rohlfing, K. J. (2011). Language does something: body action and language in maternal input to three-month-olds. IEEE Transactions on Autonomous Mental Development 3(2), 113–28.CrossRefGoogle Scholar
Richman, A. L., Miller, P. M. & LeVine, R. A. (1992). Cultural and educational variations in maternal responsiveness. Developmental Psychology 28(4), 614–21.CrossRefGoogle Scholar
Seidl, A., Tincoff, R., Baker, C. & Cristia, A. (2015). Why the body comes first: effects of experimenter touch on infants’ word finding. Developmental Science 18(1), 155–64.CrossRefGoogle ScholarPubMed
Sénéchal, M., LeFevre, J. A., Thomas, E. M. & Daley, K. E. (1998). Differential effects of home literacy experiences on the development of oral and written language. Reading Research Quarterly 33(1), 96116.CrossRefGoogle Scholar
Shute, B. & Wheldall, K. (1999). Fundamental frequency and temporal modifications in the speech of British fathers to their children. Educational Psychology 19(2), 221–33.CrossRefGoogle Scholar
Singh, L., Nestor, S., Parikh, C. & Yull, A. (2009). Influences of infant-directed speech on early word recognition. Infancy 14(6), 654–66.CrossRefGoogle ScholarPubMed
Singh, L., Reznick, J. S. & Xuehua, L. (2012). Infant word segmentation and childhood vocabulary development: a longitudinal analysis. Developmental Science 15(4), 482–95.CrossRefGoogle ScholarPubMed
Stack, D. M. & Arnold, S. L. (1998). Changes in mothers’ touch and hand gestures influence infant behavior during face-to-face interchanges. Infant Behavior and Development 21(3), 451–68.CrossRefGoogle Scholar
Stack, D. M. & Muir, D. W. (1990). Tactile stimulation as a component of social interchange: new interpretations for the still-face effect. British Journal of Developmental Psychology 8, 131–45.CrossRefGoogle Scholar
Tamis-LeMonda, C. S., Kuchirko, Y. & Tafuro, L. (2013). From action to interaction: infant object exploration and mothers’ contingent responsiveness. IEEE Transactions on Autonomous Mental Development 5(3), 202–9.CrossRefGoogle Scholar
Tamis-LeMonda, C. S., Song, L., Leavell, A. S., Kahana-Kalman, R. & Yoshikawa, H. (2012). Ethnic differences in mother–infant language and gestural communications are associated with specific skills in infants. Developmental Science 15(3), 384–97.CrossRefGoogle ScholarPubMed
Thiessen, E. D., Hill, E. A. & Saffran, J. R. (2005). Infant-directed speech facilitates word segmentation. Infancy 7(1), 5371.CrossRefGoogle ScholarPubMed
Tincoff, R. & Jusczyk, P. W. (2012). Six-month-olds comprehend words that refer to parts of the body. Infancy 17(4), 432–44.CrossRefGoogle ScholarPubMed
Weiss, S. J., Wilson, P., Hertenstein, M. J. & Campos, R. (2000). The tactile context of a mother's caregiving: implications for attachment of low birth weight infants. Infant Behavior and Development 23(1), 91111.CrossRefGoogle Scholar
Weiss, S. J., Wilson, P. & Morrison, D. (2004). Maternal tactile stimulation and the neurodevelopment of low birth weight infants. Infancy 5(1), 85107.CrossRefGoogle Scholar
Zukow-Goldring, P. (1997). A social ecological realist approach to the emergence of the lexicon: educating attention to amodal invariants in gesture and speech. In Dent-Read, C. & Zukow-Goldring, P. (eds), Evolving explanations of development: ecological approaches to organism-environment systems, (pp. 199250). Washington, DC: American Psychological Association.CrossRefGoogle Scholar