Abstract
Empirical findings from studies on imagery of auditory features (pitch, timbre, loudness, duration, tempo, rhythm) and imagery of auditory objects (musical contour and melody, musical key and harmony, notational audiation, speech and text, environmental stimuli) are reviewed. Potential individual differences in auditory imagery (involving vividness, auditory hallucination, development, musical ability, training) are considered. It is concluded that auditory imagery (a) preserves many of the structural and temporal properties of auditory information present in auditory (or multisensory or crossmodal) stimuli, (b) can impact subsequent responding by influencing perception or by influencing expectancies regarding subsequent stimuli, (c) involves mechanisms similar to many of those used in auditory perception, and (d) is subserved by many of the same cortical structures as is auditory perception.
The author thanks Andrea Halpern and Caroline Palmer for helpful comments on a previous version of this chapter.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Abramson M, Goldinger SD (1997) What the reader’s eye tells the mind’s ear: silent reading activates inner speech. Percept Psychophys 59:1059–1068
Aleman A, Böcker KBE, de Hann EHF (1999) Disposition towards hallucination and subjective versus objective vividness of imagery in normal subjects. Pers Individ Dif 27:707–714
Aleman A, Formisano E, Koppenhagen H, Hagoort P, de Hann EHF, Kahn RS (2005) The functional neuroanatomy of metrical stress evaluation of perceived and imaged spoken words. Cereb Cortex 15:221–228
Aleman A, Nieuwenstein MR, Böcker KBE, de Hann EHF (2000) Music training and mental imagery ability. Neuropsychologia 38:1664–1668
Aleman A, van’t Wout M (2004) Subvocalization in auditory-verbal imagery: just a form of motor imagery? Cogn Process 5:228–231
Alexander JD, Nygaard LC (2008) Reading voices and hearing text: Talker-specific auditory imagery in reading. J Exp Psychol Hum Percept Perform 34:446–459
Allbutt J, Ling J, Heffernan TM, Shafiullah M (2008) Self-report imagery questionnaire scores and subtypes of social-desirable responding. J Individ Dif 29:181–188
Aziz-Zadeh L, Cattaneo L, Rochat M, Rizzolatti G (2005) Covert speech arrest induced by rTMS over both motor and nonmotor left hemisphere frontal site. J Cogn Neurosci 17:928–938
Baddeley AD, Andrade J (2000) Working memory and the vividness of imagery. J Exp Psychol Gen 129:126–145
Baddeley AD, Logie RH (1992) Auditory imagery and working memory. In: Reisberg D (ed) Auditory Imagery. Erlbaum, Hillsdale, NJ
Bailes F (2007) Timbre as an elusive component of imagery for music. Empir Musicol Rev 2:21–34
Barrett TR (1993) Verbal hallucinations in normals, II: self-reported imagery vividness. Pers Individ Dif 15:61–67
Barrett TR, Etheridge JB (1992) Verbal hallucinations in normals, I: people who hear ‘voices’. Appl Cogn Psychol 6:379–387
Beaman CP, Williams TI (2010) Earworms (‘stuck song syndrome’): towards a natural history of intrusive thoughts. Br J Psychol 101:637–653
Bentall RP, Slade PD (1985) Reality testing and auditory hallucinations: a signal detection analysis. Br J Clin Psychol 24:159–169
Betts GH (1909) The Distribution and Functions of Mental Imagery. Teachers College, Columbia University, New York
Bick PA, Kinsbourne M (1987) Auditory hallucinations and subvocal speech in schizophrenic patients. Am J Psychiatry 144:222–225
Brett EA, Starker S (1977) Auditory imagery and hallucinations. J Nerv Ment Dis 164:394–400
Brodsky W, Henik A, Rubenstein BS, Zorman M (2003) Auditory imagery from musical notation in expert musicians. Percept Psychophys 65:602–612
Brodsky W, Kessler Y, Rubenstein BS, Ginsborg J, Henik A (2008) The mental representation of music notation: notational audiation. J Exp Psychol Hum Percept Perform 34:427–445
Brown S (2006) The perpetual music track: the phenomenon of constant musical imagery. J Conscious Stud 13:25–44
Brunyé TT, Ditman T, Mahoney CR, Walters EK, Taylor HA (2010) You heard it here first: readers mentally simulate described sounds. Acta Psychol 135:209–215
Bunzeck N, Wuestenberg T, Lutz K, Heinze HJ, Jancke L (2005) Scanning silence: mental imagery of complex sounds. Neuroimage 26:1119–1127
Cahn D (2008) The effects of varying ratios of physical and mental practice, and task difficulty on performance of a tonal pattern. Psychol Music 36:179–191
Campos A, Perez-Fabello MJ (2011) Some psychometric properties of the Spanish version of the Clarity of Auditory Imagery Scale. Psychol Rep 109:139–146
Cebrian AN, Janata P (2010a) Electrophysiological correlates of accurate mental image formation in auditory perception and imagery tasks. Brain Res 1342:39–54
Cebrian AN, Janata P (2010b) Influence of multiple memory systems on auditory mental image acuity. J Acoust Soc Am 127:3189–3202
Cohan RD (1984) Auditory mental imagery in children. Music Therapy 4:73–83
Crowder RG (1989) Imagery for musical timbre. J Exp Psychol Hum Percept Perform 15:472–478
Crowder RG, Pitt MA (1992) Research on memory/imagery for musical timbre. In: Reisberg D (ed) Auditory Imagery. Erlbaum, Hillsdale, NJ
Daselaar SM, Porat Y, Huijbers W, Pennartz CMA (2010) Modality-specific and modality-independent components of the human imagery system. Neuroimage 52:677–685
Eitan Z, Granot RY (2006) How music moves: musical parameters and listeners’ images of motion. Music Percept 23:221–247
Elkin J, Leuthold H (2011) The representation of pitch in auditory imagery: evidence from S-R compatibility and distance effects. Eur J Cogn Psychol 23:76–91
Evans CL, McGuire PK, David AS (2000) Is auditory imagery defective in patients with auditory hallucinations? Psychol Med 30:137–148
Farah MJ, Smith AF (1983) Perceptual interference and facilitation with auditory imagery. Percept Psychophys 33:475–478
Finke RA (1986) Some consequences of visualization in pattern identification and detection. Am J Psychol 99:257–274
Frith CD, Done DJ (1988) Towards a neuropsychology of schizophrenia. Br J Psychiatry 153:437–443
Geiselman RE, Glenny J (1977) Effects of imaging speakers’ voices on the retention of words presented visually. Mem Cognit 5:499–504
Gissurarson LR (1992) Reported auditory imagery and its relationship with visual imagery. J Mental Imagery 16:117–122
Gordon EE (1975) Learning Theory, Patterns, and Music. Tometic Associates, Buffalo, NY
Griffiths TD (2000) Musical hallucinosis in acquired deafness: phenomenology and brain substrate. Brain 123:2065–2076
Halpern AR (1988a) Mental scanning in auditory imagery for songs. J Exp Psychol Learn Mem Cogn 14:434–443
Halpern AR (1988b) Perceived and imaged tempos of familiar songs. Music Percept 6:193–202
Halpern AR (1989) Memory for the absolute pitch of familiar songs. Mem Cognit 17:572–581
Halpern AR (1992) Musical aspects of auditory imagery. In: Reisberg D (ed) Auditory Imagery. Erlbaum, Hillsdale, NJ
Halpern AR (2003) Cerebral substrates of musical imagery. In: Peretz I, Zatorre R (eds) The Cognitive Neuroscience of Music. Oxford University Press, New York
Halpern AR (2007) Commentary on “Timbre as an elusive component of imagery for music” by Freya Bailes. Empir Musical Rev 2:35–37
Halpern AR, Bartlett JC (2011) The persistence of musical memories: a descriptive study of earworms. Music Percept 28:425–431
Halpern AR, Zatorre RJ (1999) When that tune runs through your head: a PET investigation of auditory imagery for familiar melodies. Cereb Cortex 9:697–704
Halpern AR, Zatorre RJ, Bouffard M, Johnson JA (2004) Behavioral and neural correlates of perceived and imagined musical timbre. Neuropsychologia 42:1281–1292
Herholz SC, Lappe C, Knief A, Pantev C (2008) Neural basis of music imagery and the effect of musical expertise. Eur J Neurosci 28:2352–2360
Highben Z, Palmer C (2004) Effects of auditory and motor mental practice in memorized piano performance. Bull Council Res Music Educ 159:58–65
Hishitani S (2009) Auditory imagery questionnaire: its factorial structure, reliability, and validity. J Mental Imagery 33:63–80
Ho YC, Cheung MC, Chan AS (2003) Music training improves verbal but not visual memory: cross-sectional and longitudinal explorations in children. Neuropsychology 17:439–450
Hubbard TL (2010) Auditory imagery: empirical findings. Psychol Bull 136:302–329
Hubbard TL, Stoeckig K (1988) Musical imagery: generation of tones and chords. J Exp Psychol Learn Mem Cogn 14:656–667
Intons-Peterson MJ (1980) The role of loudness in auditory imagery. Mem Cognit 8:385–393
Intons-Peterson MJ (1992) Components of auditory imagery. In: Reisberg D (ed) Auditory Imagery. Erlbaum, Hillsdale, NJ
Intons-Peterson MJ, Russell W, Dressel S (1992) The role of pitch in auditory imagery. J Exp Psychol Hum Percept Perform 18:233–240
Jäncke L, Shah NJ (2004) Hearing syllables by seeing visual stimuli. Eur J Neurosci 19:2603–2608
Janata P (2001) Brain electrical activity evoked by mental formation of auditory expectations and images. Brain Topogr 13:169–193
Janata P, Paroo K (2006) Acuity of auditory images in pitch and time. Percept Psychophys 68:829–844
Johnson MK, Foley MA, Leach K (1988) The consequences for memory of imagining in another person’s voice. Mem Cognit 16:337–342
Jones SR, Fernyhough C (2007) Neural correlates of inner speech and auditory verbal hallucinations: a critical review and theoretical integration. Clin Psychol Rev 27:140–154
Kalakoski V (2007) Effect of skill level on recall of visually presented patterns of musical notes. Scand J Psychol 48:87–96
Keller PE, Dalla Bella S, Koch I (2010) Auditory imagery shapes movement timing and kinematics: evidence from a musical task. J Exp Psychol Hum Percept Perform 36:508–513
Keller PE, Koch I (2006) The planning and execution of short auditory sequences. Psychon Bull Rev 13:711–716
Keller PE, Koch I (2008) Action planning in sequential skills: relations to music performance. Q J Exp Psychol 61:275–291
Kopiez R, Weihs C, Ligges U, Lee JI (2006) Classification of high and low achievers in a music sight-reading task. Psychol Music 34:5–26
Kornicke LE (1995) An exploratory study of individual difference variables in piano sight-reading achievement. Q J Music Teach Learn 6:56–79
Kosslyn SM, Behrmann M, Jeannerod M (1995) The cognitive neuroscience of mental imagery. Neuropsychologia 33:1335–1344
Kosslyn SM, Margolis JA, Barrett AM, Goldknopf EJ, Daly PF (1990a) Age differences in imagery abilities. Child Dev 61:995–1010
Kosslyn SM, Seger C, Pani JR, Hillger LA (1990b) When is imagery used in everyday life? A diary study. J Mental Imagery 14:131–152
Kosslyn SM, Matt AMC (1977) If you speak slowly, do people read your prose slowly? Person-particular speech recoding during reading. Bull Psychon Soc 9:250–252
Kraemer DJM, Macrae CN, Green AE, Kelly WM (2005) Musical imagery: sound of silence activates auditory cortex. Nature 434:158
Kurby CA, Magliano JP, Rapp DN (2009) Those voices in your head: activation of auditory images during reading. Cognition 112:457–461
Leaver AM, van Lare J, Zielinski B, Halpern AR, Rauschecker JP (2009) Brain activation during anticipation of sound sequences. J Neurosci 29:2477–2485
Levitin DJ (2007) This is Your Brain on Music: The Science of a Human Obsession. Plume Books, New York
Linden DEJ, Thornton K, Kuswanto CN, Johnston SJ, van de Ven V, Jackson MC (2011) The brain’s voices: comparing nonclinical auditory hallucinations and imagery. Cereb Cortex 21:330–337
Magne C, Schön D, Besson M (2006) Musician children detect pitch violations in both music and language better than nonmusician children: behavioral and electrophysiological approaches. J Cogn Neurosci 18:199–211
Mannering AM, Taylor M (2008–2009) Cross modality correlations in the imagery of adults and 5-year-old children. Imagin Cogn Pers 28:207–238
Marks DF (1995) New directions for mental imagery research. J Mental Imagery 19:153–166
McGuire PK, Silbersweig DA, Wright I, Murray RM, Davis AS, Frackowiak RSJ, Frith CD (1995) Abnormal monitoring of inner speech: a physiological basis for auditory hallucinations. Lancet 346:596–600
McKelvie SJ (1995) Responses to commentaries: the VVIQ and beyond: vividness and its measurement. J Mental Imagery 19:197–252
Meyer M, Elmer S, Baumann S, Jancke L (2007) Short-term plasticity in the auditory system: differential neural responses to perception and imagery of speech and music. Restor Neurol Neurosci 25:411–431
Mintz A, Alpert M (1972) Imagery vividness, reality testing, and schizophrenic hallucinations. J Abnorm Psychol 79:310–316
Mountain R (2001) Composers and imagery: myths and realities. In: Godøy RI, Jørgensen H (eds) Musical Imagery. Taylor & Francis, New York
Mythili SP, Padmapriya V (1987) Paired-associate learning with auditory and visual imagery among blind, deaf, and normal children. J Indian Acad Appl Psychol 13:48–56
Nees MA, Walker BN (2011) Mental scanning of sonifications reveals flexible encoding of nonspeech sounds and a universal per-item scanning cost. Acta Psychol 137:309–317
Neisser U (1976) Cognition and Reality: Principles and Implications of Cognitive Psychology. Freeman, New York
Okada H, Matsuoka K (1992) Effects of auditory imagery on the detection of a pure tone in white noise: experimental evidence of the auditory Perky effect. Percept Mot Skills 74:443–448
Olivetti Belardelli M, Palmiero M, Sestieri C, Nardo D, Di Matteo R, Londei A, D’Ausilio A, Ferretti A, Del Gratta C, Romani GL (2009) An fMRI investigation on image generation in different sensory modalities: the influence of vividness. Acta Psychol 132:190–200
Piaget J, Inhelder B (1971) Mental Imagery in the Child. Routledge & Kegan Paul Ltd., New York
Pecenka N, Keller PE (2009) Auditory pitch imagery and its relationship to musical synchronization. Ann N Y Acad Sci 1169:282–286
Pitt MA, Crowder RG (1992) The role of spectral and dynamic cues in imagery for musical timbre. J Exp Psychol Hum Percept Perform 18:728–738
Pressley M, Levin JR (1977) Task parameters affecting the efficacy of a visual imagery learning strategy in younger and older children. J Exp Child Psychol 24:53–59
Rauscher FH, Shaw GL, Levine LJ, Wright EL, Dennis WR, Newcomb R (1997) Music training causes long-term enhancement of preschool children’s spatial-temporal reasoning. Neurol Res 19:2–8
Reisberg D, Smith JD, Baxter DA, Sonenshine M (1989) “Enacted” auditory images are ambiguous; “pure” auditory images are not. Q J Exp Psychol 41A:619–641
Richardson A (1977) The meaning and measurement of memory imagery. Br J Psychol 68:29–43
Rusconi E, Kwan B, Giordano BL, Umilta C, Butterworth B (2006) Spatial representation of pitch height: the SMARC effect. Cognition 99:113–129
Rudner M, Rönnberg J, Hugdahl K (2005) Reversing spoken items—mind twisting not tongue twisting. Brain Lang 92:78–90
Schaefer RS, Desain P, Suppes P (2009) Structural decomposition of EEG signatures of melodic processing. Biol Psychol 82:253–259
Schaefer RS, Vlek RJ, Desain P (2011) Music perception and imagery in EEG: alpha band effects of task and stimulus. Int J Psychophysiol 82:254–259
Schellenberg EG (2011) Examining the association between music lessons and intelligence. Br J Psychol 102:283–302
Schellenberg EG, Trehub SE (2003) Good pitch memory is widespread. Psychol Sci 14:262–266
Schneider TR, Engel AK, Debener S (2008) Multisensory identification of natural objects in a two-way crossmodal priming paradigm. Exp Psychol 55:121–132
Schürmann M, Raji T, Fujiki N, Hari R (2002) Mind’s ear in a musician: where and when in the brain. Neuroimage 16:434–440
Seal ML, Aleman A, McGuire PK (2004) Compelling imagery, unanticipated speech, and deceptive memory: neurocognitive models of auditory verbal hallucinations in schizophrenia. Cogn Neuropsychiatry 9:43–72
Seashore CE (1967) Psychology of Music. Dover, New York (Original work published 1938)
Segal SJ, Fusella V (1970) Influence of imaged pictures and sounds in detection of visual and auditory signals. J Exp Psychol 83:458–464
Sheehan PW (1967) A shortened form of Betts’ questionnaire upon mental imagery. J Clin Psychol 23:386–389
Shergill SS, Brammer MJ, Amaro E, Williams SCR, Murray RM, McGuire PK (2004) Temporal course of auditory hallucinations. Br J Psychiatry 185:516–517
Slade PD (1976) An investigation of psychological factors involved in the predisposition to auditory hallucinations. Psychol Med 6:123–132
Smith JD (1992) The auditory hallucinations of schizophrenia. In: Reisberg D (ed) Auditory Imagery. Erlbaum, Hillsdale, NJ
Smith JD, Wilson M, Reisberg D (1995) The role of subvocalization in auditory memory. Neuropsychologia 33:1433–1454
Spence C (2011) Crossmodal correspondences: a tutorial review. Atten Percept Psychophys 73:971–995
Starker S, Jolin A (1982) Imagery and hallucinations in schizophrenic patients. J Nerv Ment Dis 170:448–451
Stuart GP, Jones DM (1996) From auditory image to auditory percept: facilitation through common processes? Mem Cognit 24:296–304
Sullivan C, Urakawa KS, Cossey VL (1996) Separating the effects of alertness from the effects of encoding in a pitch-imagery task. J Gen Psychol 123:105–114
Tahiroglu D, Mannering AM, Taylor M (2011-2012) Visual and auditory imagery associated with children’s imaginary companions. Imagin Cogn Pers 31:99–112
Theiler AM, Lippman LG (1995) Effects of mental practice and modeling on guitar and vocal performance. J Gen Psychol 122:329–343
Tian X, Poeppel D (2010) Mental imagery of speech and movement implicates the dynamics of internal forward models. Front Psychol 1:166, 1–23
Tinti C, Cornoldi C, Marschark M (1997) Modality-specific auditory imaging and the interactive imagery effect. Eur J Cogn Psychol 9:417–436
Tracy RJ, Roesner LS, Kovac RN (1988) The effect of visual versus auditory imagery on vividness and memory. J Mental Imagery 12:145–161
Van Dijk H, Nieuwenhuis IL, Jensen O (2010) Left temporal alpha band activity increases during working memory retention of pitches. Eur J Neurosci 31:1701–1707
Vlek RJ, Schaefer RS, Gielen CCAM, Farquhar JDR, Desain P (2011) Shared mechanism in perception and imagery of auditory accents. Clin Neurophysiol 122:1526–1532
Vuvan DT, Schmuckler MA (2011) Tonal hierarchy representations in auditory imagery. Mem Cognit 39:477–490
Warren RM (1968) Verbal transformation effect and auditory perceptual mechanisms. Psychol Bull 70:261–270
Waters AJ, Townsend E, Underwood G (1998) Expertise in musical sight-reading: a study of pianists. Br J Psychol 89:123–149
Weber RJ, Bach M (1969) Visual and speech imagery. Br J Psychol 60:199–202
Weber RJ, Brown S (1986) Musical imagery. Music Percept 3:411–426
Weber RJ, Castleman J (1970) The time it takes to imagine. Percept Psychophys 8:165–168
Willander J, Baraldi S (2010) Development of a new clarity of auditory imagery scale. Behav Res Methods 42:785–790
Wöllner C, Halfpenny E, Ho S, Kurosawa K (2003) The effects of distracted inner hearing on sight-reading. Psychol Music 31:377–389
Wu J, Mai X, Chan CC, Zheng Y, Luo Y (2006) Event-related potentials during mental imagery of animal sounds. Psychophysiology 43:592–597
Wu J, Mai X, Yu Z, Qin S, Luo Y (2010) Effects of discrepancy between imagined and perceived sounds on the N2 component of the event-related potential. Psychophysiology 47:289–298
Wu J, Yu Z, Mai X, Wei J, Luo Y (2011) Pitch and loudness information encoded in auditory imagery as revealed by event-related potentials. Psychophysiology 48:415–419
Zacks JM (2008) Neuroimaging studies of mental rotation: a meta-analysis and review. J Cogn Neurosci 20:1–19
Zatorre RJ, Halpern AR (1993) Effect of unilateral temporal-lobe excision on perception and imagery of songs. Neuropsychologia 31:221–232
Zatorre RJ, Halpern AR (2005) Mental concerts: musical imagery and the auditory cortex. Neuron 47:9–12
Zatorre RJ, Halpern AR, Bouffard M (2010) Mental reversal of imagined melodies: a role for the posterior parietal cortex. J Cogn Neurosci 22:775–789
Zatorre RJ, Halpern AR, Perry DW, Meyer E, Evans AC (1996) Hearing in the mind’s ear: a PET investigation of musical imagery and perception. J Cogn Neurosci 8:29–46
Acknowledgements
AcknowledgmentsThe author thanks Andrea Halpern and Caroline Palmer for helpful comments on a previous version of this chapter.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer Science+Business Media, LLC
About this chapter
Cite this chapter
Hubbard, T.L. (2013). Auditory Aspects of Auditory Imagery. In: Lacey, S., Lawson, R. (eds) Multisensory Imagery. Springer, New York, NY. https://doi.org/10.1007/978-1-4614-5879-1_4
Download citation
DOI: https://doi.org/10.1007/978-1-4614-5879-1_4
Published:
Publisher Name: Springer, New York, NY
Print ISBN: 978-1-4614-5878-4
Online ISBN: 978-1-4614-5879-1
eBook Packages: Biomedical and Life SciencesBiomedical and Life Sciences (R0)