Abstract
Affective associations between a speaker’s voice (emotional prosody) and a facial expression were investigated using a new on-line procedure, the Facial Affect Decision Task (FADT). Faces depicting one of four ‘basic’ emotions were paired with utterances conveying an emotionally-related or unrelated prosody, followed by a yes/no judgement of the face as a ‘true’ exemplar of emotion. Results established that prosodic characteristics facilitate the accuracy and speed of decisions about an emotionally congruent target face, supplying empirical support for the idea that information about discrete emotions is shared across major nonverbal channels. The FADT represents a promising tool for future on-line studies of nonverbal processing in both healthy and disordered individuals.
Similar content being viewed by others
References
R. Adolphs (2002) ArticleTitleNeural systems for recognizing emotion Current Opinion in Neurobiology 12 169–177 Occurrence Handle10.1016/S0959-4388(02)00301-X
J. Bargh (1988) Automatic information processing: Implications for communication and affect L. Donohew H. Sypher E. T. Higgins (Eds) Communication, social cognition and affect Erlbaum Hillsdale, NJ 9–32
J. A. Bargh (1992) ArticleTitleThe ecology of automaticity: Toward establishing the conditions needed to produce processing effects American Journal of Psychology 105 181–199
J. Bargh S. Chaiken R. Govender F. Pratto (1992) ArticleTitleThe generality of the automatic attitude activation effect Journal of Personality and Social Psychology 62 893–912 Occurrence Handle10.1037//0022-3514.62.6.893
J. Bargh S. Chaiken P. Raymond C. Hymes (1996) ArticleTitleThe automatic evaluation effect: Unconditional automatic attitude activation with a pronunciation task Journal of Experimental Social Psychology 32 104–128 Occurrence Handle10.1006/jesp.1996.0005
S. R. Baum M. D. Pell (1999) ArticleTitleThe neural bases of prosody: Insights from lesion studies and neuroimaging Aphasiology 13 581–608 Occurrence Handle10.1080/026870399401984
D. Bimler J. Kirkland (2001) ArticleTitleCategorical perception of facial expressions of emotion: Evidence from multidimensional scaling Cognition and Emotion 15 633–658 Occurrence Handle10.1080/02699930143000077
J. Borod (2000) ArticleTitleRelationships among facial, prosodic, and lexical channels of emotional perceptual processing Cognition and Emotion 14 193–211 Occurrence Handle10.1080/026999300378932
J. C. Borod B. A. Cicero L. K. Obler J. Welkowitz H. M. Erhan C. Santschi I. S. Grunwald R. M. Agosti J. R. Whalen (1998) ArticleTitleRight hemisphere emotional perception: Evidence across multiple channels Neuropsychology 12 446–458 Occurrence Handle10.1037//0894-4105.12.3.446
G. H. Bower (1981) ArticleTitleMood and memory American Psychologist 36 129–148 Occurrence Handle10.1037//0003-066X.36.2.129
D. Bowers R. Bower K. Heilman (1993) ArticleTitleThe nonverbal affect lexicon: Theoretical perspectives from neuropsychological studies of affect perception Neuropsychology 7 433–444 Occurrence Handle10.1037//0894-4105.7.4.433
B. Gelder Particlede K. B. E. Bocker J. Tuomainen M. Hensen J. Vroomen (1999) ArticleTitleThe combined perception of emotion from voice and face: Early interaction revealed by human brain responses Neuroscience Letters 260 133–136 Occurrence Handle10.1016/S0304-3940(98)00963-X
B. Gelder Particlede G. Pourtois J. Vroomen A. C. Bachoud-Levi (2000) ArticleTitleCovert processing of faces in prosopagnosia is restricted to facial expressions: Evidence from cross-modal bias Brain and Cognition 44 425–444 Occurrence Handle10.1006/brcg.1999.1203
B. Gelder Particlede J. Vroomen (2000) ArticleTitleThe perception of emotions by ear and by eye Cognition and Emotion 14 289–311 Occurrence Handle10.1080/026999300378824
J. Houwer ParticleDe P. Eelen (1998) ArticleTitleAn affective variant of the Simon Paradigm Cognition and Emotion 12 45–61 Occurrence Handle10.1080/026999398379772
U. Dimberg A. Öhman (1996) ArticleTitleBeyond the wrath: Psychophysiological responses to facial stimuli Motivation and Emotion 20 149–182
P. Ekman (1992) ArticleTitleAn argument for basic emotions Cognition and Emotion 6 169–200
P. Ekman W. Friesen (1976) Pictures of facial affect. Consulting Psychologist’s Press Palo Alto, CA
P. Ekman E. R. Sorenson W. V. Friesen (1969) ArticleTitlePan-cultural elements in facial displays of emotion Science 164 86–88
N. L. Etcoff J. L. Magee (1992) ArticleTitleCategorical perception of facial expressions Cognition 44 227–240 Occurrence Handle10.1016/0010-0277(92)90002-Y
R. H. Fazio (2001) ArticleTitleOn the automatic activation of associated evaluations: An overview Cognition and Emotion 15 115–141 Occurrence Handle10.1080/0269993004200024
R. H. Fazio D. M. Sanbonmatsu M. C. Powell F. R. Kardes (1986) ArticleTitleOn the automatic activation of attitudes Journal of Personality and Social Psychology 50 229–238 Occurrence Handle10.1037//0022-3514.50.2.229
S. T. Fiske M. A. Pavelchak (1986) Category-based versus piecemeal-based affective responses: Developments in schema-triggered affects R. M. Sorrentino E. T. Higgins (Eds) Handbook of motivation and cognition: Foundations of social behavior Guilford New York, NY 167–203
N. H. Frijda (1993) ArticleTitleThe place of appraisal in emotion Cognition and Emotion 7 357–387
J. Halberstadt P. Niedenthal J. Kushner (1995) ArticleTitleResolution of lexical ambiguity by emotional state Psychological Science 6 278–282
C. H. Hansen C. A. Shantz (1995) ArticleTitleEmotion-specific priming: Congruence effects on affect and recognition across negative emotions Personality and Social Psychology 21 548–557
D. Hermans J. Houwer ParticleDe P. Eelen (1994) ArticleTitleThe affective priming effect: Automatic activation of evaluative information in memory Cognition and Emotion 8 515–533
D. Hermans J. Houwer ParticleDe P. Eelen (1996) ArticleTitleEvaluative decision latencies mediated by induced affective states Behaviour Research and Therapy 34 483–488 Occurrence Handle10.1016/0005-7967(96)00017-4
K. A. Hutchison J. H. Neely J. D. Johnson (2001) ArticleTitleWith great expectations, can two “Wrongs” prime a “Right” Journal of Experimental Psychology: Learning, Memory, and Cognition 27 1451–1463
A. Isen (1984) Toward understanding the role of affect in cognition R. S. Wyer T. K. Srull (Eds) Handbook of social cognition Erlbaum Hillsdale, NJ 179–236
C. Izard (1992) ArticleTitleBasic emotions, relations among emotions, and emotion-cognition relations Psychological Review 99 561–565 Occurrence Handle10.1037//0033-295X.99.3.561
C. E. Izard (1977) Human emotions Plenum Press New York
G. Kirouac F. Dore (1984) ArticleTitleAccuracy and latency of judgment of facial expressions of emotion Perceptual Motor Skills 57 683–686
S. Kitayama (1996) ArticleTitleRemembrance of emotional speech: Improvement and impairment of incidental verbal memory by emotional voice Journal of Experimental Social Psychology 32 289–308 Occurrence Handle10.1006/jesp.1996.0014
S. Kitayama S. Howard (1994) Affective regulation of perception and comprehension: Amplification and sematic priming P. M. Niedenthal S. Kitayama (Eds) The heart’s eye: Emotional influences in perception and attention Academic Press San Diego 41–65
K. C. Klauer J. Musch (2002) ArticleTitleGoal-dependent and goal independent effects of irrelevant evaluations Personality and Social Psychology Bulletin 28 802–814
K. C. Klauer C. Robnagel J. Musch (1997) ArticleTitleList-context effects in evaluative priming Journal of Experimental Psychology: Learning, Memory, and Cognition 23 246–255
J. LeDoux (1989) ArticleTitleCognitive-emotional interactions in the brain Cognition and Emotion 3 267–289
D. Massaro P. Egan (1996) ArticleTitlePerceiving affect from the voice and the face Psychonomic Bulletin and Review 3 215–221
A. Mathews B. Mackintosh (1998) ArticleTitleA cognitive model of selective processing in anxiety Cognitive Therapy and Research 22 539–560 Occurrence Handle10.1023/A:1018738019346
L. Max P. Onghena (1999) ArticleTitleSome issues in the statistical analysis of completely randomized and repeated measures designs for speech, language, and hearing research Journal of Speech, Language, and Hearing Research 42 261–270
K. Mogg B. P. Bradley (1999) ArticleTitleOrienting of attention to threatening facial expressions presented under conditions of restricted awareness Cognition and Emotion 13 713–740 Occurrence Handle10.1080/026999399379050
S. Murphy R. Zajonc (1993) ArticleTitleAffect, cognition, and awareness: Affective priming with optimal and suboptimal stimulus exposures Journal of Personality and Social Psychology 64 723–739 Occurrence Handle10.1037//0022-3514.64.5.723
J. Musch K. C. Klauer (2001) ArticleTitleLocational uncertainty moderates affective congruency effects in the evaluative decision task Cognition and Emotion 15 167–188 Occurrence Handle10.1080/0269993004200042
Neely, J. (1991). Semantic priming effects in visual word recognition: A selective review of current findings and theories. In Besner (Ed.), Basic processes in reading: Visual word recognition (pp. 264--336). Hillsdale, NJ: Erlbaum.
J. H. Neely D. E. Keefe K. L. Ross (1989) ArticleTitleSemantic priming in the lexical decision task: Roles of prospective prime-generated expectancies and retrospective semantic matching Journal of Experimental Psychology: Learning, Memory, and Cognition 15 1003–1019
P. M. Niedenthal (1990) ArticleTitleImplicit perception of affective information Journal of Experimental Social Psychology 26 505–527 Occurrence Handle10.1016/0022-1031(90)90053-O
P. M. Niedenthal J. B. Halberstadt (1995) ArticleTitleThe acquisition and structure of emotional response categories The Psychology of Learning and Motivation 33 23–64
P. M. Niedenthal J. B. Halberstadt M. B. Setterlund (1997) ArticleTitleBeing happy and seeing “happy”: Emotional state mediates visual word recognition Cognition and Emotion 11 403–432 Occurrence Handle10.1080/026999397379863
A. Öhman (1987) ArticleTitleThe psychophysiology of emotion: An evolutionary-cognitive perspective Advances in Psychophysiology 2 79–127
A. Öhman (1992) Orienting and attention: Preferred preattentive processing of potentially phobic stimuli B. Campbell H. Haynes R. Richardson (Eds) Attention and information processing in infants and adults: Perspectives from human and animal research Erlbaum Hillsdale, NJ 263–295
A. Öhman J. Soares (1994) ArticleTitleUnconscious anxiety: Phobic reponses to masked stimuli Journal of Abnormal Psychology 103 231–240 Occurrence Handle10.1037//0021-843X.103.2.231
W. Onifer D. A. Swinney (1981) ArticleTitleAccessing lexical ambiguities during sentence comprehension: Effects of frequency of meaning and contextual bias Memory and Cognition 9 225–236
M. D. Pell (2002) ArticleTitleEvaluation of nonverbal emotion in face and voice: Some preliminary findings on a new battery of tests Brain and Cognition 48 499–504
Pell, M. D. (under review). Prosody-face interactions in emotional processing as revealed by the facial affect decision task.
M. D. Pell S. R. Baum (1997) ArticleTitleThe ability to perceive and comprehend intonation in linguistic and affective contexts by brain-damaged adults Brain and Language 57 80–99 Occurrence Handle10.1006/brln.1997.1638
F. Pratto (1994) Consciousness and automatic evaluation P. Niedenthal S. Kitayama (Eds) The heart’s eye Academic Press New York 115–143
F. Pratto O. P. John (1991) ArticleTitleAutomatic vigilance: The attention-grabbing power of negative social information Journal of Personality and Social Psychology 61 380–391 Occurrence Handle10.1037//0022-3514.61.3.380
S. Rapcsak J. Comer A. Rubens (1993) ArticleTitleAnomia for facial expressions: Neuropsychological mechanisms and anatomical correlates Brain and Language 45 233–252 Occurrence Handle10.1006/brln.1993.1044
M. Robinson (1998) ArticleTitleRunning from William James’ bear: A review of preattentive mechanisms and their contributions to emotional experience Cognition and Emotion 12 667–696 Occurrence Handle10.1080/026999398379493
J. Russell (1980) ArticleTitleA circumplex model of affect Journal of Personality and Social Psychology 39 1161–1178 Occurrence Handle10.1037//0022-3514.39.1.29
K. R. Scherer (1986) ArticleTitleVocal affect expression: A review and a model for future research Psychological Bulletin 99 143–165 Occurrence Handle10.1037//0033-2909.99.2.143
K. R. Scherer (1989) Vocal correlates of emotional arousal and affective disturbance H. Wagner A. Manstead (Eds) Handbook of social psychophysiology Wiley Oxford, England 165–197
K. R. Scherer (1993) ArticleTitleNeuroscience projections to current debates in emotion psychology Cognition and Emotion 7 1–41
K. R. Scherer R. Banse H. Wallbott (2001) ArticleTitleEmotion inferences from vocal expression correlate across languages and cultures Journal of Cross-Cultural Psychology 32 76–92
K. R. Scherer H. G. Wallbott (1994) ArticleTitleEvidence for universality and cultural variation of differential emotion response patterning Journal of Personality and Social Psychology 66 310–328 Occurrence Handle10.1037//0022-3514.66.2.310
A. Schirmer S. Kotz A. Friederici (2002) ArticleTitleSex differentiates the role of emotional prosody during word processing Cognitive Brain Research 14 228–233 Occurrence Handle10.1016/S0926-6410(02)00108-8
R. Shiffrin W. Schneider (1977) ArticleTitleControlled and automatic human information processing: II. Perceptual learning, automatic attention and a general theory Psychological Review 84 127–190 Occurrence Handle10.1037//0033-295X.84.1.1
D. Swinney (1979) ArticleTitleLexical access during sentence comprehension: (Re)consideration of context effects Journal of Verbal Learning and Verbal Behavior 18 645–659 Occurrence Handle10.1016/S0022-5371(79)90355-4
J. Honk Particlevan A. Tuiten E. Haan Particlede M. Hout Particlevan den H. Stam (2001) ArticleTitleAttentional biases for angry faces: Relationships to trait anger and anxiety Cognition and Emotion 15 279–297 Occurrence Handle10.1080/0269993004200222
D. Wentura (1999) ArticleTitleActivation and inhibition of affective information: Evidence for negative priming in the evaluation task Cognition and Emotion 13 65–91 Occurrence Handle10.1080/026999399379375
D. Wentura (2000) ArticleTitleDissociative affective and associative priming effects in the lexical decision task: Yes versus no responses to word targets reveal evaluative judgement tendencies Journal of Experimental Psychology: Learning, Memory, and Cognition 26 456–469
J. Williams A. Matthews C. MacLeod (1996) ArticleTitleThe emotional Stroop task and psychopathology Psychological Bulletin 120 3–24 Occurrence Handle10.1037//0033-2909.120.1.3
L. H. Wurm D. A. Vakoch M. R. Strasser R. Calin-Jageman S. E. Ross (2001) ArticleTitleSpeech perception and vocal expression of emotion Cognition and Emotion 15 831–852 Occurrence Handle10.1080/02699930143000086
A. Young D. Rowland A. Calder N. Etcoff A. Seth D. Perrett (1997) ArticleTitleFacial expression megamix: Tests of dimensional and category accounts of emotion recognition Cognition 63 271–313 Occurrence Handle10.1016/S0010-0277(97)00003-6
Author information
Authors and Affiliations
Corresponding author
Additional information
The author gratefully acknowledges the service of Elmira Chan, Sarah Addleman, and Marta Fundamenski for running the experiment, and for helpful comments received from M. Harris, K. Scherer and anonymous reviewers of an earlier draft of the paper. This research was funded by the Natural Sciences and Engineering Research Council of Canada.
Rights and permissions
About this article
Cite this article
Pell, M.D. Nonverbal Emotion Priming: Evidence from the ‘Facial Affect Decision Task’. J Nonverbal Behav 29, 45–73 (2005). https://doi.org/10.1007/s10919-004-0889-8
Issue Date:
DOI: https://doi.org/10.1007/s10919-004-0889-8