Research reportProcessing of affective prosody and lexical-semantics in spoken utterances as differentiated by event-related potentials
Section snippets
Participants
Fourteen right-handed female undergraduate university students were asked to participate in this experiment for extra points of credit as part of their required undergraduate program. The age range fell between 19 and 40 years of age (mean=25.7, S.D.=5.8). All participants were native speakers of American English. Hearing status was determined for each ear through audiometric screening procedures. Only participants with normal hearing at octave intervals between 500 and 4000 Hz (threshold ≤25
Behavioral results
The accuracy scores gathered during experimental testing indicated that the participants could accurately identify the stimuli across conditions and types. All participants obtained an accuracy score of 88% or higher across all conditions. A repeated-measures ANOVA evaluating the accuracy scores for each stimulus condition (non-targets and targets) across stimulus types (prosody, semantics, bi-dimensional) resulted in a main effect of stimulus type (F(2,26)=8.256, p=0.002) and stimulus
Discussion
A variety of cues are extracted from a set of communicative dimensions in order to comprehend spoken messages. The majority of research has chosen one communicative dimension to study rather than investigating how and when prompts of various communicative dimensions are used and how they interact. Specific brain potentials indicating the immediate use of linguistic prosodic cues to solve syntactic ambiguities in natural speech processing have been reported [64] but such explorations cannot be
References (71)
- et al.
Three-channel Lissajous' trajectory of event related potentials to target stimuli
Electroencephalogr. Clin. Neurophysiol.
(1990) - et al.
Auditory event related potentials during lexical categorization in the oddball paradigm
Brain Lang.
(1992) - et al.
Event-related potentials to Italian spoken words
Electroencephalogr. Clin. Neurophysiol.
(1997) - et al.
P3a, perceptual distinctiveness, and stimulus modality
Cogn. Brain Res.
(1998) - et al.
P3a and P3b from typical auditory and visual stimuli
Clin. Neurophysiol.
(1999) - et al.
Stimulus novelty, task relevance, and the visual evoked potential in man
Electroencephalogr. Clin. Neurophysiol.
(1975) - et al.
The relationship between P300 amplitude and regional gray matter volumes depends upon the attentional system engaged
Electroencephalogr. Clin. Neurophysiol.
(1994) - et al.
Laterality and sex differences for visual recognition of affective and nonemotional words
Neuropsychologia
(1981) - et al.
Intracerebral potentials to rare target and distractor auditory and visual stimuli: I. Superior temporal plane and parietal lobe
Electroencephalogr. Clin. Neurophysiol.
(1995) From general to language specific capacities: the WRAPSA model of how speech perception develops
J. Phon.
(1993)
Event-related brain potentials during auditory and visual word recognition memory tasks
Cogn. Brain Res.
Hemispheric asymmetry in the perception of affective sounds
Brain Cogn.
The TRACE model of speech perception
Cogn. Psychol.
Auditory evoked responses recorded from 16-month-old human infants to words they did and did not know
Brain Lang.
An auditory Stroop effect for pitch, loudness, and time
Brain Lang.
Shortlist: a connectionist model of continuous speech recognition
Cognitiques
Evoked potential indices of selective hemispheric engagement in affective and phonetic tasks
Neuropsychologia
Semantic categorization and event-related potentials
Brain Lang.
On processing BEASTS and BIRDS: an event-related potential study on the representation of taxonomic structure
Brain Lang.
Hemispheric asymmetry in the recognition of emotional attitude conveyed by facial expression, prosody and propositional speech
Cortex
On the relationship of P3a and the Novelty-P3
Biol. Psychol.
Two varieties of long-latency positive waves evoked by unpredictable auditory stimuli in man
Electroencephalogr. Clin. Neurophysiol.
Ambiguous words in context: an event-related potential analysis of the time course of meaning activation
J. Mem. Lang.
Judgments of emotion in words and faces: ERP correlates
Int. J. Psychophysiol.
The distribution of manual asymmetry
Br. J. Psychol.
An inventory for measuring depression
Arch. Gen. Psychiatry
An inventory for measuring clinical anxiety: psychometric properties
J. Consult. Clin. Psychol.
Verbal and nonverbal communication: distinguishing symbolic, spontaneous, and pseudo-spontaneous nonverbal behavior
J. Comm.
Perceptual specificity of auditory priming: implicit memory for voice intonation and fundamental frequency
J. Exper. Psychol., Learn., Mem., Cogn.
Facial, prosodic, and lexical affective perception in stroke patients with unilateral brain damage: preliminary findings
J. Int. Neuropsychol. Soc.
Word recognition time and event related potentials during affective word processing
J. Psychophysiol.
Multivariate analysis of event-related potential data: a tutorial review
Appreciation of affective expressions in the visual and auditory modality in normal and brain damaged patients
Acta Neurol. Scand.
Stimulus characteristics and task category dissociate the anterior and posterior aspects of the novelty P3
Psychophysiology
Cited by (44)
Listen to my feelings! How prosody and accent drive the empathic relevance of complaining speech
2022, NeuropsychologiaCitation Excerpt :It is often followed by late positivities (Mauchand et al., 2021; Paulmann et al., 2013; Zougkou et al., 2017), analogous to the dissociation of affective and cognitive components of empathy. Depending on context and task demands, other early and late components of affective prosody perception have also been reported, such as mismatch negativity (Carminati et al., 2018; Thönnessen et al., 2010), early posterior negativity (Jaspers-Fayer et al., 2012; Mittermeier et al., 2011), or P3a (Carminati et al., 2018; Wambacq and Jerger, 2004). A major aspect of empathy is its social and cultural dimension; indeed, sharing and understanding other's emotions is often facilitated by socio-cultural proximity (Cheon et al., 2010).
Semantic processing and neurobiology in Alzheimer's disease and Mild Cognitive Impairment
2022, NeuropsychologiaCitation Excerpt :Again, in the same vein, studies with significant data reviewed by Almeida (2021) also speak in favour of cholinergic transients being central to conscious access of semantically-unrelated and weakly-related words (e.g., in sentences and word pairs of lexical decision tasks; see also Guillem et al., 2006) - for instance, cholinergic transients can be released within the same time window (Gritton et al., 2016; Howe et al., 2017; Sarter and Lustig, 2020; Détári et al., 1997), mediating theta oscillations (associated with the N400) as well as cue detection performance (Howe et al., 2017; Almeida, 2021). Cholinergic agents and theta oscillations also notoriously contribute to oddball ERPs (Mismatch Negativity, P3a) in oddball paradigms - a paradigm that, along with some variations, can elicit the N400 (Musiolek et al., 2019; Kitade et al., 1999; Munivrana Dervšbegović and Mildner, 2019; Kutas and Hillyard, 1983; Wambacq and Jerger, 2004; Jin et al., 2014; Schlaghecken, 1998; Cobianchi and Giaquinto, 1997; Kaplan and Levichkina, 2008; Attias and Pratt, 1992; Almeida, 2021;). Moreover, this hypothesis on cholinergic-mediated retrieval of weak lexical-semantic links could also help explain the paradoxical lack of lower-frequency words and switching in verbal fluency, as the two are apparently contradictory, but both could be reliant on cholinergic function.
Neurophysiological basis of the N400 deflection, from Mismatch Negativity to Semantic Prediction Potentials and late positive components
2021, International Journal of PsychophysiologyCitation Excerpt :The MMN (or N2a) is a negative deviance-detection ERP with an onset latency of ~150 ms and a peak latency of ~250 ms. It is ordinarily probed with auditory oddball paradigms, whereby identical stimuli – e.g., simple tones – are presented repeatedly in an “adaptation period” and sporadically interspersed by “oddballs”, or deviants, which precipitate the deflection. Since the oddball paradigm and/or variations of it (e.g., rather than tones, words or sentence words are presented seriatim until one of them violates expectations or semantic constraints) can provoke the N4 (Musiolek et al., 2019; Kitade et al., 1999; Munivrana Dervišbegović and Mildner, 2019; Kutas and Hillyard, 1983; Wambacq and Jerger, 2004; Jin et al., 2014; Schlaghecken, 1998; Cobianchi and Giaquinto, 1997; Kaplan and Levichkina, 2008; Attias and Pratt, 1992), the MMN should be our choice. Indeed, the two are similar enough to warrant an ongoing debate (Section 4.1) on whether to interpret the N4 as a N2 variant (Bornkessel-Schlesewsky and Schlesewsky, 2019; Kotchoubey, 2006; Kutas and Federmeier, 2011).
Emotional prosody Stroop effect in Hindi: An event related potential study
2019, Progress in Brain ResearchCitation Excerpt :Moreover, the mismatch in the auditory features of sound, such as frequency in Hz and intensity in dB, modulate the amplitudes of N1 whose peak occurs at around 100 ms over fronto-central regions (Hari et al., 1987; Hyde, 1997; Jones, 2003; Vaughan and Ritter, 1970). While we found an early effect and did not find any effect in P200, differences in emotional prosodic speech in P200 with higher amplitudes for happy prosody compared to neutral or angry prosodies has been found in the same frontocentral regions (Chen et al., 2011; Wambacq and Jerger, 2004; Paulmann et al., 2008, 2013; Schirmer et al., 2013). This P2 component has been repeatedly linked with early emotional prosody detection irrespective of explicit and implicit tasks (Kotz and Paulmann, 2011; Paulmann and Kotz, 2008; Schirmer and Kotz, 2006).
Influence of attention on bimodal integration during emotional change decoding: ERP evidence
2016, International Journal of Psychophysiology