SpringerLink
Log in

Neurophysiological Underpinnings of Prosody

  • Protocol
  • First Online:
Language Electrified

Part of the book series: Neuromethods ((NM,volume 202))

  • 651 Accesses

Abstract

Prosody, that is meaningful patterns in intonation, rhythm, stress, and tone, impacts on a large body of other language operations, and it is likely one of the most undervalued and possibly understudied language-related functions. Drawing primarily upon evidence from event-related brain potentials (ERPs) but also referring to neural oscillation activity where possible, this chapter offers a concise review of the electrophysiological responses underlying prosody, how prosody im**es on other language functions, summarizes the effects of task demands and listeners characteristics, and ends by sketching future directions of travel for the field of studying how prosody is processed in the brain.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Subscribe and save

Springer+ Basic
EUR 32.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or Ebook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Protocol
EUR 44.95
Price includes VAT (France)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
EUR 249.00
Price includes VAT (France)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
EUR 316.49
Price includes VAT (France)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free ship** worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Steinhauer K, Alter K, Friederici AD (1999) Brain potentials indicate immediate use of prosodic cues in natural speech processing. Nat Neurosci 2:191–196

    Article  CAS  PubMed  Google Scholar 

  2. Pauker E et al (2011) Effects of cooperating and conflicting prosody in spoken English garden path sentences: ERP evidence for the boundary deletion hypothesis. J Cogn Neurosci 23:2731–2751

    Article  PubMed  Google Scholar 

  3. Steinhauer K, Friederici AD (2001) Prosodic boundaries, comma rules, and brain responses: the closure positive shift in ERPs as a universal marker for prosodic phrasing in listeners and readers. J Psycholinguist Res 30:267–295

    Article  CAS  PubMed  Google Scholar 

  4. Hwang H, Steinhauer K (2011) Phrase length matters: the interplay between implicit prosody and syntax in Korean “garden path” sentences. J Cogn Neurosci 23:3555–3575

    Article  PubMed  Google Scholar 

  5. Foti D, Roberts F (2016) The neural dynamics of speech perception: dissociable networks for processing linguistic content and monitoring speaker turn-taking. Brain Lang 157:63–71

    Article  PubMed  Google Scholar 

  6. Li X, Chen Y, Yang Y (2011) Immediate integration of different types of prosodic information during on-line spoken language comprehension: an ERP study. Brain Res 1386:139–152

    Article  CAS  PubMed  Google Scholar 

  7. Böcker KB et al (1999) An ERP correlate of metrical stress in spoken word recognition. Psychophysiology 36:706–720

    Article  PubMed  Google Scholar 

  8. Mietz A et al (2008) Inadequate and infrequent are not alike: ERPs to deviant prosodic patterns in spoken sentence comprehension. Brain Lang 104:159–169

    Article  PubMed  Google Scholar 

  9. Paulmann S, Jessen S, Kotz SA (2012) It’s special the way you say it: an ERP investigation on the temporal dynamics of two types of prosody. Neuropsychologia 50:1609–1620

    Article  PubMed  Google Scholar 

  10. Eckstein K, Friederici AD (2006) It’s early: event-related potential evidence for initial interaction of syntax and prosody in speech comprehension. J Cogn Neurosci 18:1696–1711

    Article  PubMed  Google Scholar 

  11. Köster D (2014) Prosody in parsing morphologically complex words: neurophysiological evidence. Cogn Neuropsychol 31:147–163

    Article  Google Scholar 

  12. Söderström P, Horne M, Roll M (2017) Stem tones pre-activate suffixes in the brain. J Psycholinguist Res 46:271–280

    Article  PubMed  Google Scholar 

  13. Astésano C, Besson M, Alter K (2004) Brain potentials during semantic and prosodic processing in French. Cogn Brain Res 18:172–184

    Article  Google Scholar 

  14. Pfurtscheller G (2001) Functional brain imaging based on ERD/ERS. Vis Res 41:1257–1260

    Article  CAS  PubMed  Google Scholar 

  15. Cacace AT, McFarland DJ (2003) Spectral dynamics of electroencephalographic activity during auditory information processing. Hear Res 176:25–41

    Article  PubMed  Google Scholar 

  16. Augurzky P, Kotchoubey B (2016) Prosodic phrasing in the presence of unambiguous verb information–ERP evidence from German. Neuropsychologia 81:31–49

    Article  PubMed  Google Scholar 

  17. Schirmer A, Kotz SA (2006) Beyond the right hemisphere: brain mechanisms mediating vocal emotional processing. Trends Cogn Sci 10:24–30

    Article  PubMed  Google Scholar 

  18. Kotz SA, Paulmann S (2011) Emotion, language, and the brain. Lang Ling Compass 5:108–125

    Article  Google Scholar 

  19. Näätänen R, Picton T (1987) The N1 wave of the human electric and magnetic response to sound: a review and an analysis of the component structure. Psychophysiology 24:375–425

    Article  PubMed  Google Scholar 

  20. Paulmann S, Bleichner M, Kotz SA (2013) Valence, arousal, and task effects in emotional prosody processing. Front Psychol 4:345

    Article  PubMed  PubMed Central  Google Scholar 

  21. Paulmann S, Kotz SA (2008) Early emotional prosody perception based on different speaker voices. Neuroreport 19:209–213

    Article  PubMed  Google Scholar 

  22. Pinheiro AP et al (2014) Abnormalities in the processing of emotional prosody from single words in schizophrenia. Schizophr Res 152:235–241

    Article  PubMed  Google Scholar 

  23. Schirmer A et al (2013) Vocal emotions influence verbal memory: neural correlates and interindividual differences. Cogn Affect Behav Neurosci 13:80–93

    Article  PubMed  Google Scholar 

  24. Goydke KN et al (2004) Changes in emotional tone and instrumental timbre are reflected by the mismatch negativity. Cogn Brain Res 21:351–359

    Article  Google Scholar 

  25. Jiang A, Yang J, Yang Y (2014) MMN responses during implicit processing of changes in emotional prosody: an ERP study using Chinese pseudo-syllables. Cogn Neurodyn 8:499–508

    Article  PubMed  PubMed Central  Google Scholar 

  26. Schirmer A, Striano T, Friederici AD (2005) Sex differences in the preattentive processing of vocal emotional expressions. Neuroreport 16:635–639

    Article  PubMed  Google Scholar 

  27. Carminati M, Fiori-Duharcourt N, Isel F (2018) Neurophysiological differentiation between preattentive and attentive processing of emotional expressions on French vowels. Biol Psychol 132:55–63

    Article  PubMed  Google Scholar 

  28. Paulmann S (2015) The neurocognition of prosody. In: Hickok G, Small SL (eds) Neurobiology of language. Elsevier (Academic Press), pp 1109–1120

    Google Scholar 

  29. Paulmann S, Uskul AK (2017) Early and late brain signatures of emotional prosody among individuals with high versus low power. Psychophysiology 54:555–565

    Article  PubMed  Google Scholar 

  30. Pantev C et al (1996) Binaural fusion and the representation of virtual pitch in the human auditory cortex. Hear Res 100:164–170

    Article  CAS  PubMed  Google Scholar 

  31. Picton TW et al (1977) Evoked potential audiometry. J Otolaryngol 6:90–119

    Google Scholar 

  32. Liu X et al (2018) Emotional connotations of musical instrument timbre in comparison with emotional speech prosody: evidence from acoustics and event-related potentials. Front Psychol 9:737

    Article  PubMed  PubMed Central  Google Scholar 

  33. Paulmann S, Pell MD (2010) Contextual influences of emotional speech prosody on face processing: how much is enough? Cogn Affect Behav Neurosci 10:230–242

    Article  PubMed  Google Scholar 

  34. Castiajo P, Pinheiro AP (2019) Decoding emotions from nonverbal vocalizations: how much voice signal is enough? Motiv Emot 43:803–813

    Article  Google Scholar 

  35. Steber S et al (2020) Uncovering electrophysiological and vascular signatures of implicit emotional prosody. Sci Rep 10:1–14

    Article  Google Scholar 

  36. Del Giudice R et al (2016) The voice of anger: oscillatory EEG responses to emotional prosody. PLoS One 11:e0159429

    Article  PubMed  PubMed Central  Google Scholar 

  37. Bostanov V, Kotchoubey B (2004) Recognition of affective prosody: continuous wavelet measures of event-related brain potentials to emotional exclamations. Psychophysiology 41:259–268

    Article  PubMed  Google Scholar 

  38. Wambacq IJ, Jerger JF (2004) Processing of affective prosody and lexical-semantics in spoken utterances as differentiated by event-related potentials. Cogn Brain Res 20:427–437

    Article  Google Scholar 

  39. Schirmer A, Kotz SA, Friederici AD (2002) Sex differentiates the role of emotional prosody during word processing. Cogn Brain Res 14:228–233

    Article  Google Scholar 

  40. Schirmer A, Kotz SA, Friederici AD (2005) On the role of attention for the processing of emotions in speech: sex differences revisited. Cogn Brain Res 24:442–452

    Article  Google Scholar 

  41. Schirmer A, Kotz SA (2003) ERP evidence for a sex-specific Stroop effect in emotional speech. J Cogn Neurosci 15:1135–1148

    Article  PubMed  Google Scholar 

  42. Pell MD et al (2015) Preferential decoding of emotion from human non-linguistic vocalizations versus speech prosody. Biol Psychol 111:14–25

    Article  CAS  PubMed  Google Scholar 

  43. Foti D, Hajcak G (2008) Deconstructing reappraisal: descriptions preceding arousing pictures modulate the subsequent neural response. J Cogn Neurosci 20:977–988

    Article  PubMed  Google Scholar 

  44. Kotz SA, Paulmann S (2007) When emotional prosody and semantics dance cheek to cheek: ERP evidence. Brain Res 1151:107–118

    Article  CAS  PubMed  Google Scholar 

  45. Chen X et al (2015) EEG oscillations reflect task effects for the change detection in vocal emotion. Cogn Neurodyn 9:351–358

    Article  PubMed  Google Scholar 

  46. Paulmann S, Weinstein N, Zougkou K (2019) Now listen to this! Evidence from a cross-spliced experimental design contrasting pressuring and supportive communications. Neuropsychologia 124:192–201

    Article  PubMed  Google Scholar 

  47. Chen X et al (2011) Event-related potential correlates of the expectancy violation effect during emotional prosody processing. Biol Psychol 86:158–167

    Article  PubMed  Google Scholar 

  48. Wickens S, Perry C (2015) What do you mean by that?! An electrophysiological study of emotional and attitudinal prosody. PLoS One 10:e0132947

    Article  PubMed  PubMed Central  Google Scholar 

  49. Jiang X, Pell MD (2015) On how the brain decodes vocal cues about speaker confidence. Cortex 66:9–34

    Article  PubMed  Google Scholar 

  50. Rigoulot S, Fish K, Pell MD (2014) Neural correlates of inferring speaker sincerity from white lies: an event-related potential source localization study. Brain Res 1565:48–62

    Article  CAS  PubMed  Google Scholar 

  51. Regel S, Coulson S, Gunter TC (2010) The communicative style of a speaker can affect language comprehension? ERP evidence from the comprehension of irony. Brain Res 1311:121–135

    Article  CAS  PubMed  Google Scholar 

  52. Hodgetts S, Weis S, Hausmann M (2015) Sex hormones affect language lateralisation but not cognitive control in normally cycling women. Horm Behav 74:194–200

    Article  CAS  PubMed  Google Scholar 

  53. Grossmann T, Striano T, Friederici AD (2005) Infants’ electric brain responses to emotional prosody. Neuroreport 16:1825–1828

    Article  PubMed  Google Scholar 

  54. Chronaki G et al (2015) The development of emotion recognition from facial expressions and non-linguistic vocalizations during childhood. Br J Dev Psychol 33:218–236

    Article  PubMed  Google Scholar 

  55. Gerson S et al (2019) Infants attend longer to controlling versus supportive directive speech. J Exp Child Psychol 187:104654

    Article  PubMed  Google Scholar 

  56. Chronaki G et al (2012) Isolating N400 as neural marker of vocal anger processing in 6–11-year old children. Dev Cogn Neurosci 2:268–276

    Article  PubMed  Google Scholar 

  57. Paulmann S, Pell MD, Kotz SA (2008) How aging affects the recognition of emotional speech. Brain Lang 104:262–269

    Article  PubMed  Google Scholar 

  58. Zinchenko A et al (2017) Positive emotion impedes emotional but not cognitive conflict processing. Cogn Affect Behav Neurosci 17:665–677

    Article  PubMed  PubMed Central  Google Scholar 

  59. Paulmann S, Harmsworth C, Russo R (2015) Emotional prosody perception in healthy ageing – evidence from ERPs and recognition rates. SAN conference, Boston, 23–25 April

    Google Scholar 

  60. Scherer KR, Banse R, Wallbott HG (2001) Emotion inferences from vocal expression correlate across languages and cultures. J Cross-Cult Psychol 32:76–92

    Article  Google Scholar 

  61. Pell MD et al (2009) Recognizing emotions in a foreign language. J Nonverbal Behav 33:107–120

    Article  Google Scholar 

  62. Paulmann S, Uskul AK (2014) Cross-cultural emotional prosody recognition: evidence from Chinese and British listeners. Cogn Emot 28:230–244

    Article  PubMed  Google Scholar 

  63. Liu P, Rigoulot S, Pell MD (2015) Culture modulates the brain response to human expressions of emotion: electrophysiological evidence. Neuropsychologia 67:1–13

    Article  PubMed  Google Scholar 

  64. Liu P, Rigoulot S, Pell MD (2015) Cultural differences in on-line sensitivity to emotional voices: comparing East and West. Front Hum Neurosci 9:311

    Article  PubMed  PubMed Central  Google Scholar 

  65. Steinmann S et al (2018) The role of functional and structural interhemispheric auditory connectivity for language lateralization – a combined EEG and DTI study. Sci Rep 8:1–12

    Article  CAS  Google Scholar 

  66. Alday PM, Schlesewsky M, Bornkessel-Schlesewsky I (2019) M/EEG analysis of naturalistic stories: a review from speech to language processing. Lang Cogn Neurosci 34:457–473

    Article  Google Scholar 

  67. Tromp J, Peeters D, Meyer AS, Hagoort P (2018) The combined use of virtual reality and EEG to study language processing in naturalistic environments. Behav Res Methods 50:862–869

    Article  PubMed  Google Scholar 

  68. Babiloni F, Astolfi L (2014) Social neuroscience and hyperscanning techniques: past, present and future. Neurosci Biobehav Rev 44:76–93

    Article  PubMed  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Psychology, Centre for Brain Science, University of Essex, Colchester, UK

    Silke Paulmann

Authors
  1. Silke Paulmann
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Silke Paulmann .

Editor information

Editors and Affiliations

  1. Centro di Ricerca Interdisciplinare sul Linguaggio (CRIL), University of Salento, Lecce, Italy

    Mirko Grimaldi

  2. Department of Clinical Medicine, Aarhus University, Aarhus, Denmark

    Elvira Brattico

  3. Center of Functionally Integrative Neuroscience (CFIN), Department of Clinical Medicine, Aarhus University, Aarhus, Denmark

    Yury Shtyrov

Rights and permissions

Reprints and permissions

Copyright information

© 2023 Springer Science+Business Media, LLC, part of Springer Nature

About this protocol

Check for updates. Verify currency and authenticity via CrossMark

Cite this protocol

Paulmann, S. (2023). Neurophysiological Underpinnings of Prosody. In: Grimaldi, M., Brattico, E., Shtyrov, Y. (eds) Language Electrified. Neuromethods, vol 202. Humana, New York, NY. https://doi.org/10.1007/978-1-0716-3263-5_21

Download citation

  • DOI: https://doi.org/10.1007/978-1-0716-3263-5_21

  • Published:

  • Publisher Name: Humana, New York, NY

  • Print ISBN: 978-1-0716-3262-8

  • Online ISBN: 978-1-0716-3263-5

  • eBook Packages: Springer Protocols

Publish with us

Policies and ethics

Search

Navigation