1932
0
  1. Home
  2. A-Z Publications
  3. Annual Review of Linguistics
  4. Volume 9, 2023
  5. Article

Annual Review of Linguistics

Volume 9, 2023

Speech Prosody in Mental Disorders

Abstract

In response to uncovering brain mechanisms underlying vocal communication and searching for biomarkers for mental illnesses, speech prosody has been increasingly studied in recent years in multiple disciplines, including psycholinguistics. In this article, we provide an up-to-date synthesis of the theoretical foundation and empirical evidence to profile linguistic and emotional prosody in the proper characterization of mental disorders, including schizophrenia, autism, Alzheimer's disease, and depression. Our review reveals a need to develop theoretically motivated and methodologically integrated approaches to the study of context-driven comprehension and expression of pragmatic-affective prosody, which will help elucidate the core features of socio-communicative problems in individuals with mental disorders. We propose that comprehensive models within and across the conventional cognition-emotion-language trichotomy need to be developed to integrate current findings and guide future research. In particular, there needs to be due emphasis on investigating multisensory and cross-modal effects in normal and pathological prosody research. Our review calls for multidisciplinary efforts to address the challenging issues to inform and inspire the advancement of linguistic theories and psychiatric diagnosis and treatment.

Keyword(s): affective prosody, mental disorders, pragmatic prosody, prosody production, prosody recognition, speech prosody
Loading

Article metrics loading...

/content/journals/10.1146/annurev-linguistics-030421-065139
2023-01-17
2024-04-25
Loading full text...

Full text loading...

/deliver/fulltext/linguistics/9/1/annurev-linguistics-030421-065139.html?itemId=/content/journals/10.1146/annurev-linguistics-030421-065139&mimeType=html&fmt=ahah

Literature Cited

  1. Alghowinem S, Goecke R, Wagner M, Epps J, Hyett M et al. 2018. Multimodal depression detection: fusion analysis of paralinguistic, head pose and eye gaze behaviors. IEEE Trans. Affect. Comput. 9:478–90
     [Google Scholar]
  2. Alpert M, Pouget ER, Silva RR. 2001. Reflections of depression in acoustic measures of the patient's speech. J. Affect. Disord. 66:59–69
     [Google Scholar]
  3. Alpert M, Shaw RJ, Pouget ER, Lim KO. 2002. A comparison of clinical ratings with vocal acoustic measures of flat affect and alogia. J. Psychiatr. Res. 36:347–53
     [Google Scholar]
  4. American Psychiatric Association. 1994. Diagnostic and Statistical Manual of Mental Disorders, 4th Ed Washington, DC: Am. Psychiatr. Publ.
  5. Angeleri R, Bosco FM, Zettin M, Sacco K, Colle L, Bara BG. 2008. Communicative impairment in traumatic brain injury: a complete pragmatic assessment. Brain Lang. 107:229–45
     [Google Scholar]
  6. Aziz-Zadeh L, Sheng T, Gheytanchi A. 2010. Common premotor regions for the perception and production of prosody and correlations with empathy and prosodic ability. PLOS ONE 5:e8759
     [Google Scholar]
  7. Bambini V, Arcara G, Bechi M, Buonocore M, Cavallaro R, Bosia M. 2016. The communicative impairment as a core feature of schizophrenia: frequency of pragmatic deficit, cognitive substrates, and relation with quality of life. Compr. Psychiatry 71:106–20
     [Google Scholar]
  8. Banse R, Scherer KR. 1996. Acoustic profiles in vocal emotion expression. J. Personal. Soc. Psychol. 70:614–36
     [Google Scholar]
  9. Baron-Cohen S. 1995. Mindblindness: An Essay on Autism and Theory of Mind Cambridge, MA: MIT Press
  10. Barrett LF, Lindquist KA, Gendron M. 2007. Language as context for the perception of emotion. Trends Cogn. Sci. 11:327–32
     [Google Scholar]
  11. Baxter AJ, Brugha TS, Erskine HE, Scheurer RW, Vos T, Scott JG. 2015. The epidemiology and global burden of autism spectrum disorders. Psychol. Med. 45:601–13
     [Google Scholar]
  12. Becker JT, Boller F, Lopez OL, Saxton J, McGonigle KL. 1994. The natural history of Alzheimer's disease. Description of study cohort and accuracy of diagnosis. Arch. Neurol. 51:585–94
     [Google Scholar]
  13. Belyk M, Brown S. 2014. Perception of affective and linguistic prosody: an ALE meta-analysis of neuroimaging studies. Soc. Cogn. Affect. Neurosci. 9:1395–403
     [Google Scholar]
  14. Benedetti V, Weill-Chounlamountry A, Pradat-Diehl P, Villain M. 2021. Assessment tools and rehabilitation treatments for aprosodia following acquired brain injury: a scoping review. Int. J. Lang. Commun. Dis. 57:474–96
     [Google Scholar]
  15. Bolinger D. 1989. Intonation and Its Uses: Melody in Grammar and Discourse Stanford, CA: Stanford Univ. Press
  16. Bowers D, Blonder L, Heilman K. 1998. Florida affect battery Manual, Cent. Neuropsychol. Stud., Dep. Neurol., Univ. Fla.
  17. Brooks JA, Shablack H, Gendron M, Satpute AB, Parrish MH, Lindquist KA. 2017. The role of language in the experience and perception of emotion: a neuroimaging meta-analysis. Soc. Cogn. Affect. Neurosci. 12:169–83
     [Google Scholar]
  18. Bryant GA. 2021. The evolution of human vocal emotion. Emot. Rev. 13:25–33
     [Google Scholar]
  19. Bucks RS, Radford SA. 2004. Emotion processing in Alzheimer's disease. Aging Ment. Health 8:222–32
     [Google Scholar]
  20. Cancelliere AE, Kertesz A. 1990. Lesion localization in acquired deficits of emotional expression and comprehension. Brain Cogn. 13:133–47
     [Google Scholar]
  21. Carvalho AF, Solmi M, Sanches M, Machado MO, Stubbs B et al. 2020. Evidence-based umbrella review of 162 peripheral biomarkers for major mental disorders. Transl. Psychiatry 10:152
     [Google Scholar]
  22. Chen F, Zhang H, Ding HW, Wang SP, Peng G, Zhang Y. 2021. Neural coding of formant-exaggerated speech and nonspeech in children with and without autism spectrum disorders. Autism Res. 14:1357–74
     [Google Scholar]
  23. Chevallier C, Noveck I, Happé F, Wilson D 2011. What's in a voice? Prosody as a test case for the Theory of Mind account of autism. Neuropsychologia 49:507–17
     [Google Scholar]
  24. Chien PJ, Friederici AD, Hartwigsen G, Sammler D. 2021. Intonation processing increases task-specific fronto-temporal connectivity in tonal language speakers. Hum. Brain Mapp. 42:161–74
     [Google Scholar]
  25. Chrabaszcz A, Neumann W-J, Stretcu O, Lipski WJ, Bush A et al. 2019. Subthalamic nucleus and sensorimotor cortex activity during speech production. J. Neurosci. 39:2698–708
     [Google Scholar]
  26. Cohen AS, Alpert M, Nienow TM, Dinzeo TJ, Docherty NM. 2008. Computerized measurement of negative symptoms in schizophrenia. J. Psychiatr. Res. 42:827–36
     [Google Scholar]
  27. Covington MA, He CZ, Brown C, Naci L, McClain JT et al. 2005. Schizophrenia and the structure of language: the linguist's view. Schizophr. Res. 77:85–98
     [Google Scholar]
  28. Crystal D. 1986. Prosodic development. Language Acquisition P Fletcher, M Garman 33–48 Cambridge, UK: Cambridge Univ. Press
     [Google Scholar]
  29. Cummins N, Scherer S, Krajewski J, Schnieder S, Epps J, Quatieri TF. 2015. A review of depression and suicide risk assessment using speech analysis. Speech Commun. 71:10–49
     [Google Scholar]
  30. Cutler A, Dahan D, van Donselaar W. 1997. Prosody in the comprehension of spoken language: a literature review. Lang. Speech 40:141–201
     [Google Scholar]
  31. Cutler A, Pearson M. 2018. On the analysis of prosodic turn-taking cues. Intonation in Discourse C Johns-Lewis 139–55 Abingdon, UK: Routledge
     [Google Scholar]
  32. Deliens G, Papastamou F, Ruytenbeek N, Geelhand P, Kissine M. 2018. Selective pragmatic impairment in autism spectrum disorder: indirect requests versus irony. J. Autism Dev. Disord. 48:2938–52
     [Google Scholar]
  33. Diehl JJ, Paul R. 2013. Acoustic and perceptual measurements of prosody production on the profiling elements of prosodic systems in children by children with autism spectrum disorders. Appl. Psycholinguist. 34:135–61
     [Google Scholar]
  34. Edwards J, Jackson HJ, Pattison PE. 2002. Emotion recognition via facial expression and affective prosody in schizophrenia: a methodological review. Clin. Psychol. Rev. 22:789–832
     [Google Scholar]
  35. Ekman P. 1992. An argument for basic emotions. Cogn. Emot. 6:169–200
     [Google Scholar]
  36. Emerson CS, Harrison DW, Everhart DE. 1999. Investigation of receptive affective prosodic ability in school-aged boys with and without depression. Neuropsychiatry Neuropsychol. Behav. Neurol. 12:102–9
     [Google Scholar]
  37. Fairbanks G, Pronovost W. 1938. Vocal pitch during simulated emotion. Science 88:382–83
     [Google Scholar]
  38. Filipe MG, Frota S, Castro SL, Vicente SG. 2014. Atypical prosody in Asperger syndrome: perceptual and acoustic measurements. J. Autism Dev. Disord. 44:1972–81
     [Google Scholar]
  39. Filipe MG, Watson L, Vicente SG, Frota S. 2018. Atypical preference for infant-directed speech as an early marker of autism spectrum disorders? A literature review and directions for further research. Clin. Linguist. Phon. 32:213–31
     [Google Scholar]
  40. Fine J, Bartolucci G, Ginsberg G, Szatmari P. 1991. The use of intonation to communicate in pervasive developmental disorders. J. Child Psychol. Psychiatry 32:771–82
     [Google Scholar]
  41. Franich K, Wong HY, Yu ACL, To CKS. 2021. Temporal coordination and prosodic structure in autism spectrum disorder: timing across speech and non-speech motor domains. J. Autism Dev. Disord. 51:2929–49
     [Google Scholar]
  42. Friederici AD, Alter K. 2004. Lateralization of auditory language functions: a dynamic dual pathway model. Brain Lang. 89:267–76
     [Google Scholar]
  43. Froming K, Levy M, Schaffer S, Ekman P. 2022. The Comprehensive Affect Testing System https://www.millisecond.com/download/library/cats
  44. Frühholz S, Gschwind M, Grandjean D. 2015. Bilateral dorsal and ventral fiber pathways for the processing of affective prosody identified by probabilistic fiber tracking. Neuroimage 109:27–34
     [Google Scholar]
  45. Fusaroli R, Lambrechts A, Bang D, Bowler DM, Gaigg SB. 2017. Is voice a marker for autism spectrum disorder? A systematic review and meta-analysis. Autism Res. 10:384–407
     [Google Scholar]
  46. Gandour J, Tong YX, Wong D, Talavage T, Dzemidzic M et al. 2004. Hemispheric roles in the perception of speech prosody. Neuroimage 23:344–57
     [Google Scholar]
  47. Globerson E, Amir N, Kishon-Rabin L, Golan O. 2015. Prosody recognition in adults with high-functioning autism spectrum disorders: from psychoacoustics to cognition. Autism Res. 8:153–63
     [Google Scholar]
  48. Golan O, Baron-Cohen S, Hill J. 2006. The Cambridge Mindreading (CAM) Face-Voice Battery: testing complex emotion recognition in adults with and without Asperger syndrome. J. Autism Dev. Disord. 36:169–83
     [Google Scholar]
  49. Golfinopoulos E, Tourville JA, Guenther FH. 2010. The integration of large-scale neural network modeling and functional brain imaging in speech motor control. Neuroimage 52:862–74
     [Google Scholar]
  50. Grandjean D. 2021. Brain networks of emotional prosody processing. Emot. Rev. 13:34–43
     [Google Scholar]
  51. Grossman RB, Bemis RH, Skwerer DP, Tager-Flusberg H. 2010. Lexical and affective prosody in children with high-functioning autism. J. Speech Lang. Hear. Res. 53:778–93
     [Google Scholar]
  52. Haider F, de la Fuente S, Luz S 2020. An assessment of paralinguistic acoustic features for detection of Alzheimer's dementia in spontaneous speech. IEEE J. Sel. Top. Signal Process. 14:272–81
     [Google Scholar]
  53. Hampel H, Hardy J, Blennow K, Chen C, Perry G et al. 2021. The amyloid-beta pathway in Alzheimer's disease. Mol. Psychiatry 26:5481–503
     [Google Scholar]
  54. Hirschberg J, Hjalmarsson A, Elhadad N 2010.. “ You're as sick as you sound”: using computational approaches for modeling speaker state to gauge illness and recovery. Advances in Speech Recognition A Neustein 305–22 Boston: Springer
     [Google Scholar]
  55. Hoekert M, Kahn RS, Pijnenborg M, Aleman A. 2007. Impaired recognition and expression of emotional prosody in schizophrenia: review and meta-analysis. Schizophr. Res. 96:135–45
     [Google Scholar]
  56. Hoemann K, Barrett LF. 2019. Concepts dissolve artificial boundaries in the study of emotion and cognition, uniting body, brain, and mind. Cogn. Emot. 33:67–76
     [Google Scholar]
  57. Horley K, Reid A, Burnham D 2010. Emotional prosody perception and production in dementia of the Alzheimer's type. J. Speech Lang. Hear. Res. 53:1132–46
     [Google Scholar]
  58. Hubbard DJ, Faso DJ, Assmann PF, Sasson NJ. 2017. Production and perception of emotional prosody by adults with autism spectrum disorder. Autism Res. 10:1991–2001
     [Google Scholar]
  59. Icht M, Zukerman G, Ben-Itzchak E, Ben-David BM. 2021. Keep it simple: identification of basic versus complex emotions in spoken language in individuals with autism spectrum disorder without intellectual disability: a meta-analysis study. Autism Res. 14:1948–64
     [Google Scholar]
  60. Insel TR. 2018. Digital phenotyping: a global tool for psychiatry. World Psychiatry 17:276–77
     [Google Scholar]
  61. Irvine CA, Eigsti IM, Fein DA. 2016. Uh, um, and autism: filler disfluencies as pragmatic markers in adolescents with optimal outcomes from autism spectrum disorder. J. Autism Dev. Disord. 46:1061–70
     [Google Scholar]
  62. Ivanova O, Meilán JJG, Martínez-Sánchez F, Martínez-Nicolás I, Llorente TE, González NC. 2022. Discriminating speech traits of Alzheimer's disease assessed through a corpus of reading task for Spanish language. Comput. Speech Lang. 73:101341
     [Google Scholar]
  63. Jahshan C, Wynn JK, Green MF. 2013. Relationship between auditory processing and affective prosody in schizophrenia. Schizophr. Res. 143:348–53
     [Google Scholar]
  64. Jarvinen-Pasley A, Peppe S, King-Smith G, Heaton P. 2008. The relationship between form and function level receptive prosodic abilities in autism. J. Autism Dev. Disord. 38:1328–40
     [Google Scholar]
  65. Jiang X, Gossack-Keenan K, Pell MD. 2020. To believe or not to believe? How voice and accent information in speech alter listener impressions of trust. Q. J. Exp. Psychol. 73:55–79
     [Google Scholar]
  66. Joanette Y, Ska B, Côté H. 2004. Protocole Montréal d'évaluation de la communication Tool, IUGM Montreal: https://criugm.qc.ca/outils/protocole-montreal-devaluation-mec/
  67. Jones CRG, Pickles A, Falcaro M, Marsden AJS, Happe F et al. 2011. A multimodal approach to emotion recognition ability in autism spectrum disorders. J. Child Psychol. Psychiatry 52:275–85
     [Google Scholar]
  68. Keough M, Derrick D, Gick B. 2019. Cross-modal effects in speech perception. Annu. Rev. Linguist. 5:49–66
     [Google Scholar]
  69. Key AP, Slaboch KD. 2021. Speech processing in autism spectrum disorder: an integrative review of auditory neurophysiology findings. J. Speech Lang. Hear. Res. 64:4192–212
     [Google Scholar]
  70. Klein-Koerkamp Y, Beaudoin M, Baciu M, Hot P. 2012. Emotional decoding abilities in Alzheimer's disease: a meta-analysis. J. Alzheimer's Dis. 32:109–25
     [Google Scholar]
  71. Koff E, Zaitchik D, Montepare J, Albert MS. 1999. Emotion processing in the visual and auditory domains by patients with Alzheimer's disease. J. Int. Neuropsychol. Soc. 5:32–40
     [Google Scholar]
  72. Kotz SA, Meyer M, Alter K, Besson M, von Cramon DY, Friederici AD. 2003. On the lateralization of emotional prosody: an event-related functional MR investigation. Brain Lang. 86:366–76
     [Google Scholar]
  73. Kroger BJ, Kannampuzha J, Neuschaefer-Rube C. 2009. Towards a neurocomputational model of speech production and perception. Speech Commun. 51:793–809
     [Google Scholar]
  74. Ladd DR. 2008. Intonational Phonology Cambridge, UK: Cambridge Univ. Press
  75. Ladd DR Jr. 1980. The Structure of Intonational Meaning: Evidence from English Bloomington, IN: Indiana Univ. Press
  76. Lartseva A, Dijkstra T, Buitelaar JK. 2015. Emotional language processing in autism spectrum disorders: a systematic review. Front. Hum. Neurosci. 8:991
     [Google Scholar]
  77. Leitman DI, Hoptman MJ, Foxe JJ, Saccente E, Wylie GR et al. 2007. The neural substrates of impaired prosodic detection in schizophrenia and its sensorial antecedents. Am. J. Psychiatry 164:474–82
     [Google Scholar]
  78. Leitman DI, Ziwich R, Pasternak R, Javitt DC. 2006. Theory of Mind (ToM) and counterfactuality deficits in schizophrenia: misperception or misinterpretation?. Psychol. Med. 36:1075–83
     [Google Scholar]
  79. Li YN, Tang C, Lu JF, Wu JS, Chang EF. 2021. Human cortical encoding of pitch in tonal and non-tonal languages. Nat. Commun. 12:1161
     [Google Scholar]
  80. Liberman MY. 2019. Corpus phonetics. Annu. Rev. Linguist. 5:91–107
     [Google Scholar]
  81. Liebenthal E, Silbersweig DA, Stern E. 2016. The language, tone and prosody of emotions: neural substrates and dynamics of spoken-word emotion perception. Front. Neurosci. 10:506
     [Google Scholar]
  82. Lin Y, Ding H, Zhang Y. 2018. Emotional prosody processing in schizophrenic patients: a selective review and meta-analysis. J. Clin. Med. 7:363
     [Google Scholar]
  83. Lin Y, Ding H, Zhang Y. 2020. Multisensory integration of emotion in schizophrenic patients. Multisens. Res. 33:865–901
     [Google Scholar]
  84. Loveall SJ, Hawthorne K, Gaines M. 2021. A meta-analysis of prosody in autism, Williams syndrome, and Down syndrome. J. Commun. Disord. 89:106055
     [Google Scholar]
  85. Low DM, Bentley KH, Ghosh SS. 2020. Automated assessment of psychiatric disorders using speech: a systematic review. Laryngoscope Investig. Otolaryngol. 5:96–116
     [Google Scholar]
  86. Lucarini V, Grice M, Cangemi F, Zimmermann JT, Marchesi C et al. 2020. Speech prosody as a bridge between psychopathology and linguistics: the case of the schizophrenia spectrum. Front. Psychiatry 11:531863
     [Google Scholar]
  87. MacWhinney B 2007. The Talkbank Project. Creating and Digitizing Language Corpora, Vol. 1 Synchronic Databases JC Beal, KP Corrigan, HL Moisl 163–80 London: Palgrave Macmillan
     [Google Scholar]
  88. Martin I, McDonald S. 2003. Weak coherence, no theory of mind, or executive dysfunction? Solving the puzzle of pragmatic language disorders. Brain Lang. 85:451–66
     [Google Scholar]
  89. McCann J, Peppe S. 2003. Prosody in autism spectrum disorders: a critical review. Int. J. Lang. Commun. Dis. 38:325–50
     [Google Scholar]
  90. McCann J, Peppe S, Gibbon FE, O'Hare A, Rutherford M 2007. Prosody and its relationship to language in school-aged children with high-functioning autism. Int. J. Lang. Commun. Dis. 42:682–702
     [Google Scholar]
  91. McCutcheon RA, Reis Marques T, Howes OD 2020. Schizophrenia: an overview. JAMA Psychiatry 77:201–10
     [Google Scholar]
  92. McGregor KK, Hadden RR. 2020. Brief report: “Um” fillers distinguish children with and without ASD. J. Autism Dev. Disord. 50:1816–21
     [Google Scholar]
  93. Meilan JJG, Martinez-Sanchez F, Carro J, Lopez DE, Millian-Morell L, Arana JM. 2014. Speech in Alzheimer's disease: Can temporal and acoustic parameters discriminate dementia?. Dement. Geriatr. Cogn. Disord. 37:327–34
     [Google Scholar]
  94. Miller HE, Guenther FH. 2021. Modelling speech motor programming and apraxia of speech in the DIVA/GODIVA neurocomputational framework. Aphasiology 35:424–41
     [Google Scholar]
  95. Mitchell RLC, Crow TJ. 2005. Right hemisphere language functions and schizophrenia: the forgotten hemisphere?. Brain 128:963–78
     [Google Scholar]
  96. Mitchell RLC, Ross ED. 2013. Attitudinal prosody: what we know and directions for future study. Neurosci. Biobehav. Rev. 37:471–79
     [Google Scholar]
  97. Monrad-Krohn GH. 1947. The prosodic quality of speech and its disorders. Acta Psychiatr. Scand. 22:255–69
     [Google Scholar]
  98. Moore E II, Clements MA, Peifer JW, Weisser L 2008. Critical analysis of the impact of glottal features in the classification of clinical depression in speech. IEEE Trans. Biomed. Eng. 55:96–107
     [Google Scholar]
  99. Mundt JC, Vogel AP, Feltner DE, Lenderking WR. 2012. Vocal acoustic biomarkers of depression severity and treatment response. Biol. Psychiatry 72:580–87
     [Google Scholar]
  100. Murphy D, Cutting J. 1990. Prosodic comprehension and expression in schizophrenia. J. Neurol. Neurosurg. Psychiatry 53:727–30
     [Google Scholar]
  101. Nadig A, Shaw H. 2012. Acoustic and perceptual measurement of expressive prosody in high-functioning autism: increased pitch range and what it means to listeners. J. Autism Dev. Disord. 42:499–511
     [Google Scholar]
  102. O'Connor K. 2012. Auditory processing in autism spectrum disorder: a review. Neurosci. Biobehav. Rev. 36:836–54
     [Google Scholar]
  103. Oh C, Morris RJ, Wang X. 2021. A systematic review of expressive and receptive prosody in people with dementia. J. Speech Lang. Hear. Res. 64:3803–25
     [Google Scholar]
  104. Parola A, Gabbatore I, Berardinelli L, Salvini R, Bosco FM. 2021. Multimodal assessment of communicative-pragmatic features in schizophrenia: a machine learning approach. NPJ Schizophr. 7:28
     [Google Scholar]
  105. Pastoriza-Domínguez P, Torre IG, Diéguez-Vide F, Gómez-Ruiz I, Geladó S et al. 2022. Speech pause distribution as an early marker for Alzheimer's disease. Speech Commun. 136:107–17
     [Google Scholar]
  106. Patel SP, Kim JH, Larson CR, Losh M. 2019. Mechanisms of voice control related to prosody in autism spectrum disorder and first-degree relatives. Autism Res. 12:1192–210
     [Google Scholar]
  107. Paul R, Augustyn A, Klin A, Volkmar FR. 2005. Perception and production of prosody by speakers with autism spectrum disorders. J. Autism Dev. Disord. 35:205–20
     [Google Scholar]
  108. Pawełczyk A, Łojek E, Żurner N, Gawłowska-Sawosz M, Pawełczyk T. 2018. Higher-order language dysfunctions as a possible neurolinguistic endophenotype for schizophrenia: evidence from patients and their unaffected first degree relatives. Psychiatry Res. 267:63–72
     [Google Scholar]
  109. Pell MD. 2006. Judging emotion and attitudes from prosody following brain damage. Prog. Brain Res. 156:303–17
     [Google Scholar]
  110. Pell MD, Jaywant A, Monetta L, Kotz SA. 2011. Emotional speech processing: disentangling the effects of prosody and semantic cues. Cogn. Emot. 25:834–53
     [Google Scholar]
  111. Pell MD, Paulmann S, Dara C, Alasseri A, Kotz SA. 2009. Factors in the recognition of vocally expressed emotions: a comparison of four languages. J. Phon. 37:417–35
     [Google Scholar]
  112. Pierrehumbert JB, Hirschberg J 1990. The meaning of intonational contours in the interpretation of discourse. Intentions in Communication P Cohen, J Morgan, M Pollack 271–311 Cambridge, MA: MIT Press
     [Google Scholar]
  113. Pisanski K, Cartei V, McGettigan C, Raine J, Reby D 2016. Voice modulation: a window into the origins of human vocal control?. Trends Cogn. Sci. 20:304–18
     [Google Scholar]
  114. Putnam KM, Kring AM. 2007. Accuracy and intensity of posed emotional expressions in unmedicated schizophrenia patients: vocal and facial channels. Psychiatry Res. 151:67–76
     [Google Scholar]
  115. Razafimandimby A, Herve PY, Marzloff V, Brazo P, Tzourio-Mazoyer N, Dollfus S. 2016. Functional deficit of the medial prefrontal cortex during emotional sentence attribution in schizophrenia. Schizophr. Res. 178:86–93
     [Google Scholar]
  116. Robin J, Harrison JE, Kaufman LD, Rudzicz F, Simpson W, Yancheva M. 2020. Evaluation of speech-based digital biomarkers: review and recommendations. Digit. Biomark. 4:99–108
     [Google Scholar]
  117. Ross ED. 2021. Differential hemispheric lateralization of emotions and related display behaviors: emotion-type hypothesis. Brain Sci. 11:1034
     [Google Scholar]
  118. Ross ED, Thompson RD, Yenkosky J. 1997. Lateralization of affective prosody in brain and the callosal integration of hemispheric language functions. Brain Lang. 56:27–54
     [Google Scholar]
  119. Rutherford MD, Baron-Cohen S, Wheelwright S. 2002. Reading the mind in the voice: a study with normal adults and adults with Asperger syndrome and high functioning autism. J. Autism Dev. Disord. 32:189–94
     [Google Scholar]
  120. Sammler D, Grosbras MH, Anwander A, Bestelmeyer PEG, Belin P. 2015. Dorsal and ventral pathways for prosody. Curr. Biol. 25:3079–85
     [Google Scholar]
  121. Schirmer A, Kotz SA. 2006. Beyond the right hemisphere: brain mechanisms mediating vocal emotional processing. Trends Cogn. Sci. 10:24–30
     [Google Scholar]
  122. Schreibman L, Dawson G, Stahmer AC, Landa R, Rogers SJ et al. 2015. Naturalistic developmental behavioral interventions: empirically validated treatments for autism spectrum disorder. J. Autism Dev. Disord. 45:2411–28
     [Google Scholar]
  123. Schurz M, Radua J, Tholen MG, Maliske L, Margulies DS et al. 2021. Toward a hierarchical model of social cognition: a neuroimaging meta-analysis and integrative review of empathy and theory of mind. Psychol. Bull. 147:293–327
     [Google Scholar]
  124. Science. 2021. 125 questions: exploration and discovery Booklet Science Washington, DC:
  125. Sharda M, Subhadra TP, Sahay S, Nagaraja C, Singh L et al. 2010. Sounds of melody-pitch patterns of speech in autism. Neurosci. Lett. 478:42–45
     [Google Scholar]
  126. Shriberg LD, Paul R, McSweeny JL, Klin A, Cohen DJ, Volkmar FR. 2001. Speech and prosody characteristics of adolescents and adults with high-functioning autism and Asperger syndrome. J. Speech Lang. Hear. Res. 44:1097–115
     [Google Scholar]
  127. Taler V, Chertkow H, Baum SR, Saumier D. 2008. Comprehension of grammatical and emotional prosody is impaired in Alzheimer's disease. Neuropsychology 22:188–95
     [Google Scholar]
  128. Tang E, Zhang M, Chen Y, Lin Y, Ding H. 2022. Recognition of affective prosody in bipolar and depressive conditions: a systematic review and meta-analysis. J. Affect. Disord. 313:126–36
     [Google Scholar]
  129. Tang SX, Kriz R, Cho S, Park SJ, Harowitz J et al. 2021. Natural language processing methods are sensitive to sub-clinical linguistic differences in schizophrenia spectrum disorders. NPJ Schizophr. 7:25
     [Google Scholar]
  130. Thaler NS, Strauss GP, Sutton GP, Vertinski M, Ringdahl EN et al. 2013. Emotion perception abnormalities across sensory modalities in bipolar disorder with psychotic features and schizophrenia. Schizophr. Res. 147:287–92
     [Google Scholar]
  131. Thurber C, Tager-Flusberg H. 1993. Pauses in the narratives produced by autistic, mentally retarded, and normal children as an index of cognitive demand. J. Autism Dev. Disord. 23:309–22
     [Google Scholar]
  132. Uekermann J, Abdel-Hamid M, Lehmkaemper C, Vollmoeller W, Daum I 2008. Perception of affective prosody in major depression: a link to executive functions?. J. Int. Neuropsychol. Soc. 14:552–61
     [Google Scholar]
  133. Van Rheenen TE, Rossell SL. 2013. Is the non-verbal behavioural emotion-processing profile of bipolar disorder impaired? A critical review. Acta Psychiatr. Scand. 128:163–78
     [Google Scholar]
  134. Wang AT, Lee SS, Sigman M, Dapretto M. 2006. Neural basis of irony comprehension in children with autism: the role of prosody and context. Brain 129:932–43
     [Google Scholar]
  135. Ward N. 2006. Non-lexical conversational sounds in American English. Pragmat. Cogn. 14:129–82
     [Google Scholar]
  136. Wichmann A. 2002. Attitudinal intonation and the inferential process Presented at International Conference on Speech Prosody Aix-en-Provence, Fr.: April 11–13
  137. World Health Organization. 2022. Mental disorders Fact Sheet, World Health Organization https://www.who.int/news-room/fact-sheets/detail/mental-disorders
  138. Wu TC, Jia XQ, Shi HF, Niu JQ, Yin XH et al. 2021. Prevalence of mental health problems during the COVID-19 pandemic: a systematic review and meta-analysis. J. Affect. Disord. 281:91–98
     [Google Scholar]
  139. Yang Y, Fairbairn C, Cohn JF. 2013. Detecting depression severity from vocal prosody. IEEE Trans. Affect. Comput. 4:142–50
     [Google Scholar]
  140. Yu LD, Fan YB, Deng ZZ, Huang D, Wang SP, Zhang Y. 2015. Pitch processing in tonal-language-speaking children with autism: an event-related potential study. J. Autism Dev. Disord. 45:3656–67
     [Google Scholar]
  141. Yu LD, Huang D, Wang SP, Zhang Y. 2022. Reduced neural specialization for word-level linguistic prosody in children with autism. J. Autism Dev. Disord. https://doi.org/10.1007/s10803-022-05720-x
    [Google Scholar]
  142. Yuan JH, Cai XY, Bian YC, Ye Z, Church K. 2021. Pauses for detection of Alzheimer's disease. Front. Comput. Sci. 2:624624488
     [Google Scholar]
  143. Zhang M, Chen Y, Lin Y, Ding H, Zhang Y. 2022. Multi-channel perception of emotion in speech, voice, facial expression and gesture in individuals with autism: a scoping review. J. Speech Lang. Hear. Res. 65:1435–49
     [Google Scholar]
  144. Zhang M, Xu S, Chen Y, Lin Y, Ding H, Zhang Y. 2021. Recognition of affective prosody in autism spectrum conditions: a systematic review and meta-analysis. Autism 26:798–813
     [Google Scholar]
  145. Zurlo MC, Ruggiero M. 2021. Assessing pragmatic language skills in adults with major depressive disorder: an exploratory study. Psychopathology 54:78–91
     [Google Scholar]
/content/journals/10.1146/annurev-linguistics-030421-065139
Loading
  • Article Type: Review Article

Most Cited Most Cited RSS feed

This is a required field
Please enter a valid email address
Approval was a Success
Invalid data
An Error Occurred
Approval was partially successful, following selected items could not be processed due to error