A cross-linguistic fMRI study of perception of intonation and emotion in Chinese

Jack Gandour, Donald Wong, Mario Dzemidzic, Mark Lowe, Yunxia Tong, Xiaojian Li

Research output: Contribution to journalArticle

60 Citations (Scopus)

Abstract

Conflicting data from neurobehavioral studies of the perception of intonation (linguistic) and emotion (affective) in spoken language highlight the need to further examine how functional attributes of prosodic stimuli are related to hemispheric differences in processing capacity. Because of similarities in their acoustic profiles, intonation and emotion permit us to assess to what extent hemispheric lateralization of speech prosody depends on functional instead of acoustical properties. To examine how the brain processes linguistic and affective prosody, an fMRI study was conducted using Chinese, a tone language in which both intonation and emotion may be signaled prosodically, in addition to lexical tones. Ten Chinese and 10 English subjects were asked to perform discrimination judgments of intonation (I: statement, question) and emotion (E: happy, angry, sad) presented in semantically neutral Chinese sentences. A baseline task required passive listening to the same speech stimuli (S). In direct between-group comparisons, the Chinese group showed left-sided frontoparietal activation for both intonation (I vs. S) and emotion (E vs. S) relative to baseline. When comparing intonation relative to emotion (I vs. E), the Chinese group demonstrated prefrontal activation bilaterally; parietal activation in the left hemisphere only. The reverse comparison (E vs. I), on the other hand, revealed that activation occurred in anterior and posterior prefrontal regions of the right hemisphere only. These findings show that some aspects of perceptual processing of emotion are dissociable from intonation, and, moreover, that they are mediated by the right hemisphere.

Original languageEnglish
Pages (from-to)149-157
Number of pages9
JournalHuman Brain Mapping
Volume18
Issue number3
DOIs
StatePublished - Mar 2003

Fingerprint

Linguistics
Emotions
Magnetic Resonance Imaging
Language
Acoustics
Brain

Keywords

  • Functional magnetic resonance imaging
  • Human auditory processing
  • Language
  • Pitch
  • Selective attention
  • Speech perception
  • Suprasegmental

ASJC Scopus subject areas

  • Clinical Neurology
  • Neuroscience(all)
  • Radiological and Ultrasound Technology

Cite this

A cross-linguistic fMRI study of perception of intonation and emotion in Chinese. / Gandour, Jack; Wong, Donald; Dzemidzic, Mario; Lowe, Mark; Tong, Yunxia; Li, Xiaojian.

In: Human Brain Mapping, Vol. 18, No. 3, 03.2003, p. 149-157.

Research output: Contribution to journalArticle

Gandour, Jack ; Wong, Donald ; Dzemidzic, Mario ; Lowe, Mark ; Tong, Yunxia ; Li, Xiaojian. / A cross-linguistic fMRI study of perception of intonation and emotion in Chinese. In: Human Brain Mapping. 2003 ; Vol. 18, No. 3. pp. 149-157.
@article{9ff73257cccf4e6a91146b0bdadf752c,
title = "A cross-linguistic fMRI study of perception of intonation and emotion in Chinese",
abstract = "Conflicting data from neurobehavioral studies of the perception of intonation (linguistic) and emotion (affective) in spoken language highlight the need to further examine how functional attributes of prosodic stimuli are related to hemispheric differences in processing capacity. Because of similarities in their acoustic profiles, intonation and emotion permit us to assess to what extent hemispheric lateralization of speech prosody depends on functional instead of acoustical properties. To examine how the brain processes linguistic and affective prosody, an fMRI study was conducted using Chinese, a tone language in which both intonation and emotion may be signaled prosodically, in addition to lexical tones. Ten Chinese and 10 English subjects were asked to perform discrimination judgments of intonation (I: statement, question) and emotion (E: happy, angry, sad) presented in semantically neutral Chinese sentences. A baseline task required passive listening to the same speech stimuli (S). In direct between-group comparisons, the Chinese group showed left-sided frontoparietal activation for both intonation (I vs. S) and emotion (E vs. S) relative to baseline. When comparing intonation relative to emotion (I vs. E), the Chinese group demonstrated prefrontal activation bilaterally; parietal activation in the left hemisphere only. The reverse comparison (E vs. I), on the other hand, revealed that activation occurred in anterior and posterior prefrontal regions of the right hemisphere only. These findings show that some aspects of perceptual processing of emotion are dissociable from intonation, and, moreover, that they are mediated by the right hemisphere.",
keywords = "Functional magnetic resonance imaging, Human auditory processing, Language, Pitch, Selective attention, Speech perception, Suprasegmental",
author = "Jack Gandour and Donald Wong and Mario Dzemidzic and Mark Lowe and Yunxia Tong and Xiaojian Li",
year = "2003",
month = "3",
doi = "10.1002/hbm.10088",
language = "English",
volume = "18",
pages = "149--157",
journal = "Human Brain Mapping",
issn = "1065-9471",
publisher = "Wiley-Liss Inc.",
number = "3",

}

TY - JOUR

T1 - A cross-linguistic fMRI study of perception of intonation and emotion in Chinese

AU - Gandour, Jack

AU - Wong, Donald

AU - Dzemidzic, Mario

AU - Lowe, Mark

AU - Tong, Yunxia

AU - Li, Xiaojian

PY - 2003/3

Y1 - 2003/3

N2 - Conflicting data from neurobehavioral studies of the perception of intonation (linguistic) and emotion (affective) in spoken language highlight the need to further examine how functional attributes of prosodic stimuli are related to hemispheric differences in processing capacity. Because of similarities in their acoustic profiles, intonation and emotion permit us to assess to what extent hemispheric lateralization of speech prosody depends on functional instead of acoustical properties. To examine how the brain processes linguistic and affective prosody, an fMRI study was conducted using Chinese, a tone language in which both intonation and emotion may be signaled prosodically, in addition to lexical tones. Ten Chinese and 10 English subjects were asked to perform discrimination judgments of intonation (I: statement, question) and emotion (E: happy, angry, sad) presented in semantically neutral Chinese sentences. A baseline task required passive listening to the same speech stimuli (S). In direct between-group comparisons, the Chinese group showed left-sided frontoparietal activation for both intonation (I vs. S) and emotion (E vs. S) relative to baseline. When comparing intonation relative to emotion (I vs. E), the Chinese group demonstrated prefrontal activation bilaterally; parietal activation in the left hemisphere only. The reverse comparison (E vs. I), on the other hand, revealed that activation occurred in anterior and posterior prefrontal regions of the right hemisphere only. These findings show that some aspects of perceptual processing of emotion are dissociable from intonation, and, moreover, that they are mediated by the right hemisphere.

AB - Conflicting data from neurobehavioral studies of the perception of intonation (linguistic) and emotion (affective) in spoken language highlight the need to further examine how functional attributes of prosodic stimuli are related to hemispheric differences in processing capacity. Because of similarities in their acoustic profiles, intonation and emotion permit us to assess to what extent hemispheric lateralization of speech prosody depends on functional instead of acoustical properties. To examine how the brain processes linguistic and affective prosody, an fMRI study was conducted using Chinese, a tone language in which both intonation and emotion may be signaled prosodically, in addition to lexical tones. Ten Chinese and 10 English subjects were asked to perform discrimination judgments of intonation (I: statement, question) and emotion (E: happy, angry, sad) presented in semantically neutral Chinese sentences. A baseline task required passive listening to the same speech stimuli (S). In direct between-group comparisons, the Chinese group showed left-sided frontoparietal activation for both intonation (I vs. S) and emotion (E vs. S) relative to baseline. When comparing intonation relative to emotion (I vs. E), the Chinese group demonstrated prefrontal activation bilaterally; parietal activation in the left hemisphere only. The reverse comparison (E vs. I), on the other hand, revealed that activation occurred in anterior and posterior prefrontal regions of the right hemisphere only. These findings show that some aspects of perceptual processing of emotion are dissociable from intonation, and, moreover, that they are mediated by the right hemisphere.

KW - Functional magnetic resonance imaging

KW - Human auditory processing

KW - Language

KW - Pitch

KW - Selective attention

KW - Speech perception

KW - Suprasegmental

UR - http://www.scopus.com/inward/record.url?scp=0345700683&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0345700683&partnerID=8YFLogxK

U2 - 10.1002/hbm.10088

DO - 10.1002/hbm.10088

M3 - Article

VL - 18

SP - 149

EP - 157

JO - Human Brain Mapping

JF - Human Brain Mapping

SN - 1065-9471

IS - 3

ER -