Discrete neural substrates underlie complementary audiovisual speech integration processes

Ryan A. Stevenson, Ross M. VanDerKlok, David Pisoni, Thomas W. James

Research output: Contribution to journalArticle

65 Citations (Scopus)

Abstract

The ability to combine information from multiple sensory modalities into a single, unified percept is a key element in an organism's ability to interact with the external world. This process of perceptual fusion, the binding of multiple sensory inputs into a perceptual gestalt, is highly dependent on the temporal synchrony of the sensory inputs. Using fMRI, we identified two anatomically distinct brain regions in the superior temporal cortex, one involved with processing temporal-synchrony, and one with processing perceptual fusion of audiovisual speech. This dissociation suggests that the superior temporal cortex should be considered a "neuronal hub" composed of multiple discrete subregions that underlie an array of complementary low- and high-level multisensory integration processes. In this role, abnormalities in the structure and function of superior temporal cortex provide a possible common etiology for temporal-processing and perceptual-fusion deficits seen in a number of clinical populations, including individuals with autism spectrum disorder, dyslexia, and schizophrenia.

Original languageEnglish
Pages (from-to)1339-1345
Number of pages7
JournalNeuroImage
Volume55
Issue number3
DOIs
StatePublished - Apr 1 2011

Fingerprint

Temporal Lobe
Aptitude
Dissociative Disorders
Dyslexia
Schizophrenia
Magnetic Resonance Imaging
Brain
Population

Keywords

  • Autism
  • Dyslexia
  • FMRI
  • Multisensory integration
  • Schizophrenia
  • Speech perception
  • STS
  • Temporal processing

ASJC Scopus subject areas

  • Cognitive Neuroscience
  • Neurology

Cite this

Discrete neural substrates underlie complementary audiovisual speech integration processes. / Stevenson, Ryan A.; VanDerKlok, Ross M.; Pisoni, David; James, Thomas W.

In: NeuroImage, Vol. 55, No. 3, 01.04.2011, p. 1339-1345.

Research output: Contribution to journalArticle

Stevenson, Ryan A. ; VanDerKlok, Ross M. ; Pisoni, David ; James, Thomas W. / Discrete neural substrates underlie complementary audiovisual speech integration processes. In: NeuroImage. 2011 ; Vol. 55, No. 3. pp. 1339-1345.
@article{bbdbca5cfa7d4fa6aba3e9ac5e97743e,
title = "Discrete neural substrates underlie complementary audiovisual speech integration processes",
abstract = "The ability to combine information from multiple sensory modalities into a single, unified percept is a key element in an organism's ability to interact with the external world. This process of perceptual fusion, the binding of multiple sensory inputs into a perceptual gestalt, is highly dependent on the temporal synchrony of the sensory inputs. Using fMRI, we identified two anatomically distinct brain regions in the superior temporal cortex, one involved with processing temporal-synchrony, and one with processing perceptual fusion of audiovisual speech. This dissociation suggests that the superior temporal cortex should be considered a {"}neuronal hub{"} composed of multiple discrete subregions that underlie an array of complementary low- and high-level multisensory integration processes. In this role, abnormalities in the structure and function of superior temporal cortex provide a possible common etiology for temporal-processing and perceptual-fusion deficits seen in a number of clinical populations, including individuals with autism spectrum disorder, dyslexia, and schizophrenia.",
keywords = "Autism, Dyslexia, FMRI, Multisensory integration, Schizophrenia, Speech perception, STS, Temporal processing",
author = "Stevenson, {Ryan A.} and VanDerKlok, {Ross M.} and David Pisoni and James, {Thomas W.}",
year = "2011",
month = "4",
day = "1",
doi = "10.1016/j.neuroimage.2010.12.063",
language = "English",
volume = "55",
pages = "1339--1345",
journal = "NeuroImage",
issn = "1053-8119",
publisher = "Academic Press Inc.",
number = "3",

}

TY - JOUR

T1 - Discrete neural substrates underlie complementary audiovisual speech integration processes

AU - Stevenson, Ryan A.

AU - VanDerKlok, Ross M.

AU - Pisoni, David

AU - James, Thomas W.

PY - 2011/4/1

Y1 - 2011/4/1

N2 - The ability to combine information from multiple sensory modalities into a single, unified percept is a key element in an organism's ability to interact with the external world. This process of perceptual fusion, the binding of multiple sensory inputs into a perceptual gestalt, is highly dependent on the temporal synchrony of the sensory inputs. Using fMRI, we identified two anatomically distinct brain regions in the superior temporal cortex, one involved with processing temporal-synchrony, and one with processing perceptual fusion of audiovisual speech. This dissociation suggests that the superior temporal cortex should be considered a "neuronal hub" composed of multiple discrete subregions that underlie an array of complementary low- and high-level multisensory integration processes. In this role, abnormalities in the structure and function of superior temporal cortex provide a possible common etiology for temporal-processing and perceptual-fusion deficits seen in a number of clinical populations, including individuals with autism spectrum disorder, dyslexia, and schizophrenia.

AB - The ability to combine information from multiple sensory modalities into a single, unified percept is a key element in an organism's ability to interact with the external world. This process of perceptual fusion, the binding of multiple sensory inputs into a perceptual gestalt, is highly dependent on the temporal synchrony of the sensory inputs. Using fMRI, we identified two anatomically distinct brain regions in the superior temporal cortex, one involved with processing temporal-synchrony, and one with processing perceptual fusion of audiovisual speech. This dissociation suggests that the superior temporal cortex should be considered a "neuronal hub" composed of multiple discrete subregions that underlie an array of complementary low- and high-level multisensory integration processes. In this role, abnormalities in the structure and function of superior temporal cortex provide a possible common etiology for temporal-processing and perceptual-fusion deficits seen in a number of clinical populations, including individuals with autism spectrum disorder, dyslexia, and schizophrenia.

KW - Autism

KW - Dyslexia

KW - FMRI

KW - Multisensory integration

KW - Schizophrenia

KW - Speech perception

KW - STS

KW - Temporal processing

UR - http://www.scopus.com/inward/record.url?scp=79952071953&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=79952071953&partnerID=8YFLogxK

U2 - 10.1016/j.neuroimage.2010.12.063

DO - 10.1016/j.neuroimage.2010.12.063

M3 - Article

VL - 55

SP - 1339

EP - 1345

JO - NeuroImage

JF - NeuroImage

SN - 1053-8119

IS - 3

ER -