Auditory-visual speech perception and synchrony detection for speech and nonspeech signals

Brianna Conrey, David Pisoni

Research output: Contribution to journalArticle

90 Citations (Scopus)

Abstract

Previous research has identified a "synchrony window" of several hundred milliseconds over which auditory-visual (AV) asynchronies are not reliably perceived. Individual variability in the size of this AV synchrony window has been linked with variability in AV speech perception measures, but it was not clear whether AV speech perception measures are related to synchrony detection for speech only or for both speech and nonspeech signals. An experiment was conducted to investigate the relationship between measures of AV speech perception and AV synchrony detection for speech and nonspeech signals. Variability in AV synchrony detection for both speech and nonspeech signals was found to be related to variability in measures of auditory-only (A-only) and AV speech perception, suggesting that temporal processing for both speech and nonspeech signals must be taken into account in explaining variability in A-only and multisensory speech perception.

Original languageEnglish
Pages (from-to)4065-4073
Number of pages9
JournalJournal of the Acoustical Society of America
Volume119
Issue number6
DOIs
StatePublished - Jun 2006

Fingerprint

Speech Perception
Synchrony
Hearing
Temporal Processing
Experiment

ASJC Scopus subject areas

  • Acoustics and Ultrasonics

Cite this

Auditory-visual speech perception and synchrony detection for speech and nonspeech signals. / Conrey, Brianna; Pisoni, David.

In: Journal of the Acoustical Society of America, Vol. 119, No. 6, 06.2006, p. 4065-4073.

Research output: Contribution to journalArticle

@article{518765a17f844332935e09f451f5446f,
title = "Auditory-visual speech perception and synchrony detection for speech and nonspeech signals",
abstract = "Previous research has identified a {"}synchrony window{"} of several hundred milliseconds over which auditory-visual (AV) asynchronies are not reliably perceived. Individual variability in the size of this AV synchrony window has been linked with variability in AV speech perception measures, but it was not clear whether AV speech perception measures are related to synchrony detection for speech only or for both speech and nonspeech signals. An experiment was conducted to investigate the relationship between measures of AV speech perception and AV synchrony detection for speech and nonspeech signals. Variability in AV synchrony detection for both speech and nonspeech signals was found to be related to variability in measures of auditory-only (A-only) and AV speech perception, suggesting that temporal processing for both speech and nonspeech signals must be taken into account in explaining variability in A-only and multisensory speech perception.",
author = "Brianna Conrey and David Pisoni",
year = "2006",
month = "6",
doi = "10.1121/1.2195091",
language = "English",
volume = "119",
pages = "4065--4073",
journal = "Journal of the Acoustical Society of America",
issn = "0001-4966",
publisher = "Acoustical Society of America",
number = "6",

}

TY - JOUR

T1 - Auditory-visual speech perception and synchrony detection for speech and nonspeech signals

AU - Conrey, Brianna

AU - Pisoni, David

PY - 2006/6

Y1 - 2006/6

N2 - Previous research has identified a "synchrony window" of several hundred milliseconds over which auditory-visual (AV) asynchronies are not reliably perceived. Individual variability in the size of this AV synchrony window has been linked with variability in AV speech perception measures, but it was not clear whether AV speech perception measures are related to synchrony detection for speech only or for both speech and nonspeech signals. An experiment was conducted to investigate the relationship between measures of AV speech perception and AV synchrony detection for speech and nonspeech signals. Variability in AV synchrony detection for both speech and nonspeech signals was found to be related to variability in measures of auditory-only (A-only) and AV speech perception, suggesting that temporal processing for both speech and nonspeech signals must be taken into account in explaining variability in A-only and multisensory speech perception.

AB - Previous research has identified a "synchrony window" of several hundred milliseconds over which auditory-visual (AV) asynchronies are not reliably perceived. Individual variability in the size of this AV synchrony window has been linked with variability in AV speech perception measures, but it was not clear whether AV speech perception measures are related to synchrony detection for speech only or for both speech and nonspeech signals. An experiment was conducted to investigate the relationship between measures of AV speech perception and AV synchrony detection for speech and nonspeech signals. Variability in AV synchrony detection for both speech and nonspeech signals was found to be related to variability in measures of auditory-only (A-only) and AV speech perception, suggesting that temporal processing for both speech and nonspeech signals must be taken into account in explaining variability in A-only and multisensory speech perception.

UR - http://www.scopus.com/inward/record.url?scp=33745102745&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=33745102745&partnerID=8YFLogxK

U2 - 10.1121/1.2195091

DO - 10.1121/1.2195091

M3 - Article

VL - 119

SP - 4065

EP - 4073

JO - Journal of the Acoustical Society of America

JF - Journal of the Acoustical Society of America

SN - 0001-4966

IS - 6

ER -