List equivalency of PRESTO for the evaluation of speech recognition

Kathleen F. Faulkner, Terrin N. Tamati, Jaimie L. Gilbert, David Pisoni

Research output: Contribution to journalArticle

1 Citation (Scopus)

Abstract

Background: There is a pressing clinical need for the development of ecologically valid and robust assessment measures of speech recognition. Perceptually Robust English Sentence Test Open-set (PRESTO) is a new high-variability sentence recognition test that is sensitive to individual differences and was designed for use with several different clinical populations. PRESTO differs from other sentence recognition tests because the target sentences differ in talker, gender, and regional dialect. Increasing interest in using PRESTO as a clinical test of spoken word recognition dictates the need to establish equivalence across test lists. Purpose: The purpose of this study was to establish list equivalency of PRESTO for clinical use. Research Design: PRESTO sentence lists were presented to three groups of normal-hearing listeners in noise (multitalker babble [MTB] at 0 dB signal-to-noise ratio) or under eight-channel cochlear implant simulation (CI-Sim). Study Sample: Ninety-one young native speakers of English who were undergraduate students from the Indiana University community participated in this study. Data Collection and Analysis: Participants completed a sentence recognition task using different PRESTO sentence lists. They listened to sentences presented over headphones and typed in the words they heard on a computer. scoring was completed offline. Equivalency for sentence lists was determined based on the list intelligibility (mean accuracy for each list compared with all other lists) and listener consistency (the relation between mean accuracy on each list for each listener). Results: Based on measures of list equivalency and listener consistency, ten PRESTO lists were found to be equivalent in the MTB condition, nine lists were equivalent in the CI-Sim condition, and six PRESTO lists were equivalent in both conditions. Conclusions: PRESTO is a valuable addition to the clinical toolbox for assessing sentence recognition across different populations. Because the test condition influenced the overall intelligibility of lists, researchers and clinicians should take the presentation conditions into consideration when selecting the best PRESTO lists for their research or clinical protocols.

Original languageEnglish
Pages (from-to)582-594
Number of pages13
JournalJournal of the American Academy of Audiology
Volume26
Issue number6
DOIs
StatePublished - Jun 1 2015

Fingerprint

Cochlear Implants
Signal-To-Noise Ratio
Clinical Protocols
Population Groups
Individuality
Population
Hearing
Noise
Research Design
Research Personnel
Students

Keywords

  • Cochlear implants
  • Individual differences
  • Speaker variation
  • Speech perception
  • Speech recognition
  • TIMIT

ASJC Scopus subject areas

  • Speech and Hearing

Cite this

List equivalency of PRESTO for the evaluation of speech recognition. / Faulkner, Kathleen F.; Tamati, Terrin N.; Gilbert, Jaimie L.; Pisoni, David.

In: Journal of the American Academy of Audiology, Vol. 26, No. 6, 01.06.2015, p. 582-594.

Research output: Contribution to journalArticle

Faulkner, Kathleen F. ; Tamati, Terrin N. ; Gilbert, Jaimie L. ; Pisoni, David. / List equivalency of PRESTO for the evaluation of speech recognition. In: Journal of the American Academy of Audiology. 2015 ; Vol. 26, No. 6. pp. 582-594.
@article{778e8ca38d904aacb8ef7485f0091f5b,
title = "List equivalency of PRESTO for the evaluation of speech recognition",
abstract = "Background: There is a pressing clinical need for the development of ecologically valid and robust assessment measures of speech recognition. Perceptually Robust English Sentence Test Open-set (PRESTO) is a new high-variability sentence recognition test that is sensitive to individual differences and was designed for use with several different clinical populations. PRESTO differs from other sentence recognition tests because the target sentences differ in talker, gender, and regional dialect. Increasing interest in using PRESTO as a clinical test of spoken word recognition dictates the need to establish equivalence across test lists. Purpose: The purpose of this study was to establish list equivalency of PRESTO for clinical use. Research Design: PRESTO sentence lists were presented to three groups of normal-hearing listeners in noise (multitalker babble [MTB] at 0 dB signal-to-noise ratio) or under eight-channel cochlear implant simulation (CI-Sim). Study Sample: Ninety-one young native speakers of English who were undergraduate students from the Indiana University community participated in this study. Data Collection and Analysis: Participants completed a sentence recognition task using different PRESTO sentence lists. They listened to sentences presented over headphones and typed in the words they heard on a computer. scoring was completed offline. Equivalency for sentence lists was determined based on the list intelligibility (mean accuracy for each list compared with all other lists) and listener consistency (the relation between mean accuracy on each list for each listener). Results: Based on measures of list equivalency and listener consistency, ten PRESTO lists were found to be equivalent in the MTB condition, nine lists were equivalent in the CI-Sim condition, and six PRESTO lists were equivalent in both conditions. Conclusions: PRESTO is a valuable addition to the clinical toolbox for assessing sentence recognition across different populations. Because the test condition influenced the overall intelligibility of lists, researchers and clinicians should take the presentation conditions into consideration when selecting the best PRESTO lists for their research or clinical protocols.",
keywords = "Cochlear implants, Individual differences, Speaker variation, Speech perception, Speech recognition, TIMIT",
author = "Faulkner, {Kathleen F.} and Tamati, {Terrin N.} and Gilbert, {Jaimie L.} and David Pisoni",
year = "2015",
month = "6",
day = "1",
doi = "10.3766/jaaa.14082",
language = "English",
volume = "26",
pages = "582--594",
journal = "Journal of the American Academy of Audiology",
issn = "1050-0545",
publisher = "American Academy of Audiology",
number = "6",

}

TY - JOUR

T1 - List equivalency of PRESTO for the evaluation of speech recognition

AU - Faulkner, Kathleen F.

AU - Tamati, Terrin N.

AU - Gilbert, Jaimie L.

AU - Pisoni, David

PY - 2015/6/1

Y1 - 2015/6/1

N2 - Background: There is a pressing clinical need for the development of ecologically valid and robust assessment measures of speech recognition. Perceptually Robust English Sentence Test Open-set (PRESTO) is a new high-variability sentence recognition test that is sensitive to individual differences and was designed for use with several different clinical populations. PRESTO differs from other sentence recognition tests because the target sentences differ in talker, gender, and regional dialect. Increasing interest in using PRESTO as a clinical test of spoken word recognition dictates the need to establish equivalence across test lists. Purpose: The purpose of this study was to establish list equivalency of PRESTO for clinical use. Research Design: PRESTO sentence lists were presented to three groups of normal-hearing listeners in noise (multitalker babble [MTB] at 0 dB signal-to-noise ratio) or under eight-channel cochlear implant simulation (CI-Sim). Study Sample: Ninety-one young native speakers of English who were undergraduate students from the Indiana University community participated in this study. Data Collection and Analysis: Participants completed a sentence recognition task using different PRESTO sentence lists. They listened to sentences presented over headphones and typed in the words they heard on a computer. scoring was completed offline. Equivalency for sentence lists was determined based on the list intelligibility (mean accuracy for each list compared with all other lists) and listener consistency (the relation between mean accuracy on each list for each listener). Results: Based on measures of list equivalency and listener consistency, ten PRESTO lists were found to be equivalent in the MTB condition, nine lists were equivalent in the CI-Sim condition, and six PRESTO lists were equivalent in both conditions. Conclusions: PRESTO is a valuable addition to the clinical toolbox for assessing sentence recognition across different populations. Because the test condition influenced the overall intelligibility of lists, researchers and clinicians should take the presentation conditions into consideration when selecting the best PRESTO lists for their research or clinical protocols.

AB - Background: There is a pressing clinical need for the development of ecologically valid and robust assessment measures of speech recognition. Perceptually Robust English Sentence Test Open-set (PRESTO) is a new high-variability sentence recognition test that is sensitive to individual differences and was designed for use with several different clinical populations. PRESTO differs from other sentence recognition tests because the target sentences differ in talker, gender, and regional dialect. Increasing interest in using PRESTO as a clinical test of spoken word recognition dictates the need to establish equivalence across test lists. Purpose: The purpose of this study was to establish list equivalency of PRESTO for clinical use. Research Design: PRESTO sentence lists were presented to three groups of normal-hearing listeners in noise (multitalker babble [MTB] at 0 dB signal-to-noise ratio) or under eight-channel cochlear implant simulation (CI-Sim). Study Sample: Ninety-one young native speakers of English who were undergraduate students from the Indiana University community participated in this study. Data Collection and Analysis: Participants completed a sentence recognition task using different PRESTO sentence lists. They listened to sentences presented over headphones and typed in the words they heard on a computer. scoring was completed offline. Equivalency for sentence lists was determined based on the list intelligibility (mean accuracy for each list compared with all other lists) and listener consistency (the relation between mean accuracy on each list for each listener). Results: Based on measures of list equivalency and listener consistency, ten PRESTO lists were found to be equivalent in the MTB condition, nine lists were equivalent in the CI-Sim condition, and six PRESTO lists were equivalent in both conditions. Conclusions: PRESTO is a valuable addition to the clinical toolbox for assessing sentence recognition across different populations. Because the test condition influenced the overall intelligibility of lists, researchers and clinicians should take the presentation conditions into consideration when selecting the best PRESTO lists for their research or clinical protocols.

KW - Cochlear implants

KW - Individual differences

KW - Speaker variation

KW - Speech perception

KW - Speech recognition

KW - TIMIT

UR - http://www.scopus.com/inward/record.url?scp=84934278644&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84934278644&partnerID=8YFLogxK

U2 - 10.3766/jaaa.14082

DO - 10.3766/jaaa.14082

M3 - Article

C2 - 26134725

AN - SCOPUS:84934278644

VL - 26

SP - 582

EP - 594

JO - Journal of the American Academy of Audiology

JF - Journal of the American Academy of Audiology

SN - 1050-0545

IS - 6

ER -