Comprehension of natural and synthetic speech: effects of predictability on the verification of sentences controlled for intelligibility

David B. Pisoni, Laura M. Manous, Michael J. Dedina

Research output: Contribution to journalArticle

37 Citations (Scopus)

Abstract

A sentence verification task (SVT) was used to study the effects of sentence predictability on comprehension of natural speech and synthetic speech that was controlled for intelligibility. Sentences generated using synthetic speech were matched on intelligibility with natural speech using results obtained from a separate sentence transcription task. In the main experiment, the sentence verification task included both true and false sentences that varied in predictability. Results showed differences in verification speed between natural and synthetic sentences, despite the fact that these materials were equated for intelligibility. This finding suggests that the differences in perception and comprehension between natural and synthetic speech go beyond segmental intelligibility as measured by transcription accuracy. The observed differences in response times appear to be related to the cognitive processes involved in understanding and verifying the truth value of short sentences. Reliable effects of predictability on error rates and response latencies were also observed. High-predictability sentences displayed lower error rates and faster response times than low-predictability sentences. However, predictability did not have differential effects on the processing of synthetic speech as expected. The results demonstrate the need to develop new measures of sentence comprehension that can be used to study speech communication at processing levels above and beyond those indexed through transcription tasks, or forced-choice intelligibility tests such as the Modified Rhyme Test (MRT) or the Diagnostic Rhyme Test (DRT).

Original languageEnglish (US)
Pages (from-to)303-320
Number of pages18
JournalComputer Speech and Language
Volume2
Issue number3-4
DOIs
StatePublished - Jan 1 1987

Fingerprint

Predictability
comprehension
Speech intelligibility
Transcription
Reaction Time
Response Time
Error Rate
Speech communication
Diagnostic Tests
Processing
Speech
Routine Diagnostic Tests
Latency
diagnostic
Communication
communication
experiment
Demonstrate
Experiment
Experiments

ASJC Scopus subject areas

  • Software
  • Theoretical Computer Science
  • Human-Computer Interaction

Cite this

Comprehension of natural and synthetic speech : effects of predictability on the verification of sentences controlled for intelligibility. / Pisoni, David B.; Manous, Laura M.; Dedina, Michael J.

In: Computer Speech and Language, Vol. 2, No. 3-4, 01.01.1987, p. 303-320.

Research output: Contribution to journalArticle

@article{b86ca652e4924393871775d5f46d90cf,
title = "Comprehension of natural and synthetic speech: effects of predictability on the verification of sentences controlled for intelligibility",
abstract = "A sentence verification task (SVT) was used to study the effects of sentence predictability on comprehension of natural speech and synthetic speech that was controlled for intelligibility. Sentences generated using synthetic speech were matched on intelligibility with natural speech using results obtained from a separate sentence transcription task. In the main experiment, the sentence verification task included both true and false sentences that varied in predictability. Results showed differences in verification speed between natural and synthetic sentences, despite the fact that these materials were equated for intelligibility. This finding suggests that the differences in perception and comprehension between natural and synthetic speech go beyond segmental intelligibility as measured by transcription accuracy. The observed differences in response times appear to be related to the cognitive processes involved in understanding and verifying the truth value of short sentences. Reliable effects of predictability on error rates and response latencies were also observed. High-predictability sentences displayed lower error rates and faster response times than low-predictability sentences. However, predictability did not have differential effects on the processing of synthetic speech as expected. The results demonstrate the need to develop new measures of sentence comprehension that can be used to study speech communication at processing levels above and beyond those indexed through transcription tasks, or forced-choice intelligibility tests such as the Modified Rhyme Test (MRT) or the Diagnostic Rhyme Test (DRT).",
author = "Pisoni, {David B.} and Manous, {Laura M.} and Dedina, {Michael J.}",
year = "1987",
month = "1",
day = "1",
doi = "10.1016/0885-2308(87)90014-3",
language = "English (US)",
volume = "2",
pages = "303--320",
journal = "Computer Speech and Language",
issn = "0885-2308",
publisher = "Academic Press Inc.",
number = "3-4",

}

TY - JOUR

T1 - Comprehension of natural and synthetic speech

T2 - effects of predictability on the verification of sentences controlled for intelligibility

AU - Pisoni, David B.

AU - Manous, Laura M.

AU - Dedina, Michael J.

PY - 1987/1/1

Y1 - 1987/1/1

N2 - A sentence verification task (SVT) was used to study the effects of sentence predictability on comprehension of natural speech and synthetic speech that was controlled for intelligibility. Sentences generated using synthetic speech were matched on intelligibility with natural speech using results obtained from a separate sentence transcription task. In the main experiment, the sentence verification task included both true and false sentences that varied in predictability. Results showed differences in verification speed between natural and synthetic sentences, despite the fact that these materials were equated for intelligibility. This finding suggests that the differences in perception and comprehension between natural and synthetic speech go beyond segmental intelligibility as measured by transcription accuracy. The observed differences in response times appear to be related to the cognitive processes involved in understanding and verifying the truth value of short sentences. Reliable effects of predictability on error rates and response latencies were also observed. High-predictability sentences displayed lower error rates and faster response times than low-predictability sentences. However, predictability did not have differential effects on the processing of synthetic speech as expected. The results demonstrate the need to develop new measures of sentence comprehension that can be used to study speech communication at processing levels above and beyond those indexed through transcription tasks, or forced-choice intelligibility tests such as the Modified Rhyme Test (MRT) or the Diagnostic Rhyme Test (DRT).

AB - A sentence verification task (SVT) was used to study the effects of sentence predictability on comprehension of natural speech and synthetic speech that was controlled for intelligibility. Sentences generated using synthetic speech were matched on intelligibility with natural speech using results obtained from a separate sentence transcription task. In the main experiment, the sentence verification task included both true and false sentences that varied in predictability. Results showed differences in verification speed between natural and synthetic sentences, despite the fact that these materials were equated for intelligibility. This finding suggests that the differences in perception and comprehension between natural and synthetic speech go beyond segmental intelligibility as measured by transcription accuracy. The observed differences in response times appear to be related to the cognitive processes involved in understanding and verifying the truth value of short sentences. Reliable effects of predictability on error rates and response latencies were also observed. High-predictability sentences displayed lower error rates and faster response times than low-predictability sentences. However, predictability did not have differential effects on the processing of synthetic speech as expected. The results demonstrate the need to develop new measures of sentence comprehension that can be used to study speech communication at processing levels above and beyond those indexed through transcription tasks, or forced-choice intelligibility tests such as the Modified Rhyme Test (MRT) or the Diagnostic Rhyme Test (DRT).

UR - http://www.scopus.com/inward/record.url?scp=0001302126&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0001302126&partnerID=8YFLogxK

U2 - 10.1016/0885-2308(87)90014-3

DO - 10.1016/0885-2308(87)90014-3

M3 - Article

AN - SCOPUS:0001302126

VL - 2

SP - 303

EP - 320

JO - Computer Speech and Language

JF - Computer Speech and Language

SN - 0885-2308

IS - 3-4

ER -