Effects of audio‐visual training on the identification of English /r/ and /l/ by Japanese speakers

Reiko Akahane-Yamada, Ann R. Bradlow, David Pisoni, Yoh’ichi Tohkura

Research output: Contribution to journalArticle

3 Citations (Scopus)

Abstract

Two groups of Japanese speakers were trained to identify AE /r/ and /l/ using two different types of training: audio visual and auditory only. In audiovisual training, a movie of the talker’s face was presented together with the auditory stimuli, whereas only auditory stimuli were presented in audio‐only training. Improvement in /r/–/l/ identification from pretest to post‐test on three types of tests (audio‐only, visual only and audiovisual) did not differ substantially across the two training groups. Interestingly, the audio‐only group showed improved identification in the visual‐only tests, suggesting that training in the auditory domain transferred to the visual domain. A McGurk‐type test using /r/ and /l/ stimuli with conflicting audio and visual information was also conducted. Identification accuracies on this test showed a greater effect of conflicting visual information at post‐test than at pretest for the audio–visual training group, but not for the audio‐only training group, suggesting that audio‐visual training facilitated integration of auditory and visual information. Taken together, these results suggest that the internal representation of second‐language phonetic categories incorporates both auditory and visual information. Implications for theories of perceptual learning and phonological development will be discussed.

Original languageEnglish (US)
Pages (from-to)3137
Number of pages1
JournalJournal of the Acoustical Society of America
Volume102
Issue number5
DOIs
StatePublished - 1997

Fingerprint

education
auditory stimuli
phonetics
stimuli
learning
Hearing

ASJC Scopus subject areas

  • Arts and Humanities (miscellaneous)
  • Acoustics and Ultrasonics

Cite this

Effects of audio‐visual training on the identification of English /r/ and /l/ by Japanese speakers. / Akahane-Yamada, Reiko; Bradlow, Ann R.; Pisoni, David; Tohkura, Yoh’ichi.

In: Journal of the Acoustical Society of America, Vol. 102, No. 5, 1997, p. 3137.

Research output: Contribution to journalArticle

@article{f269a7c7d7914d0d9c297ee4f9bcf2d9,
title = "Effects of audio‐visual training on the identification of English /r/ and /l/ by Japanese speakers",
abstract = "Two groups of Japanese speakers were trained to identify AE /r/ and /l/ using two different types of training: audio visual and auditory only. In audiovisual training, a movie of the talker’s face was presented together with the auditory stimuli, whereas only auditory stimuli were presented in audio‐only training. Improvement in /r/–/l/ identification from pretest to post‐test on three types of tests (audio‐only, visual only and audiovisual) did not differ substantially across the two training groups. Interestingly, the audio‐only group showed improved identification in the visual‐only tests, suggesting that training in the auditory domain transferred to the visual domain. A McGurk‐type test using /r/ and /l/ stimuli with conflicting audio and visual information was also conducted. Identification accuracies on this test showed a greater effect of conflicting visual information at post‐test than at pretest for the audio–visual training group, but not for the audio‐only training group, suggesting that audio‐visual training facilitated integration of auditory and visual information. Taken together, these results suggest that the internal representation of second‐language phonetic categories incorporates both auditory and visual information. Implications for theories of perceptual learning and phonological development will be discussed.",
author = "Reiko Akahane-Yamada and Bradlow, {Ann R.} and David Pisoni and Yoh’ichi Tohkura",
year = "1997",
doi = "10.1121/1.420653",
language = "English (US)",
volume = "102",
pages = "3137",
journal = "Journal of the Acoustical Society of America",
issn = "0001-4966",
publisher = "Acoustical Society of America",
number = "5",

}

TY - JOUR

T1 - Effects of audio‐visual training on the identification of English /r/ and /l/ by Japanese speakers

AU - Akahane-Yamada, Reiko

AU - Bradlow, Ann R.

AU - Pisoni, David

AU - Tohkura, Yoh’ichi

PY - 1997

Y1 - 1997

N2 - Two groups of Japanese speakers were trained to identify AE /r/ and /l/ using two different types of training: audio visual and auditory only. In audiovisual training, a movie of the talker’s face was presented together with the auditory stimuli, whereas only auditory stimuli were presented in audio‐only training. Improvement in /r/–/l/ identification from pretest to post‐test on three types of tests (audio‐only, visual only and audiovisual) did not differ substantially across the two training groups. Interestingly, the audio‐only group showed improved identification in the visual‐only tests, suggesting that training in the auditory domain transferred to the visual domain. A McGurk‐type test using /r/ and /l/ stimuli with conflicting audio and visual information was also conducted. Identification accuracies on this test showed a greater effect of conflicting visual information at post‐test than at pretest for the audio–visual training group, but not for the audio‐only training group, suggesting that audio‐visual training facilitated integration of auditory and visual information. Taken together, these results suggest that the internal representation of second‐language phonetic categories incorporates both auditory and visual information. Implications for theories of perceptual learning and phonological development will be discussed.

AB - Two groups of Japanese speakers were trained to identify AE /r/ and /l/ using two different types of training: audio visual and auditory only. In audiovisual training, a movie of the talker’s face was presented together with the auditory stimuli, whereas only auditory stimuli were presented in audio‐only training. Improvement in /r/–/l/ identification from pretest to post‐test on three types of tests (audio‐only, visual only and audiovisual) did not differ substantially across the two training groups. Interestingly, the audio‐only group showed improved identification in the visual‐only tests, suggesting that training in the auditory domain transferred to the visual domain. A McGurk‐type test using /r/ and /l/ stimuli with conflicting audio and visual information was also conducted. Identification accuracies on this test showed a greater effect of conflicting visual information at post‐test than at pretest for the audio–visual training group, but not for the audio‐only training group, suggesting that audio‐visual training facilitated integration of auditory and visual information. Taken together, these results suggest that the internal representation of second‐language phonetic categories incorporates both auditory and visual information. Implications for theories of perceptual learning and phonological development will be discussed.

UR - http://www.scopus.com/inward/record.url?scp=84896957665&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84896957665&partnerID=8YFLogxK

U2 - 10.1121/1.420653

DO - 10.1121/1.420653

M3 - Article

AN - SCOPUS:84896957665

VL - 102

SP - 3137

JO - Journal of the Acoustical Society of America

JF - Journal of the Acoustical Society of America

SN - 0001-4966

IS - 5

ER -