Proceedings Fonetik 2009 - Institutionen för lingvistik

Proceedings, FONETIK 2009, Dept. of Linguistics, Stockholm Universitythe linguistically informative quality is relevant Green K. P., Kuhl P. K., Meltzoff A. N., andhere, and that an additional discrepancy betweenvoice and face can even make it more formatin across talkers, gender, and sensoryStevens E. B. (1991) Integrating speech in-difficult to notice the relevant discrepancy. This modality: Female faces and male voices inappears to have happened with the auditory e ♀ the McGurk effect. Perception and Psychophys50, 524–536.dubbed on the visual y ♂ (see Table 1).7) The difference between subjects listeningvia headphones and those listening via foreign language effect in the McGurk ef-Hayashi T., and Sekiyama K. (1998) Native-loudspeaker is easily understood: The audibility fect: a test with Chinese and Japanese.of the voice is likely to be increased when using AVSP’98, Terrigal, Australia.headphones, mainly because of a better signalto-noiseratio.Irwin, J. R., Whalen, D. H., and Fowler, C. A.http://www.isca-speech.org/archive/avsp98/8) The greater influence of vision among (2006) A sex difference in visual influenceTurks as compared with Swedes most likely on heard speech. Perception and Psychophysics,68, 582–592.reflects a “foreign language effect” (Hayashiand Sekiyama, 1998; Chen and Hazan, 2007). Johnson K., Strand A.E., and D’Imperio, M.To Turkish listeners, syllables such as /ɡyːɡ/ (1999) Auditory-visual integration of talkerand /ɡiːɡ/ sound as foreign since long vowels gender in vowel perception. Journal of Phonetics27, 359–384.occur only in open syllables and a final /ɡ/never in Turkish. Minor differences in vowel Jordan, T.R. (2000) Effects of distance on visualand audiovisual speech recognition. Lan-quality are also involved. A greater influence ofvision might perhaps also result from a higher guage and Speech 43, 107–124.functional load of the roundedness distinction, McGurk H., and MacDonald J. (1976) Hearingbut this load is not likely to be higher in Turkishthan in Swedish.748.lips and seeing voices. Nature 264, 746–9) The results show that habituation to Munhall, K.G., Gribble, P., Sacco, L., Ward, M.dubbed speech has no deteriorating effect on (1996) Temporal constraints on the McGurknormal auditory-visual integration in the case of effect. Perception and Psychophysics 58,roundedness. The counter-intuitive result showingTurkish habituated subjects to be influenced Sams, M., Manninen, P., Surakka, V., Helin, P.351–362.more often by vision remains to be explained. It and Kättö, R. (1998) McGurk effect in inshould be taken with caution since only 15 of Finnish syllables, isolated words, and wordsthe 68 Turkish subjects were not habituated to in sentences: Effects of word meaning anddubbing.sentence context. Speech Communication26, 75–87.AcknowledgementsShigeno, S. (2002) Influence of vowel contexton the audio-visual perception of voicedI am grateful to Mehmet Aktürk (Centre for Researchon Bilingualism at Stockholm Universi-Research 42, 155–167.stop consonants. Japanese Psychologicalty) for the translation and the recruitment of Sekiyama K., Tohkura Y. (1993) Inter-languageTurkish subjects. His service was financed differences in the influence of visual cues inwithin the frame of the EU-project CONTACT speech perception. Journal of Phonetics 21,(NEST, proj. 50101).427–444.Sekiyama, K., and Burnham, D. (2004) IssuesReferencesin the development of auditory-visualspeech perception: adults, infants, andBurnham, D., and Dodd, B. (2004) Auditoryvisualspeech integration by prelinguistic in-children, In INTERSPEECH-2004, 1137–1140.fants: Perception of an emergent consonantTraunmüller H., and Öhrström, N. (2007) Audiovisualperception of openness and lipin the McGurk effect. Developmental Psychobiology45, 204–220.rounding in front vowels. Journal of Phonetics35, 244–258.Chen, Y., and Hazan, V. (2007) Language effectson the degree of visual influence inTraunmüller H., and Öhrström, N. (2007b) Theaudiovisual speech perception. Proc. of the16 th auditory and the visual percept evoked byInternational Congress of Phoneticthe same audiovisual stimuli. In AVSP-Sciences, 2177–2180.2007, paper L4-1.171