Proceedings Fonetik 2009 - Institutionen för lingvistik

More documents

Recommendations

Info

Proceedings, FONETIK 2009, Dept. of Linguistics, Stockholm UniversityFigure 2. Example showing one frame from the two video cameras taken from the Spontal database.AnnotationThe Spontal database is currently being transcribedorthographically. Basic gesture and dialog-levelannotation will also be added (e.g.turn-taking and feedback). Additionally, automaticannotation and validation methods arebeing developed and tested within the project.The transcription activities are being performedin parallel with the recording phase of theproject with special annotation tools written forthe project facilitating this process.Specifically, the project aims at annotationthat is both efficient, coherent, and to the largestextent possible objective. To achieve this,automatic methods are used wherever possible.The orthographic transcription, for example,follows a strict method: (1) automaticspeech/non-speech segmentation, (2) orthographictranscription of resulting speech segments,(3) validation by a second transcriber,(4) automatic phone segmentation based on theorthographic transcriptions. Pronunciation variabilityis not annotated by the transcribers, butis left for the automatic segmentation stage (4),which uses a pronunciation lexicon capturingmost standard variations.Figure 3. A single frame from one of the videocameras.Figure 4. 3D representation of the motion capturedata corresponding to the video frame shown inFigure 3.Concluding remarksA number of important contemporary trends inspeech research raise demands for large speechcorpora. A shining example is the study ofeveryday spoken language in dialog which hasmany characteristics that differ from writtenlanguage or scripted speech. Detailed analysisof spontaneous speech can also be fruitful forphonetic studies of prosody as well as reducedand hypoarticulated speech. The Spontal databasewill make it possible to test hypotheses onthe visual and verbal features employed incommunicative behavior covering a variety offunctions. To increase our understanding of traditionalprosodic functions such as prominencelending and grouping and phrasing, the databasewill enable researchers to study visual andacoustic interaction over several subjects anddialog partners. Moreover, dialog functionssuch as the signaling of turn-taking, feedback,attitudes and emotion can be studied from amultimodal, dialog perspective.In addition to basic research, one importantapplication area of the database is to gain192
Proceedings, FONETIK 2009, Dept. of Linguistics, Stockholm Universityknowledge to use in creating an animated talkingagent (talking head) capable of displayingrealistic communicative behavior with the longtermaim of using such an agent in conversationalspoken language systems.The project is planned to extend through2010 at which time the recordings and basicorthographic transcription will be completed,after which the database will be made freelyavailable for research purposes.AcknowledgementsThe work presented here is funded by the SwedishResearch Council, KFI - Grant for largedatabases (VR 2006-7482). It is performed atKTH Speech Music and Hearing (TMH) andthe Centre for Speech Technology (CTT) withinthe School of Computer Science and Communication.193
Page 1 and 2:
Department of LinguisticsProceeding
Page 3 and 4:
Proceedings, FONETIK 2009, Dept. of
Page 5 and 6:
Page 7 and 8:
Page 9 and 10:
Page 11 and 12:
Page 13 and 14:
Page 15 and 16:
Page 17 and 18:
Page 19 and 20:
Page 21 and 22:
Page 23 and 24:
Page 25 and 26:
Page 27 and 28:
Page 29 and 30:
Page 31 and 32:
Page 33 and 34:
Page 35 and 36:
Page 37 and 38:
Page 39 and 40:
Page 41 and 42:
Proceedings, FOETIK 2009, Dept. of
Page 43 and 44:
Page 45 and 46:
Page 47 and 48:
Page 49 and 50:
Page 51 and 52:
Page 53 and 54:
Page 55 and 56:
Page 57 and 58:
Page 59 and 60:
Page 61 and 62:
Page 63 and 64:
Page 65 and 66:
Page 67 and 68:
Page 69 and 70:
Page 71 and 72:
Page 73 and 74:
Page 75 and 76:
Page 77 and 78:
Page 79 and 80:
Page 81 and 82:
Page 83 and 84:
Page 85 and 86:
Page 87 and 88:
Page 89 and 90:
Page 91 and 92:
Page 93 and 94:
Page 95 and 96:
Page 97 and 98:
Page 99 and 100:
Page 101 and 102:
Page 103 and 104:
Page 105 and 106:
Page 107 and 108:
Page 109 and 110:
Page 111 and 112:
Page 113 and 114:
Page 115 and 116:
Page 117 and 118:
Page 119 and 120:
Page 121 and 122:
Page 123 and 124:
Page 125 and 126:
Page 127 and 128:
Page 129 and 130:
Page 131 and 132:
Page 133 and 134:
Page 135 and 136:
Page 137 and 138:
Page 139 and 140:
Page 141 and 142: Proceedings, FONETIK 2009, Dept. of
Page 191: Proceedings, FONETIK 2009, Dept. of
Page 203 and 204: Proceedings, FOETIK 2009, Dept. of
Page 205 and 206: Proceedings, FOETIK 2009, Dept. of
Page 227: Department of LinguisticsPhonetics
show all

Proceedings Fonetik 2009 - Institutionen för lingvistik

You also want an ePaper? Increase the reach of your titles

Delete template?

Save as template?