MAS.632 Conversational Computer Systems - MIT OpenCourseWare

More documents

Recommendations

Info

AUDIO SERVER ARCHITECTURES D~kop Audio 273 tions of sound map time to the horizontal dimension, showing a bar the length of which indicates sound duration. The user plays the sound by clicking on the bar, and as playback progresses a cursor moves in synchronization to indicate temporal position. With many ofthese interfaces the user can change the playback position by clicking to reposition the cursor. Chapter 4 illustrated a variety of time bar representations, many showing speech and silence intervals. The Sound- Viewer is a more recent example of such an interface; it is described below as a case study. The time bar representation has several advantages over the simple sound button by indicating the duration of the sound and providing finer control over playback. Its main disadvantage is the amount of screen space it requires. This difficulty has led to implementations in which the presence of a sound within an application is indicated by a small icon; when this icon is clicked on or dragged to another location a larger control panel opens up for playback, sound editing, and other functions (see Figures 12.3 and 12.4). Such an interface affords many of the advantages of the time bar display while saving screen space (especially useful if multiple sounds are visible), although it does require additional effort on the part of the user, and more importantly requires the user to shift gaze to the location where the control panel appears. An appropriate software architecture is required to support access to desktop audio by multiple applications. Current audio servers support digitization and playback of voice, but future servers will also incorporate software implementations of the speech processing technologies discussed throughout this book. Software-based speech recognition, speech synthesis, audio data compression, time-scaling, and other signal manipulation algorithms are feasible on today's workstations; products to perform these operations are already becoming available. When recognition and synthesis required additional external hardware devices or add-in cards, they were costly and unwieldy. When available as software, these technologies can be considerably less expensive and more widely available and hence attractive to application developers. Audio servers allow voice resources (speaker, microphone, voice processing algorithms) to be made available to multiple applications running simultaneously on one workstation. A server-based approach allows distributed audio processing and resource management among a variety of client applications. The relationship between an audio server and its clients is similar to that found in a server-based window system; instead of directly manipulating audio devices, clients make requests to the server, which controls devices on behalf of the clients. Because clients do not manipulate hardware directly, each client can operate without knowledge of the other clients. The server, or a separate policy agent operating in concert with the server, arbitrates conflicting requests (for a window system, the policy agent is the window manager). For example, if one client requests the server to play a sound while another client is already in the
274 VOICE COMMUNICATION WITH COMPUTERS Images removed due to copyright restrictions. Figure 12.3. The NeXT audio control panel. In the top form sound is represented only as a bar; by clicking a button the user can invoke the waveform envelope display shown at the bottom. midst of playing a different sound, various policies might be: make the new client wait, make the first client stop playing, or mix the sounds and play them simultaneously. Because the server approach divides client and server into separate processes that communicate via a well-known protocol, several additional benefits are realized. An application need not be recompiled to execute with a different version of
Page 1 and 2:
MIT OpenCourseWare http://ocw.mit.e
Page 3 and 4:
VNR Computer Library Advanced Topic
Page 5 and 6:
To Ava andKaya for the patienceto s
Page 7 and 8:
vi VOICE COMMUNICATION WITH COMPUTE
Page 9 and 10:
viE VOICE COMMUNICATION WITH COMPUT
Page 11 and 12:
VOICE COMMUNICATION WITH COMPUTEgS
Page 14 and 15:
Speaking of Talk As we enter the ne
Page 16 and 17:
Speaking ofTalk The short-term fix
Page 18 and 19:
Preface This book began as graduate
Page 20:
RFe[e ih This is just the beginning
Page 23 and 24:
xxii VOICE OMMUNICEAIIO WITH COMPUT
Page 25 and 26:
2 VOICE COMMUNICATION WITH COMPUTER
Page 27 and 28:
4 VOICE COMMUNICATION WITH COMPUTEI
Page 29 and 30:
6 VOICE (OMMUNICAIION WITH COMPUTER
Page 31 and 32:
S YVOICE COMMUNICATION WITH COMPUTE
Page 33 and 34:
10 VOICE COMMUHICATION WITH (OMPUIE
Page 35 and 36:
12 VOICE COMMUNICATION WITH COMPUTE
Page 37 and 38:
Page 39 and 40:
Page 41 and 42:
18 YVOII (OMMUNICATION WITH (OMPUTE
Page 43 and 44:
20 VOIC[ COMMUNICATION WITH COMPUTE
Page 45 and 46:
Page 47 and 48:
Page 49 and 50:
Page 51 and 52:
28 VOICE (OMMUNICATION WITH COMPUTE
Page 53 and 54:
30 VOICE COMMUNICATION WITH (OMPUTE
Page 55 and 56:
32 VOICE (OMMUHICATIOI WITH (OMPUTE
Page 57 and 58:
Page 59 and 60:
3 Speech Coding This chapter introd
Page 61 and 62:
38 VOICE (OMMUNICATlON WITH COMPUTE
Page 63 and 64:
40 VOICE COMMURItATION WITH (OMPUTE
Page 65 and 66:
Page 67 and 68:
Page 69 and 70:
Page 71 and 72:
48 VOICE COMMUNICATION WITi COMPUTE
Page 73 and 74:
IT -010 !Mm1-tgq Vm-0 50 VOICE COMM
Page 75 and 76:
52 VOICE (OMMUNICAlION WITH COMPUTE
Page 77 and 78:
Page 79 and 80:
56 VOICE COMMUNI(ATION WITH COMPUTE
Page 81 and 82:
Page 83 and 84:
4 Applications and Editing of Store
Page 85 and 86:
Page 87 and 88:
Page 89 and 90:
Page 91 and 92:
Page 93 and 94:
Page 95 and 96:
Page 97 and 98:
Page 99 and 100:
Page 101 and 102:
78 YOICE COMMUNICATION WITH COMPUTE
Page 103 and 104:
Page 105 and 106:
5 Speech Synthesis The previous two
Page 107 and 108:
Page 109 and 110:
6 YVOICE (OMMUNICATION WITH [OMPUTE
Page 111 and 112:
n VOICE COMMUNICATION WITH COMPUTER
Page 113 and 114:
Page 115 and 116:
Page 117 and 118:
Page 119 and 120:
Page 121 and 122:
98 VOICE COMMUlICATION WITH COMPUTE
Page 123 and 124:
Interactive Voice Response This cha
Page 125 and 126:
102 VOICE COMMUNICATION WITH COMPUT
Page 127 and 128:
104 VOICE COMMUNICATION WITH (OMPUT
Page 129 and 130:
Page 131 and 132:
Page 133 and 134:
110 VOICE (DMMUNICATION WITH COMPUT
Page 135 and 136:
112 VOICE COMMUNICATIOH WITH COMPUT
Page 137 and 138:
Page 139 and 140:
Page 141 and 142:
Page 143 and 144:
Page 145 and 146:
Page 147 and 148:
Page 149 and 150:
Page 151 and 152:
Page 153 and 154:
13 VOICE COMMUNICAIIOR WITH COMPUTE
Page 155 and 156:
7 Speech Recognition This chapter i
Page 157 and 158:
Page 159 and 160:
Page 161 and 162:
138 VOICE (OMMUNICATION WITH COMPUT
Page 163 and 164:
Page 165 and 166:
Page 167 and 168:
Page 169 and 170:
Page 171 and 172:
Page 173 and 174:
Page 175 and 176:
Page 177 and 178:
USES OF VOICE INPUT Sole IW,1 Canna
Page 179 and 180:
Page 181 and 182:
In VOICE COMMUNICATION WITH COMPUTE
Page 183 and 184:
160 VOICE [OMMUHICATION WIITH OMPUT
Page 185 and 186:
Page 187 and 188:
Page 189 and 190:
Page 191 and 192:
168 VOICE COMMUNICAlION WITH COM IU
Page 193 and 194:
Page 195 and 196:
172 VOICE (OMMURICAION WITH COMPUTE
Page 197 and 198:
Page 199 and 200:
Page 201 and 202:
Page 203 and 204:
Page 205 and 206:
182 OICE (COMMUNIICAION WITH COMPUT
Page 207 and 208:
1I4 VOICE COMMUNICATION WITH COMPUT
Page 209 and 210:
Page 211 and 212:
188 VOICE COMMUNICATION WIIH (OMPUT
Page 213 and 214:
190 VOICE COMMUNICATION WIIH (OMPUT
Page 215 and 216:
192 VOIC0 COMMUNICATION WITH COMPUT
Page 217 and 218:
194 VOI(E COMMUNIATIION WITH (OMPUT
Page 219 and 220:
Page 221 and 222:
198 VOICI COMMUNICATION WITH COMPUT
Page 223 and 224:
Page 225 and 226:
202 VOICE COMMUNICATIOR WIIH COMPUT
Page 227 and 228:
204 VOICE COMMUNICAIION WIlH COMPUT
Page 229 and 230:
206 VOIC([ OMMUNICATION WITH COMPUT
Page 231 and 232:
Page 233 and 234:
10 Basics of Telephones This and th
Page 235 and 236:
Page 237 and 238:
Page 239 and 240:
216 VOICE COMMUNICATION WITH COMPUI
Page 241 and 242:
Page 243 and 244:
Page 245 and 246: 222 VOICE COMMUNICATION WITH COMPUT
Page 247 and 248: 224 VOICE COMMUNICATION WIIH (OMPUT
Page 249 and 250: 226 VOICE (COMMUNICATION WITH COMPU
Page 253 and 254: 11 Telephones and Computers The pre
Page 257 and 258: 214 VOICE COMMUHiCATION WITH COMPUI
Page 259 and 260: 236 VOICE COMMUNICATIOK WITH COMPUT
Page 265 and 266: 242 VOICE COMMUHICATIOI WITH COMPUI
Page 269 and 270: 246 VOICE (OMMUNICAIION WITH COMPUT
Page 271 and 272: 248 VOICE (COMMUNICATION WITH COMPU
Page 277 and 278: 254 VOICE COMMUNICAIION WITH COMPUT
Page 279 and 280: 25 VOICE (OMMUNICATIOK WITH COMPUTE
Page 291 and 292: 12 Desktop Audio Because of limitat
Page 295: 2f2 VOICE COMMUIICAIION WITH COMPUT
Page 305 and 306: 22 VOICE COMMUNICATION WITH COMPUTE
Page 307 and 308: 284 VOIC[ COMMIUWlATION WITH COMPUT
Page 311 and 312: 211 VOICE (OMMUNICATION WITH COMPUT
Page 313 and 314: 290 VOICE COMMIUNICATIO0 WITH COMPU
Page 317 and 318: 294 VOICE (OMMUNICATION WITH COMPUT
Page 321 and 322: 298 VOICE (OMMUNICATION WITH (COMPU
Page 328 and 329: Bibliography Ades, S. and D. C. Swi
Page 330 and 331: Biliograply o30 Daly, N. A. and V W
Page 332 and 333: Bib~lgraphy 309 Klatt, D. H. "Revie
Page 334 and 335: liblgraphy 311 G.Peterson, W. Wang,
Page 336 and 337: Bbliography 313 Spiegel, M. F "Usin
Page 338 and 339: Index p-law, 45, 220, 224 acoustics
Page 340 and 341: Integrated Services Digital Network
Page 342: vocal tract, 19-24, 23 voice mail,
show all

MAS.632 Conversational Computer Systems - MIT OpenCourseWare

You also want an ePaper? Increase the reach of your titles

Delete template?

Save as template?