PhD thesis - School of Informatics - University of Edinburgh

More documents

Recommendations

Info

Chapter 2. Background and Theory 35 2.2.1 Language Identification of Mixed-lingual Data Most conventional LID systems are successful in recognising the language of larger portions of text but are not well suited to classify individual tokens or sub-parts thereof. This section examines four LID approaches that are designed to deal with mixed- lingual input text. The first method relies on morpho-syntactic analysis combined with lexicon lookup (Pfister and Romsdorfer, 2003). The second approach is built on a combination of different methods including dictionary lookup and character n- gram statistics (Marcadet et al., 2005). The third system combines Hidden Markov Model language tagging with dictionary lookup and character-based n-gram modelling (Farrugia, 2005). Finally, the last algorithm (Andersen, 2005) is based on combined chargram and regular expression matching. Each study is reviewed in detail. 2.2.1.1 Morpho-syntactic Analysis of Mixed-lingual Data: Pfister and Romsdorfer (2003) Pfister and Romsdorfer (2003) outline the language mixing phenomena which is typi- cally encountered in German texts and derive a method for analysing such data. Based on their analysis, they conclude that Swiss newspaper articles contain many foreign inclusions, the majority of which are of English but also some of French origin. These results are consistent with findings by Henrich (1988) who states that most of the foreign inclusions in German text for which German pronunciation patterns do not apply are either English or French. Such inclusions can vary from simple word stems to entire phrases. Pfister and Romsdorfer (2003) identified various types of English inclusions and grouped them into three major categories: 1. Mixed-lingual word forms produced from an English stem by means of German declension, conjugation or compounding, e.g. • Den Managern wird misstraut. (noun stem + n, dative plural case) Translation: Managers are mistrusted. • Er surft gern. (verb stem + t, 3rd person singular) Translation: He likes to surf.
Chapter 2. Background and Theory 36 • Das ist ein smartes System. (adjective stem + es, nominative neuter case) Translation: This is a smart system. • Managergehälter sind umstritten. (compound noun) Translation: Manager salaries are controversial. • Exotic mixed-lingual words like: outgesourct (outsourced). 2. Full foreign word forms that follow the foreign morphology, e.g. • Die Fans lieben ihr Team. (noun) Translation: The fans love their team. • Der Laser ist eine Lichtquelle. (noun) Translation: The laser is a light source. • Sie ist happy. (adjective) Translation: She is happy. 3. Multi-word inclusions which are syntactically correct foreign constituents, e.g. • Der Konkurs von Swiss Dairy Food ist ... (proper name) Translation: The bankruptcy of Swiss Dairy Food is . . . • Human Touch kommt an. (noun group) Translation: Human touch goes down well. By foreign language inclusions they refer to foreign words which are less assimilated into the receiver language and tend to keep their foreign pronunciation. Pfister and Romsdorfer (2003) make a distinction between foreign inclusions and assimilated loan words which are more integrated into the base language in terms of morphology, syntax and pronunciation. A system able to derive the appropriate pronunciation and prosody for mixed-lingual text can be used for polyglot TTS synthesis. While such a system can deal with assimilated loan words as with other words in the base language
Page 1 and 2: Automatic Detection of English Incl
Page 3 and 4: these parsers with the annotation-f
Page 5 and 6: Declaration I declare that this the
Page 7 and 8: 3.3.5 Post-processing Module . . .
Page 9 and 10: A.2.2 Kappa Coefficient . . . . . .
Page 11 and 12: 5.6 Average relative token frequenc
Page 13 and 14: 3.16 Most frequent English inclusio
Page 15 and 16: Chapter 1. Introduction 2 siderable
Page 17 and 18: Chapter 1. Introduction 4 Chapter 3
Page 19 and 20: Chapter 1. Introduction 6 1.1 Relat
Page 21 and 22: Chapter 2. Background and Theory 8
Page 47: Chapter 2. Background and Theory 34
Page 59 and 60: Chapter 3 Tracking English Inclusio
Page 61 and 62: Chapter 3. Tracking English Inclusi
Page 99 and 100:
Chapter 3. Tracking English Inclusi
Page 101 and 102:
Page 103 and 104:
Page 105 and 106:
Page 107 and 108:
Page 109 and 110:
Page 111 and 112:
Page 113 and 114:
Chapter 4 System Extension to a New
Page 115 and 116:
Chapter 4. System Extension to a Ne
Page 117 and 118:
Page 119 and 120:
Page 121 and 122:
Page 123 and 124:
Page 125 and 126:
Page 127 and 128:
Page 129 and 130:
Chapter 5 Parsing English Inclusion
Page 131 and 132:
Chapter 5. Parsing English Inclusio
Page 133 and 134:
Page 135 and 136:
Page 137 and 138:
Page 139 and 140:
Page 141 and 142:
Page 143 and 144:
Page 145 and 146:
Page 147 and 148:
Page 149 and 150:
Page 151 and 152:
Page 153 and 154:
Page 155 and 156:
Page 157 and 158:
Page 159 and 160:
Chapter 6 Other Potential Applicati
Page 161 and 162:
Chapter 6. Other Potential Applicat
Page 163 and 164:
Page 165 and 166:
Page 167 and 168:
Page 169 and 170:
Page 171 and 172:
Page 173 and 174:
Page 175 and 176:
Page 177 and 178:
Page 179 and 180:
Page 181 and 182:
Page 183 and 184:
Page 185 and 186:
Page 187 and 188:
Chapter 7 Conclusions and Future Wo
Page 189 and 190:
Chapter 7. Conclusions and Future W
Page 191 and 192:
Appendix A. Evaluation Metrics and
Page 193 and 194:
Page 195 and 196:
Page 197 and 198:
Page 199 and 200:
Appendix B. Guidelines for Annotati
Page 201 and 202:
Page 203 and 204:
Page 205 and 206:
Appendix C TIGER Tags and Labels C.
Page 207 and 208:
Appendix C. TIGER Tags and Labels 1
Page 209 and 210:
Appendix C. TIGER Tags and Labels 1
Page 211 and 212:
Bibliography 198 Andersen, G. (2005
Page 213 and 214:
Bibliography 200 Bresnan, J. (2001)
Page 215 and 216:
Bibliography 202 Damashek, M. (1995
Page 217 and 218:
Bibliography 204 Finkel, J., Dingar
Page 219 and 220:
Bibliography 206 Hachey, B., Alex,
Page 221 and 222:
Bibliography 208 Kirkness, A. (1984
Page 223 and 224:
Bibliography 210 and Technology (In
Page 225 and 226:
Bibliography 212 Poplack, S. (1988)
Page 227 and 228:
Bibliography 214 Sokol, D. K. (2000
Page 229:
Bibliography 216 Yang, W. (1990). A
show all

PhD thesis - School of Informatics - University of Edinburgh

Create successful ePaper yourself

Delete template?

Save as template?