The Corpus Thread - Det Danske Sprog- og Litteraturselskab

More documents

Recommendations

Info

3.3. Filling in the header 50 Legal values Value Description nil Info has not been determined yet. Default empty Info is irrelevant, non-existent, or undeterminable pretokenizer Splits a text into word-like segments. A pretokenizer is only applied once, all other applications are based on the pretokenized version of the text tokenizer Splits a text into word-like segments s-splitter Sentence splitter. Splits the text into sentences, i.e. a segment between two full stops or some similar type of punctuation. Inserts and tags around sentence-like text segments p-splitter Paragraph splitter. Splits the text into paragraphs. Inserts and tags around paragraph-like text segments regularizer Tags a token with a regularised version of its surface representation, i.e. its orth<strong>og</strong>raphy lemmatizer Tags a token with its lemma form pos-tagger Tags a token with part-of-speech info morph-tagger Tags a token with morphol<strong>og</strong>ical/inflectional info term-tagger Tags a token with some indication of whether it is a term (in multi- processor texts to be included in LSP corpora) Multifunctional tool that performs various tasks like tokenizing, lemmatizing, tagging as one complex process other Tool performing tasks not yet listed ⊲ appType Specifies whether an application or procedure that operated on the text was automatic (or a combination of both) as well as the type of task of the application/procedure in terms of segmentation or annotation. Properties Value set type enumerated, closed XML name vs_appType.xml
3.3. Filling in the header 51 Legal values Value Description nil Info has not been determined yet empty Info is irrelevant, non-existent, or undeterminable a- segmentation c- segmentation m- segmentation Text split into smaller segments (e.g. sentences, tokens) by an automatic process. Default Text split into smaller segments (e.g. sentences, tokens) by a combined automatic-manual process Text split into smaller segments (e.g. sentences, tokens) by a manual process a-annotation Text segments annotated with info by an automatic process c-annotation Text segments annotated with info by a combined automatic-manual process m-annotation Text segments annotated with info by a manual process ⊲ appVersionNumber Version number of an application/procedure that has operated on the text. Properties Legal values Value set type Value Description enumerated, open XML name vs_appVersionNumber.xml 99999999 Info has not been determined yet 0 Info is irrelevant, non-existent, or undeterminable ... ... ⊲ appXmlId Unique XML identifier which is referenced by the corresponding annotation layer ( element, see 4.2.3.2) in the text. Empty
Page 1 and 2: The Corpus Thread “Reference corp
Page 3 and 4: Chapter 1 Aim and concepts Sketchin
Page 5 and 6: 1.1. Aim of the project 5 Metadata
Page 7 and 8: 1.2. Project tasks and documentatio
Page 13 and 14: 1.3. Text collection, text bank, co
Page 15 and 16: Chapter 2 The text bank A platform
Page 17 and 18: 2.2. Implementation 17 and metadata
Page 19 and 20: Chapter 3 Text metadata What the he
Page 21 and 22: 3.1. Concepts 21 Section 3.3 starts
Page 23 and 24: 3.2. Header structure 23 (file des
Page 25 and 26: 3.2. Header structure 25 great verb
Page 27 and 28: 3.2. Header structure 27 The follow
Page 29 and 30: 3.2. Header structure 29 deprecated
Page 31 and 32: 3.2. Header structure 31 the text i
Page 33 and 34: 3.2. Header structure 33 Another el
Page 35 and 36: 3.2. Header structure 35 appDesc
Page 37 and 38: 3.2. Header structure 37 informal p
Page 39 and 40: 3.2. Header structure 39 3.2.3.4 Te
Page 41 and 42: 3.3. Filling in the header 41 revi
Page 43 and 44: 3.3. Filling in the header 43 samp
Page 45 and 46: 3.3. Filling in the header 45 and 9
Page 47 and 48: 3.3. Filling in the header 47 descr
Page 49: 3.3. Filling in the header 49 ⊲ a
Page 53 and 54: 3.3. Filling in the header 53 ⊲ a
Page 55 and 56: 3.3. Filling in the header 55 Legal
Page 61 and 62: 3.3. Filling in the header 61 Value
Page 65 and 66: 3.3. Filling in the header 65 ⊲ p
Page 67 and 68: 3.3. Filling in the header 67 Prope
Page 83 and 84: 3.3. Filling in the header 83 3.3.3
Page 85 and 86: 4.1. Basic considerations 85 Outlin
Page 87 and 88: 4.2. Formatting text 87 russiske hi
Page 89 and 90: 4.2. Formatting text 89 Mirganjan
Page 91 and 92: 4.2. Formatting text 91 udvikle ude
Page 93 and 94: 4.2. Formatting text 93 4.2.3.4 Add
Page 95 and 96: 4.2. Formatting text 95 i dag . T
Page 97 and 98: Part III Collecting 97
Page 99 and 100: 5.1. Implementation 99 5.5.2 Implem
Page 101 and 102:
5.1. Implementation 101 [request c
Page 103 and 104:
5.2. Header constructor:make-header
Page 105 and 106:
Page 107 and 108:
Page 109 and 110:
Page 111 and 112:
Page 113 and 114:
Page 115 and 116:
5.3. Pre-tokenizer:pretokenize 115
Page 117 and 118:
5.3. Pre-tokenizer:pretokenize 117
Page 119 and 120:
5.4. Text id registry:register-text
Page 121 and 122:
5.4. Text id registry:register-text
Page 123 and 124:
5.5. id dispatcher:make-id 123 0 11
Page 125 and 126:
Part IV Markup 125
Page 127 and 128:
6.1. Requirements 127 Outline of th
Page 129 and 130:
6.2. Survey 129 1. IMS’s TreeTagg
Page 131 and 132:
6.2. Survey 131 Code: Java. Assessm
Page 133 and 134:
6.2. Survey 133 9. alias-i’s Ling
Page 135 and 136:
6.3. Case study 135 lemmatization c
Page 137 and 138:
6.4. Further reading 137 disambigua
Page 139 and 140:
7.1. Modifications of the PAROLE Co
Page 141 and 142:
7.2. The ePOS tag set for Danish 14
Page 143 and 144:
Page 145 and 146:
Page 147 and 148:
Page 149 and 150:
Page 151 and 152:
Page 153 and 154:
Chapter 8 The full-form lexicon Sam
Page 155 and 156:
8.1. Enhancing existing material 15
Page 157 and 158:
8.1. Enhancing existing material 15
Page 159 and 160:
Part V Deployment 159
Page 161 and 162:
9.2. Text material 161 Type Source
Page 163 and 164:
10.2. Funktionaliteter 163 2. The u
Page 165 and 166:
10.2. Funktionaliteter 165 fortolke
Page 167 and 168:
10.2. Funktionaliteter 167 teknolog
Page 169 and 170:
10.2. Funktionaliteter 169 Implemen
Page 171 and 172:
10.2. Funktionaliteter 171 forbinde
Page 173 and 174:
10.2. Funktionaliteter 173 10.2.9 K
Page 175 and 176:
Bibliography Andersen, M. S., Asmus
show all

The Corpus Thread - Det Danske Sprog- og Litteraturselskab

Create successful ePaper yourself

Delete template?

Save as template?