A Wordnet from the Ground Up

4.5. Hybrid Combinations 163seem low but the number of possible attachments is set to a rather high 5 – to showthe linguist more extracted senses – so it impairs precision. The measure P ≥1 alsoshows that at least one proper attachment area was identified in the majority of LUs.Even for the worst random sample, proposals for 59.12% of new lemmas were foundworth examining, as they include helpful suggestions. The numbers do not show howthe tool can inspire the user, draw her attention to less obvious or domain-dependentsenses, reveal peculiarities in the wordnet state and so on.L All S All S All S+W One S One W One S+W Best P ≥10 26.65 7.90 16.46 45.80 16.24 34.96 42.811 35.76 14.50 24.21 58.73 28.96 47.81 61.192 42.87 21.39 31.20 67.69 40.51 57.72 75.023 48.31 27.36 36.93 73.58 51.08 65.33 81.965 53.52 34.78 43.34 78.46 58.51 71.14 86.186 57.59 43.59 49.99 81.52 64.58 75.31 89.827 61.09 49.90 55.01 83.56 70.45 78.75 91.168 63.38 53.71 58.13 84.47 73.58 80.47 92.499 65.27 56.55 60.53 85.03 75.73 81.62 93.1210 66.07 58.86 62.16 85.26 78.28 82.70 93.54Table 4.6:The accuracy [%] of plWordNet reconstruction; L – the distance from the original synset,S and W mean strong and weak fitness, respectivelyWordNet reconstructionIn the automatic evaluation, we wanted to check the ability of the AAA algorithmto reconstruct parts of plWordNet. The method is meant to expand the existing corestructure of a wordnet, so we identified 1527 LUs in the lower parts of the hypernymystructure as a basis for the evaluation. In order to introduce as little bias as possible,10 LUs were removed from the plWordNet structure in one step of the evaluation. TheC H classifier component was trained without the removed LUs and the AAA algorithmwas run to attach the processed LUs.There are many synsets in plWordNet with a single LU. This makes the evaluationof LUs in such synsets problematic. If we removed singleton synsets, we wouldartificially – and dramatically – alter the overall structure of plWordNet and so introducean unwanted bias. That is why we decided to remove only the LUs and to leave emptysynsets in the modified plWordNet.We assumed three strategies for evaluating the AAA algorithm’s proposals:• All – all proposals are evaluated;• One – only single highest-scoring attachment site is evaluated; this strategy was