A Wordnet from the Ground Up

154 Chapter 4. Extracting Relation InstancesThe whole attachment screen is embedded in the full plWordNetApp, so the linguistcan change any element of the plWordNet database by switching to another panel.The AAA algorithm runs on the server. On the client side, mainly visualisation isleft. WNW is written in Java and can run unchanged on many platforms.4.5.4 Benefits of weaving the expanded structureWNW has been designed to facilitate the actual process of wordnet expansion. Itsprimary evaluation was based on the work of a linguist with rich experience in editingplWordNet, who was adding new nominal lemmas. The candidates came from thesame set of 13285 nominal lemmas, which has been defined as a basis for expandingplWordNet during work on MSR extraction, cf Section 3.4.5. The set includes lemmasfrom a small Polish-English dictionary (Piotrowski and Saloni, 1999), two-wordlemmas from a general dictionary of Polish (PWN, 2007) and frequent nouns (>1000)from the joint corpus 14 (≈ 581 million tokens, see Section 3.4.5).For evaluation purposes, we used 1360 new lemmas divided into subdomains correspondingto animals (113 LUs), food (170), people (323), people 2 (269), plants (81),places (243), plus a sample of 161 LUs randomly drawn across all clusters (rand. inTable 4.5). Prior to the experiment, the linguist had used only traditional means ofher work – electronic dictionaries and corpus browsing. We assumed three types ofevaluation:1. subjective opinions and observations of the linguist collected during actual workover a longer period, 18 person-days,2. monitoring and analysing the linguist’s decisions recorded in the database togetherwith descriptions,3. automatic evaluation following the general scheme of re-building the existingwordnet by applying the AAA algorithm autonomously.The linguist’s observationsWNW has turned out to be useful in the inclusion of new lemmas given a narrowdomain such as jedz 15 (names of foodstuffs) or rsl (plant names). For such lemmasthe accuracy was high, and it increased even more as the database grew and as theoperation of recomputing the graphs became available. As an example, the program14 As described in Section 3.4.5, the joint corpus consists of IPIC (≈ 254 million tokens)(Przepiórkowski, 2004), texts from the electronic edition of a Polish daily Rzeczpospolita(≈ 113 million tokens) (Rzeczpospolita, 2008) and a corpus of large Polish texts collected from theInternet (≈ 214 million tokens).15 We cite here the original labels assigned to the domains in plWordNet.