Views
5 years ago

Automatic Extraction of Examples for Word Sense Disambiguation

Automatic Extraction of Examples for Word Sense Disambiguation

CHAPTER 6. AUTOMATIC

CHAPTER 6. AUTOMATIC EXTRACTION OF EXAMPLES FOR WSD 72 6.9 Evaluation The following section is a summary of the results that our system achieved on the multiple experiments, which we conducted (see Section 6.8). Additionally we report the total system performance according to the measures discussed in Section 4.1. To begin with let us consider the four different experiments, which we completed. The difference between them was in the altered training set consisting of (the following sets are referred to further in the section with their numbers below): 1. Only Automatically Annotated Data 2. Filtered Automatically Annotated 3. Only Manually Annotated 4. Manually Annotated Data plus Filtered Automatically Annotated From Table 6.15 we can see that our system achieves best results with training set 4. Set all features feature selection forward backward best perf. coarse fine coarse fine coarse fine coarse fine P R P R P R P R P R P R P R P R 1 45.4 45.4 35.5 35.5 54.7 54.7 46.2 46.2 53.2 53.2 44.2 44.2 56.2 56.2 47.5 47.5 2 54.7 54.7 47.0 47.0 65.8 65.8 59.2 59.2 63.3 63.3 56.8 56.8 66.7 66.7 60.2 60.2 3 70.7 70.7 65.0 65.0 78.7 78.7 74.3 74.3 77.8 77.8 73.3 73.3 79.3 79.3 75.1 75.1 4 70.5 70.5 64.9 64.9 78.7 78.7 74.0 74.0 77.6 77.6 73.0 73.0 79.4 79.4 75.0 75.0 Table 6.15: Summary of the results for all experiments. We always showed the accuracy of the system in terms of precision and recall, however in Sec- tion 4.1 we mentioned as well their harmonic average (used to represent the total performance of a system) - the F-score. The F-score will also allow us to compare the figures with the upper and lower bound for the experiment. Thus, in Table 6.16 we show the computed F-scores for the four experiments we conducted compared to the upper (IAA) and lower (MFS heuristic) bound for the English lexical sample task in the Senseval-3 competition as reported by (Mihalcea et al., 2004a).

A Machine Learning Approach for Automatic Road Extraction - asprs
Selective Sampling for Example-based Word Sense Disambiguation
Word sense disambiguation with pattern learning and automatic ...
Word Sense Disambiguation Using Automatically Acquired Verbal ...
Using Machine Learning Algorithms for Word Sense Disambiguation ...
Word Sense Disambiguation The problem of WSD - PEOPLE
Performance Metrics for Word Sense Disambiguation
BOOTSTRAPPING IN WORD SENSE DISAMBIGUATION
Word Sense Disambiguation - cs547pa1
WORD SENSE DISAMBIGUATION - Leffa
Word Sense Disambiguation
word sense disambiguation and recognizing textual entailment with ...
MRD-based Word Sense Disambiguation - the Association for ...
Word Sense Disambiguation Using Selectional Restriction - Ijsrp.org
Using Lexicon Definitions and Internet to Disambiguate Word Senses
Using unsupervised word sense disambiguation to ... - INESC-ID
A Comparative Evaluation of Word Sense Disambiguation Algorithms
Using Meaning Aspects for Word Sense Disambiguation
Semi-supervised Word Sense Disambiguation ... - ResearchGate
Word Sense Disambiguation is Fundamentally Multidimensional
Word Sense Disambiguation: An Empirical Survey - International ...
KU: Word Sense Disambiguation by Substitution - Deniz Yuret's ...
Word-Sense Disambiguation for Machine Translation
Word Sense Disambiguation Using Association Rules: A Survey
Similarity-based Word Sense Disambiguation
Towards Word Sense Disambiguation of Polish - Proceedings of the ...
Word Sense Disambiguation with Pictures - CLAIR
Ch7. word sense disambiguation
Unsupervised learning of word sense disambiguation rules ... - CLAIR
Word Sense Disambiguation with Pictures - CiteSeerX