A computational grammar and lexicon for Maltese

2.4.4 Coverage
Abstract function implementation
The following functions from the NumeralTransfer module were not implemented in the Maltese
grammar:
active2passive dconcat digits2num digits2numeral dn dn10 dn100 dn1000 dn1000000a dn1000000b
dn1000000c nd nd10 nd100 nd1000 nd1000000 num2digits
A bug in the GF compiler means that no warning is generated when these functions have no
linearisation rules. However, these functions are in fact not implemented in any of the language
implementations in the RGL and thus were not deemed essential.
Regression test results
Table 2.20 shows the results of running the treebank regression tests against the version of the
Maltese resource grammar at the time of publication. As can be seen, a considerable number
of linearisations (15%) do not match their gold standards. These failures can be generally
attributed to one of the following:
• Irregular vowel changes in verbs (require more forms in the lexicon).
• Incorrect selection of stem form and/or suffix form when joining enclitic pronouns.
• Insufficient work on relative clauses.
• Errors in the use of the copula kien in some tense combinations.
• Bugs in the numerals module.
It is worth pointing out that the totals in the table give a measure to how well the grammar
covers the treebank set itself; There is no measure however of how completely or evenly the
treebanks cover the Maltese language in general. Note also that all the testing carried out is
only evaluating linearisation; no testing is performed in the parsing direction.
Table 2.20: Treebank list and testing results
Name Description Trees Passed Rate (%)
ap Adjectival phrases 2 1 50.0
articles Articles 5 5 100.0
exx-resource
Wide-coverage treebank from testsuite/libraries/
in the GF repository
186 111 59.7
n-clitics Enclitic pronouns on nouns 49 35 71.4
np Noun phrases 1 1 100.0
Continued on next page
42