06.07.2014 Views

A Treebank-based Investigation of IPP-triggering Verbs in Dutch

A Treebank-based Investigation of IPP-triggering Verbs in Dutch

A Treebank-based Investigation of IPP-triggering Verbs in Dutch

SHOW MORE
SHOW LESS

Create successful ePaper yourself

Turn your PDF publications into a flip-book with our unique Google optimized e-Paper software.

[...]<br />

den<br />

ersten<br />

Gipfel<br />

[...]<br />

[...]<br />

<br />

<br />

<br />

<br />

<br />

<br />

<br />

<br />

<br />

[...]<br />

[...]<br />

le<br />

premier<br />

sommet<br />

[...]<br />

[...]<br />

<br />

<br />

<br />

<br />

<br />

<br />

<br />

<br />

<br />

[...]<br />

Figure 1: Sample KAF annotation for a German-French sentence pair<br />

The last step evaluates how well did the MT system translate the l<strong>in</strong>guistic<br />

phenomena <strong>of</strong> <strong>in</strong>terest. The evaluation is <strong>based</strong> on n-gram similarity, thus count<strong>in</strong>g<br />

the overlapp<strong>in</strong>g word sequences between the hypothesis (automatic translation)<br />

and the reference (the previously identified checkpo<strong>in</strong>t <strong>in</strong>stances). The evaluation<br />

module requires as <strong>in</strong>put the source and target language texts <strong>in</strong> KAF format, as<br />

well as the word alignments between them, the XML file produced at the previous<br />

step and the automatic translation to be evaluated. Each matched <strong>in</strong>stance is<br />

evaluated separately and, on this basis, the f<strong>in</strong>al score for the MT system is be<strong>in</strong>g<br />

computed. Figure 3 presents the evaluation <strong>of</strong> the noun phrases <strong>in</strong> figure 1. In<br />

this case, the hypothesis translation conta<strong>in</strong>s all the possible n-grams identified <strong>in</strong><br />

the reference (6 variants for the 3-word phrase le premier sommet), so the <strong>in</strong>stance<br />

receives the maximum score (6/6).<br />

148

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!