December 11-16 2016 Osaka Japan
W16-46
W16-46
Create successful ePaper yourself
Turn your PDF publications into a flip-book with our unique Google optimized e-Paper software.
former system can translate more than 90% of sentences with 4 or 5 JPO adequacy score, however, the<br />
latter systems can only translate 10 or 20% of sentences with 4 or 5 JPO adequacy score (see Figure 2).<br />
Task<br />
System No.<br />
BLEU<br />
RIBES<br />
AMFM<br />
HUMAN<br />
HUMAN<br />
(top rank)<br />
JPO adq.<br />
JPO adq.<br />
(top rank)<br />
en-ja 1 31.32 0.7599 0.7467 39.000 55.250 --- 4.02<br />
zh-ja 1 39.75 0.8437 0.7695 32.500 63.750 --- 3.94<br />
JPCzh-ja<br />
1 41.05 0.8270 0.7350 35.500 ---<br />
46.500<br />
2 40.95 0.8280 0.7451 39.000 ---<br />
3.44<br />
1 71.51 0.9447 0.8664 -3.000 ---<br />
JPCko-ja 2 68.78 0.94<strong>11</strong> 0.8517 --- 21.750 --- 4.62<br />
3 62.33 0.9271 0.8180 21.750 4.56<br />
HINDENen-hi 1 <strong>11</strong>.75 0.6719 0.6508 0.000 57.250 2.48 2.55<br />
1 7.81 0.5793 0.4681 13.750 2.00<br />
HINDENhi-ja<br />
2 7.66 0.5860 0.4731 10.000 ---<br />
39.750<br />
3 7.47 0.5823 0.4549 --- ---<br />
2.13<br />
4 2.36 0.4402 0.3628 --- ---<br />
Table 7: Evaluation results (Segmenter for ja is JUMAN)<br />
( % )<br />
100<br />
90<br />
80<br />
70<br />
60<br />
50<br />
40<br />
30<br />
20<br />
1<br />
2<br />
3<br />
4<br />
5<br />
10<br />
0<br />
JPCko-ja HINDENen-hi HINDENhi-ja<br />
Figure 2: Evaluation results by the JPO adequacy<br />
5 Conclusion<br />
System descriptions, experimental settings and experimental results of EHR group were described. We<br />
participate in the 6 tasks and submitted 12 systems’ outputs. We can recognize our translation techniques<br />
are effective. They are iterative reordering, system combination and pivoting with reordering.<br />
Several remaining issues are as follows. To improve parsing accuracy such that reordering accuracy<br />
be higher. To improve English-Hindi and Hindi-<strong>Japan</strong>ese translation accuracy that are largely lower<br />
than that of other language pairs. To challenge machine translations for other Asian languages such as<br />
Indonesian, Thai, Vietnamese, Mongolian and so on.<br />
Reference<br />
Mauro Cettolo, Christian Girardi, and Marcello Federico. 2012. WIT 3 : Web Inventory of Transcribed and Translated<br />
Talks. Proceedings of the <strong>16</strong>th EAMT Conference, pages 261-<strong>16</strong>8.<br />
Pi-Chuan Chang, Michel Galley and Chris Manning. 2008. Optimizing Chinese Word Segmentation for Machine<br />
Translation Performance. Proceedings of the Third Workshop on Statistical Machine Translation, pages 224-<br />
232.<br />
<strong>11</strong>7