Statistical Language Models based on Neural Networks - Faculty of ...
Statistical Language Models based on Neural Networks - Faculty of ...
Statistical Language Models based on Neural Networks - Faculty of ...
Create successful ePaper yourself
Turn your PDF publications into a flip-book with our unique Google optimized e-Paper software.
Appendix C: Example <strong>of</strong> decoded<br />
utterances after rescoring<br />
(WSJ-Kaldi setup).<br />
Rescored with 5-gram model, modified Kneser-Ney smoothed with no count cut<strong>of</strong>fs<br />
(16.60% WER <strong>on</strong> full Eval 93 set) and RNN LMs (13.11% WER); differences are<br />
highlighted by red color, the examples are first sentences in the Eval 93 set that<br />
differ after rescoring (not manually chosen):<br />
5-gram: IN TOKYO FOREIGN EXCHANGE TRADING YESTERDAY THE UNIT<br />
INCREASED AGAINST THE DOLLAR<br />
RNN: IN TOKYO FOREIGN EXCHANGE TRADING YESTERDAY THE YEN IN-<br />
CREASED AGAINST THE DOLLAR<br />
5-gram: SOME CURRENCY TRADERS SAID THE UPWARD REVALUATION OF<br />
THE GERMAN MARK WASN’T BIG ENOUGH AND THAT THE MARKET MAY<br />
CONTINUE TO RISE<br />
RNN: SOME CURRENCY TRADERS SAID THE UPWARD REVALUATION OF<br />
THE GERMAN MARKET WASN’T BIG ENOUGH AND THAT THE MARKET<br />
MAY CONTINUE TO RISE<br />
5-gram: MEANWHILE QUESTIONS REMAIN WITHIN THE E. M. S. WEATH-<br />
ERED YESTERDAY’S REALIGNMENT WAS ONLY A TEMPORARY SOLUTION<br />
RNN: MEANWHILE QUESTIONS REMAIN WITHIN THE E. M. S. WHETHER<br />
YESTERDAY’S REALIGNMENT WAS ONLY A TEMPORARY SOLUTION<br />
5-gram: MR. PARNES FOLEY ALSO FOR THE FIRST TIME THE WIND WITH<br />
SUEZ’S PLANS FOR GENERALE DE BELGIQUE’S WAR<br />
RNN: MR. PARNES SO LATE ALSO FOR THE FIRST TIME ALIGNED WITH<br />
SUEZ’S PLANS FOR GENERALE DE BELGIQUE’S WAR<br />
5-gram: HE SAID THE GROUP WAS MARKET IN ITS STRUCTURE AND NO<br />
ONE HAD LEADERSHIP<br />
RNN: HE SAID THE GROUP WAS ARCANE IN ITS STRUCTURE AND NO ONE<br />
HAD LEADERSHIP<br />
127