SRI-LM toolkit

More documents

Recommendations

Info

Witten-Bell Discounting 14
Witten-Bell Discounting • Key Concept—Things Seen Once: Use the count of things you’ve seen once to help estimate the count of things you’ve never seen • So we estimate the total probability mass of all the zero N-grams with the number of types divided by the number of tokens plus observed types: i: ∑ c i p = T * i = 0 N + T N : the number of tokens T : observed types 15
Page 1 and 2: SRI-LM toolkit 2003/12/16 Louis Tsa
Page 3 and 4: Create language model ~ W = arg max
Page 5 and 6: Vocabulary (Lexicon2003-72k.txt)
Page 7 and 8: 以 \data\ 開頭 LM Format (ssp.n
Page 9 and 10: Good-Turing Discounting and 預設
Page 11 and 12: Good-Turing Discounting Parameters
Page 13: • Take the conditional probabilit
Page 17 and 18: Witten-Bell Discounting p * i ci =
Page 19 and 20: • For bigram ∑ p Witten-Bell Di
Page 21 and 22: P abs Smoothing absolute discountin

SRI-LM toolkit

Create successful ePaper yourself

Delete template?

Save as template?