PPT - 数据工程与知识工程教育部重点实验室

Comparison between different models
LDA Mixture of Unigram BTM
l Document level topic
distribution
– Suffer sparsity of the doc!
l Model the generation of
each word
– Ignore context
l Corpus level topic
distribution
– Alleviate doc sparsity
l Single topic assumption in
each document
– Too strong assumption
l Corpus level topic
distribution
– Alleviate doc sparsity
l Model the generation of
word pairs
– Leverage context