Nonparametric Bayesian Discrete Latent Variable Models for ...
Nonparametric Bayesian Discrete Latent Variable Models for ...
Nonparametric Bayesian Discrete Latent Variable Models for ...
Create successful ePaper yourself
Turn your PDF publications into a flip-book with our unique Google optimized e-Paper software.
logP(F|X,σ x )<br />
K<br />
α<br />
σ x<br />
σ a<br />
−4.3<br />
−4.5<br />
15<br />
5<br />
4<br />
2<br />
1<br />
0.5<br />
0<br />
1.5<br />
1<br />
0.5<br />
10 3<br />
4.4 A Flexible Infinite <strong>Latent</strong> Feature Model<br />
conjugate sampling<br />
250 500 750 1000<br />
250 500 750 1000<br />
250 500 750 1000<br />
250 500 750 1000<br />
250 500<br />
iterations<br />
750 1000<br />
Figure 4.8: Trace plots <strong>for</strong> the Gibbs sampling using conjugacy. The sampler converges in a few<br />
iterations to the high probability regions, employing five to seven latent features.<br />
The generating value of σx is recovered.<br />
logP(F|X,σ x )<br />
K<br />
α<br />
σ x<br />
σ a<br />
−4.3<br />
10 3<br />
non−conjugate sampling<br />
−4.5<br />
0 100 200 300 400 500 600 700 800 900 1000<br />
15<br />
5<br />
4<br />
2<br />
1<br />
0.5<br />
0<br />
1.5<br />
1<br />
0.5<br />
250 500 750 1000<br />
250 500 750 1000<br />
250 500 750 1000<br />
250 500<br />
iterations<br />
750 1000<br />
Figure 4.9: Trace plots <strong>for</strong> the approximate Gibbs sampler not exploiting conjugacy with five<br />
auxiliary features <strong>for</strong> unique feature updates. Compared to the conjugate Gibbs<br />
sampler, the chain moves slower, especially <strong>for</strong> K. However the samples <strong>for</strong> all<br />
parameters have similar values to the samples from the conjugate Gibbs sampler.<br />
99