08.02.2013 Views

Bernal S D_2010.pdf - University of Plymouth

Bernal S D_2010.pdf - University of Plymouth

Bernal S D_2010.pdf - University of Plymouth

SHOW MORE
SHOW LESS

You also want an ePaper? Increase the reach of your titles

YUMPU automatically turns print PDFs into web optimized ePapers that Google loves.

4.5. {REDBACK PROCESSING<br />

true vs. random<br />

distributions (baseline)<br />

K Umax<br />

-*-Nmfl)(=1<br />

-^l*nax = 3<br />

— Nmax = 4<br />

-^ Nma" = 5<br />

- Nmai^e<br />

Random<br />

Figure4.!7: Kullback-l-eibler divergence between ihc true and the approximate prior function<br />

;tfX) distribution for differeni values <strong>of</strong> kunmi and A',,, averaged over 50<br />

trials. The Kullhack-l.eibler(K-l-) divergence, on ihcy-axis, measures the crosscorrelation<br />

hdiweun an approximult- disiribuliiin und the true dislribuiiuii, and is<br />

typically used as a goodness <strong>of</strong> fit between IwiMjiscreie probahilily distributions<br />

(Kri.ston and Kiehel 2()09, Winn and Bishop 2U()5, Hinton el al. 2()()f)). The xaxis<br />

.shows the number <strong>of</strong> samples taken from the K messages. k,„iu- Kesults are<br />

ploiled for values <strong>of</strong> N„a.i ranging from I to 6 as indicated in Ihc colour legend.<br />

The dolled hori/.onia! tine shows the K-l. divergence between ihe true and a random<br />

disirihuiion, which serves as a baseline to compare the goiHlness <strong>of</strong> lit <strong>of</strong> the<br />

approximate dislrihutions.<br />

182<br />

2D

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!