27.10.2013 Views

Helmholtz Machines and Wake-Sleep Learning - Gatsby ...

Helmholtz Machines and Wake-Sleep Learning - Gatsby ...

Helmholtz Machines and Wake-Sleep Learning - Gatsby ...

SHOW MORE
SHOW LESS

Create successful ePaper yourself

Turn your PDF publications into a flip-book with our unique Google optimized e-Paper software.

Figure 1: <strong>Helmholtz</strong> machine. A) Structure of a three-layer <strong>Helmholtz</strong><br />

machine, with generative weights <strong>and</strong> biases (dashed) <strong>and</strong> recognition<br />

weights <strong>and</strong> biases Ê (solid). B) H<strong>and</strong>written digit example. The left column<br />

shows eight samples from a training set of binarised, ¢ , h<strong>and</strong>written<br />

‘9’s; the right column shows eight samples produced by the generative<br />

model after training. The training set is as described in Hinton et al (1995).<br />

11

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!