28.01.2015 Views

Slides in PDF - of Marcus Hutter

Slides in PDF - of Marcus Hutter

Slides in PDF - of Marcus Hutter

SHOW MORE
SHOW LESS

You also want an ePaper? Increase the reach of your titles

YUMPU automatically turns print PDFs into web optimized ePapers that Google loves.

<strong>Marcus</strong> <strong>Hutter</strong> - 51 - Universal Induction & Intelligence<br />

Priors from Prefix Codes<br />

• Let Code(H ν ) be a prefix code <strong>of</strong> hypothesis H ν .<br />

• Def<strong>in</strong>e complexity Kw(ν) :=Length(Code(H ν ))<br />

• Choose prior w ν = p(H ν ) = 2 −Kw(ν)<br />

⇒ ∑ ν∈M w ν ≤ 1 is semi-probability (by Kraft).<br />

• How to choose a Code and hypothesis space M <br />

• Praxis: Choose a code which is reasonable for your problem<br />

and M large enough to conta<strong>in</strong> the true model.<br />

• Theory: Choose a universal code and consider “all” hypotheses ...

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!