Slides in PDF - of Marcus Hutter
Slides in PDF - of Marcus Hutter
Slides in PDF - of Marcus Hutter
You also want an ePaper? Increase the reach of your titles
YUMPU automatically turns print PDFs into web optimized ePapers that Google loves.
<strong>Marcus</strong> <strong>Hutter</strong> - 51 - Universal Induction & Intelligence<br />
Priors from Prefix Codes<br />
• Let Code(H ν ) be a prefix code <strong>of</strong> hypothesis H ν .<br />
• Def<strong>in</strong>e complexity Kw(ν) :=Length(Code(H ν ))<br />
• Choose prior w ν = p(H ν ) = 2 −Kw(ν)<br />
⇒ ∑ ν∈M w ν ≤ 1 is semi-probability (by Kraft).<br />
• How to choose a Code and hypothesis space M <br />
• Praxis: Choose a code which is reasonable for your problem<br />
and M large enough to conta<strong>in</strong> the true model.<br />
• Theory: Choose a universal code and consider “all” hypotheses ...