28.01.2015 Views

Slides in PDF - of Marcus Hutter

Slides in PDF - of Marcus Hutter

Slides in PDF - of Marcus Hutter

SHOW MORE
SHOW LESS

Create successful ePaper yourself

Turn your PDF publications into a flip-book with our unique Google optimized e-Paper software.

<strong>Marcus</strong> <strong>Hutter</strong> - 63 - Universal Induction & Intelligence<br />

More Stuff / Critique / Problems<br />

• Prior knowledge y can be <strong>in</strong>corporated by us<strong>in</strong>g “subjective” prior<br />

w U ν|y = 2−K(ν|y) or by prefix<strong>in</strong>g observation x by y.<br />

• Additive/multiplicative constant fudges and U-dependence is <strong>of</strong>ten<br />

(but not always) harmless.<br />

• Incomputability: K and M can serve as “gold standards” which<br />

practitioners should aim at, but have to be (crudely) approximated<br />

<strong>in</strong> practice (MDL [Ris89], MML [Wal05], LZW [LZ76], CTW [WSTT95],<br />

NCD [CV05]).<br />

• The M<strong>in</strong>imum Description Length Pr<strong>in</strong>ciple:<br />

M(x) ≈ 2 −K U (x) ≈ 2 −K T (x) . Predict y <strong>of</strong> highest M(y|x) is<br />

approximately same as MDL: Predict y <strong>of</strong> smallest K T (xy).

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!