11.07.2015 Views

Foundations of Induction - of Marcus Hutter

Foundations of Induction - of Marcus Hutter

Foundations of Induction - of Marcus Hutter

SHOW MORE
SHOW LESS

You also want an ePaper? Increase the reach of your titles

YUMPU automatically turns print PDFs into web optimized ePapers that Google loves.

<strong>Marcus</strong> <strong>Hutter</strong> - 32 - <strong>Foundations</strong> <strong>of</strong> <strong>Induction</strong>Sequential Decision TheorySetup: For t = 1, 2, 3, 4, ...Given sequence x 1 , x 2 , ..., x t−1(1) predict/make decision y t ,(2) observe x t ,(3) suffer loss Loss(x t , y t ),(4) t → t + 1, goto (1)Goal: Minimize expected Loss.Greedy minimization <strong>of</strong> expected loss is optimal if:Important: Decision y t does not influence env. (future observations).Loss function is known.Problem: Expectation w.r.t. what?Solution: W.r.t. universal distribution M if true distr. is unknown.

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!