23.02.2015 Views

Machine Learning - DISCo

Machine Learning - DISCo

Machine Learning - DISCo

SHOW MORE
SHOW LESS

You also want an ePaper? Increase the reach of your titles

YUMPU automatically turns print PDFs into web optimized ePapers that Google loves.

could involve creating board positions designed to explore particular regions<br />

of the state space.<br />

Together, the design choices we made for our checkers program produce<br />

specific instantiations for the performance system, critic; generalizer, and experiment<br />

generator. Many machine learning systems can-be usefully characterized in<br />

terms of these four generic modules.<br />

The sequence of design choices made for the checkers program is summarized<br />

in Figure 1.2. These design choices have constrained the learning task in a<br />

number of ways. We have restricted the type of knowledge that can be acquired<br />

to a single linear evaluation function. Furthermore, we have constrained this evaluation<br />

function to depend on only the six specific board features provided. If the<br />

true target function V can indeed be represented by a linear combination of these<br />

Determine Type<br />

of Training Experience<br />

1<br />

Determine<br />

Target Function<br />

I<br />

I<br />

I<br />

Determine Representation<br />

of Learned Function<br />

Linear function<br />

of six features<br />

/ \<br />

Determine<br />

<strong>Learning</strong> Algorithm<br />

I<br />

Artificial neural<br />

network<br />

...<br />

FIGURE 1.2<br />

Sununary of choices in designing the checkers learning program.

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!