12.01.2015 Views

Evolutionary Computation : A Unified Approach

Evolutionary Computation : A Unified Approach

Evolutionary Computation : A Unified Approach

SHOW MORE
SHOW LESS

Create successful ePaper yourself

Turn your PDF publications into a flip-book with our unique Google optimized e-Paper software.

58 CHAPTER 4. A UNIFIED VIEW OF SIMPLE EAS<br />

lation in less than 20 generations. The reason is straightforward: with a finite population,<br />

any stochastic selection method is likely to result in a loss of diversity simply because of<br />

sampling error. This is a well-understood phenomenon in biology and results in populations<br />

exhibiting “genetic drift”. In our example, having disabled reproductive variation, this effect<br />

is magnified and its compounding effects result in a loss of all but one genotype in less<br />

than 20 generations.<br />

There are two other commonly used selection techniques, tournament selection and<br />

fitness-proportional selection, that can be characterized in a similar manner. Tournament<br />

selection involves randomly selecting k individuals using a uniform probability distribution,<br />

and then selecting the best (or worst) individual from the k competitors as the winner (or<br />

loser). If n individuals need to be selected, n such tournaments are performed (with replacement)<br />

on the selection pool. The effect is to implicitly impose a probability distribution on<br />

the selection pool without explicit calculation and assignment of probabilities. In the case<br />

of binary tournaments (k = 2), the implicit distribution can be shown to be equivalent (in<br />

expectation) to linear ranking, and produces curves identical to the linear ranking curve in<br />

figure 4.6. If we increase the tournament size to k = 3, the implicit probability distribution<br />

changes from linear ranking to quadratic ranking with more probability mass shifted toward<br />

the best. With each increase in the tournament size k, selection becomes more elitist.<br />

More difficult to characterize is fitness-proportional selection, in which each individual<br />

in the selection pool is assigned the probability f i /f sum ,wheref i is the fitness of individual<br />

i, andf sum is the total fitness of all the individuals in the current selection pool. The result<br />

is a dynamically changing probability distribution that can be quite elitist in the early<br />

generations when there is a wide range of fitness values, and typically evolves to a nearly<br />

flat uniform distribution in the later stages, as the population becomes more homogeneous<br />

and the range of fitness values is quite narrow.<br />

As we will see in chapter 6, it can be shown formally that the various selection schemes<br />

can be ranked according to selection pressure strength. Of the ones we have discussed so<br />

far, the ranking from weakest to strongest is:<br />

• uniform<br />

• fitness-proportional<br />

• linear ranking and binary tournament<br />

• nonlinear ranking and tournaments with k>2<br />

• truncation<br />

4.3.1 Choosing Selection Mechanisms<br />

How do we use this knowledge about selection mechanisms when designing an EA There<br />

are two places in simple EAs where selection occurs: when choosing parents to produce<br />

offspring, and when choosing which individuals will survive. The cumulative effect is to<br />

control the focus of search in future generations. If the combined selection pressure is too<br />

strong, an EA is likely to converge too quickly to a suboptimal region of the space. As we<br />

saw in the previous section, even an EA with uniform parent selection and linear ranking

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!