Pattern Classification

Backpropagation Algorithm30• More specifically, the “backpropagation oferrors” algorithm• During training, an error must be propagatedfrom the output layer back to the hidden layer tolearn the input-to-hidden weights• It is gradient descent in a layered network• Exact behavior of the learning algorithmdepends on the starting point• Start the process with random values of weights;in practice you learn many networks withdifferent initializationsPattern Classification, Chapter 6