26.12.2013 Views

AI - a Guide to Intelligent Systems.pdf - Member of EEPIS

AI - a Guide to Intelligent Systems.pdf - Member of EEPIS

AI - a Guide to Intelligent Systems.pdf - Member of EEPIS

SHOW MORE
SHOW LESS

You also want an ePaper? Increase the reach of your titles

YUMPU automatically turns print PDFs into web optimized ePapers that Google loves.

194<br />

ARTIFICIAL NEURAL NETWORKS<br />

where y m;i is the ith element <strong>of</strong> the actual output vec<strong>to</strong>r Y m , and x m;j is<br />

the jth element <strong>of</strong> the input vec<strong>to</strong>r X m . In matrix form,<br />

X m ¼ Y m ;<br />

Y m ¼ sign ðWX m<br />

m ¼ 1; 2; ...; M<br />

hÞ<br />

If all fundamental memories are recalled perfectly we may proceed <strong>to</strong><br />

the next step.<br />

Step 3:<br />

Retrieval<br />

Present an unknown n-dimensional vec<strong>to</strong>r (probe), X, <strong>to</strong> the network<br />

and retrieve a stable state. Typically, the probe represents a corrupted or<br />

incomplete version <strong>of</strong> the fundamental memory, that is,<br />

X 6¼ Y m ;<br />

m ¼ 1; 2; ...; M<br />

(a)<br />

Initialise the retrieval algorithm <strong>of</strong> the Hopfield network by setting<br />

x j ð0Þ ¼x j<br />

j ¼ 1; 2; ...; n<br />

and calculate the initial state for each neuron<br />

0<br />

1<br />

y i ð0Þ ¼sign@<br />

Xn<br />

w ij x j ð0Þ A; i ¼ 1; 2; ...; n<br />

j¼1<br />

i<br />

where x j ð0Þ is the jth element <strong>of</strong> the probe vec<strong>to</strong>r X at iteration<br />

p ¼ 0, and y i ð0Þ is the state <strong>of</strong> neuron i at iteration p ¼ 0.<br />

In matrix form, the state vec<strong>to</strong>r at iteration p ¼ 0 is presented as<br />

Yð0Þ ¼sign ½WXð0Þ<br />

h Š<br />

(b) Update the elements <strong>of</strong> the state vec<strong>to</strong>r, YðpÞ, according <strong>to</strong> the<br />

following rule:<br />

0<br />

1<br />

y i ðp þ 1Þ ¼sign@<br />

Xn<br />

w ij x j ðpÞ A<br />

j¼1<br />

i<br />

Neurons for updating are selected asynchronously, that is,<br />

randomly and one at a time.<br />

Repeat the iteration until the state vec<strong>to</strong>r becomes unchanged,<br />

or in other words, a stable state is achieved. The condition for<br />

stability can be defined as:<br />

0<br />

1<br />

y i ðp þ 1Þ ¼sign@<br />

Xn<br />

w ij y j ðpÞ A; i ¼ 1; 2; ...; n ð6:24Þ<br />

or, in matrix form,<br />

j¼1<br />

i<br />

Yðp þ 1Þ ¼sign ½WYðpÞ h Š ð6:25Þ

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!