18.10.2014 Views

Delta-Bar-Delta and Extended Delta-Bar-Delta - Computer Science

Delta-Bar-Delta and Extended Delta-Bar-Delta - Computer Science

Delta-Bar-Delta and Extended Delta-Bar-Delta - Computer Science

SHOW MORE
SHOW LESS

You also want an ePaper? Increase the reach of your titles

YUMPU automatically turns print PDFs into web optimized ePapers that Google loves.

<strong>Extended</strong> <strong>Delta</strong> <strong>Bar</strong> <strong>Delta</strong><br />

- Similar to st<strong>and</strong>ard <strong>Delta</strong> <strong>Bar</strong> <strong>Delta</strong>, but with<br />

the addition of a momentum coefficient<br />

- Momentum allows previous weight changes to<br />

influence future weight changes<br />

- Can help a network surpass a local minimum<br />

instead of being trapped, allowing for a better<br />

end result<br />

13

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!