Neural Network Toolbox User's Guide

AcknowledgmentsAcknowledgmentsThe authors would like to thank:Martin Hagan of Oklahoma State University for providing the originalLevenberg-Marquardt algorithm in the Neural Network Toolbox version 2.0and various algorithms found in version 3.0, including the new reducedmemory use version of the Levenberg-Marquardt algorithm, the conjugategradient algorithm, RPROP, and generalized regression method. Martin alsowrote Chapter 5 and Chapter 6 of this toolbox. Chapter 5 on Chapter describesnew algorithms, suggests algorithms for pre- and post-processing of data, andpresents a comparison of the efficacy of various algorithms. Chapter 6 oncontrol system applications describes practical applications including neuralnetwork model predictive control, model reference adaptive control, and afeedback linearization controller.Joe Hicklin of The MathWorks for getting Howard into neural networkresearch years ago at the University of Idaho, for encouraging Howard to writethe toolbox, for providing crucial help in getting the first toolbox version 1.0 outthe door, and for continuing to be a good friend.Jim Tung of The MathWorks for his long-term support for this project.Liz Callanan of The MathWorks for getting us off the such a good start withthe Neural Network Toolbox version 1.0.Roy Lurie of The MathWorks for his vigilant reviews of the developingmaterial in this version of the toolbox.Matthew Simoneau of The MathWorks for his help with demos, test suiteroutines, for getting user feedback, and for helping with other toolbox matters.Sean McCarthy for his many questions from users about the toolboxoperationJane Carmody of The MathWorks for editing help and for always being at herphone to help with documentation problems.Donna Sullivan and Peg Theriault of The MathWorks for their editing andother help with the Mac document.Jane Price of The MathWorks for getting constructive user feedback on thetoolbox document and its Graphical User’s Interface.xiii