AD Tutorial at the TU Berlin
AD Tutorial at the TU Berlin
AD Tutorial at the TU Berlin
Create successful ePaper yourself
Turn your PDF publications into a flip-book with our unique Google optimized e-Paper software.
Univari<strong>at</strong>e Taylor Propag<strong>at</strong>ion on M<strong>at</strong>rices (UTPM)<br />
Applic<strong>at</strong>ion of Newton’s Method to defining equ<strong>at</strong>ions<br />
Defining equ<strong>at</strong>ions of <strong>the</strong> QR decomposition:<br />
0<br />
0<br />
0<br />
D<br />
= [Q] D [R] D − [A] D<br />
D<br />
= [Q] T D [Q] D − I<br />
D<br />
= P L ◦ [R] D ,<br />
where (P L ) ij = δ i>j and element-wise multiplic<strong>at</strong>ion ◦.<br />
Defining equ<strong>at</strong>ions of <strong>the</strong> symmetric eigenvalue decomposition<br />
0<br />
0<br />
0<br />
D<br />
= [Q] T D [A] D[Q] D − [Λ] D<br />
D<br />
= [Q] T D [Q] D − I<br />
D<br />
= (P L + P R ) ◦ [Λ] D .<br />
Defining equ<strong>at</strong>ions of <strong>the</strong> Cholesky Decomposition<br />
etc...<br />
0<br />
0<br />
0<br />
D<br />
= [L] D [L] T D − [a] D<br />
D<br />
= P D ◦ [L] D − I<br />
D<br />
= P R ◦ [L] D .<br />
Sebastian F. Walter, HU <strong>Berlin</strong> () Not So Short <strong>Tutorial</strong> OnAlgorithmic Differenti<strong>at</strong>ion Wednesday, 04.06.2010 25 / 39