spline cubic, 722 spline cubic, locality, 731 spline shape preserving, 735 inverse interpolation, 292 inverse iteration, 439 preconditioned, 444 inverse matrix, 70 invertible matrix, 70, 71 iteration Halley’s, 287 Euler’s, 287 quadratical inverse interpolation, 287 iteration function, 240, 258 iterative method convergence, 240 IVP, 829 Jacobi preconditioner, 376 Jacobian, 265, 300 kinetics of chemical reaction, 920 Kirchhoff law, 67 line search, 337 linear complexity, 43 linear correlation, 492 linear electric circuit, 67 linear filter, 541 linear operator diagonalization, 609 linear ordinary differential equation, 394 linear regression, 46 linear system of equations, 66 multiple right hand sides, 82 local a posteriori erorr estimation for adaptive quadrature, 813 local convergence Newton method, 318 local linearization, 300 local mesh refinement for adaptive quadrature, 813 Lotka-Volterra ODE, 824 low pass filter, 574 lower triangular matrix, 86 LU-decomposition Konvergenz Algebraische, Quadratur, 810 Kronecker symbol, 24 Krylov space, 353 for Ritz projection, 460 L-stable, 931 Lagrange multiplier, 526 Landau-O, 41 Lapack, 78 Least squares with linear constraint, 525 least squares, 503 total, 524 least squares problem conditioning, 505 Lebesgue constant, 678 Lebesgue constant, 643 Levinson algorithm, 622 limit cycle, 922 limiter, 716 blocked, 94 computational costs, 92 envelope aware, 169 existence, 88 in place, 92 LU-factorization envelope aware, 169 of sparse matrices, 152 machine number, 108 exponent, 108 machine numbers, 109 distribution, 108 machine precision, 112 mantissa, 108 Markov chain, 411, 619 stationary distribution, 413 Matlab, 19 Matrix adjoint, 26 Hermitian, 400 Hermitian transposed, 26 Ôº ½¿º Ôº ½¿º normal, 399 obere Dreiecks, 227 obere Hessenberg, 221 skew-Hermitian, 400 transposed, 26 unitary, 400 matrix banded, 164 condition number, 132 dense, 139 diagonal, 86 envelope, 166 Fourier, 563 Hermitian, 179 Hessian, 306 lower triangular, 86 normalized, 86 orthogonal, 194 positive definite, 179 positive semi-definite, 179 rank, 70 sine, 605 Quasi-Newton, 323 midpoint rule, 767, 862 Milne rule, 770 min-max theorem, 435 minimal residual methods, 384 model function, 277 Modellfunktionsverfahren, 277 modification technique QR-factorization, 220 monomial representation of a polynomial, 631 monomials, 631 multi-point methods, 278, 288 multiplicity geometric, 397 NaN, 110 Ncut, 430 nested subspaces, 350 Newton basis, 656 sparse, 139 structurally symmetric, 172 symmetric, 179 tridiagonal, 164 unitary, 194 upper triangular, 86 matrix algebra, 39 matrix block, 26 matrix faktorization, 84 matrix norm, 116 column sums, 117 row sums, 117 matrix product, 31 matrix storage envelope oriented, 172 Matrixmultiplikation Blockweise, 39 Matrixnorm, 116 Submultiplikativität, 116 mesh in time, 848 Method damping, 319 damping factor, 319 monotonicity test, 320 simplified method, 307 Newton correction, 300 simplified, 317 Newton iteration, 300 numerical Differentiation, 307 termination criterion, 315 Newton method 1D, 278 damped, 318 local convergence, 318 local quadratic convergence, 312 region of convergence, 318 nodal analysis, 67, 235 nodal potentials, 67 node in electric circuit, 67 quadrature, 764 nodes, 633 Chebychev, 676 Ôº ½¿º Ôº¼ ½¿º
Chebychev nodes, 678 double, 634 for interpolation, 635 non-linear data fitting, 529 non-normalized numbers, 110 norm, 115 L 1 , 642 L 2 , 642 ∞-, 115 1-, 115 energy-, 333 Euclidean, 115 of matrix, 116 Sobolev semi-, 669 supremum, 641 normal equations, 508 extended, 526 normalized lower triangular matrix, 85 normalized triangular matrix, 86 not a number, 110 Nullstellenbestimmung Modellfunktionsverfahren, 277 orthogonal polynomials, 798 orthonormal basis, 207, 400 overflow, 110 page rank, 411 stochastic simulation, 412 partial pivoting, 98, 100 Partition of unity, 755 PCA, 481 PCG, 375 Peano Theorem of, 837 periodic sequence, 546 permutation, 102 permutation matrix, 102 Permutationsmatrix, 228 perturbation lemma, 131 Petrov-Galerkin condition, 387 phase space of an ODE, 830 Picard-Lindelöf numerical algorithm, 119 <strong>Numerical</strong> differentiation roundoff, 309 numerical Differentiation Newton iteration, 307 numerical quadrature, 761 numerical rank, 519 Obere Hessenbergmatrix, 221 ODE, 829 scalar, 831 Ohmic resistor, 68 one-point methods, 278 order of quadrature formula, 775 order of convergence, 247 fractional, 290 ordinary differential equation linear, 394 ordinary differential equation (ODE), 829 oregonator, 870 orthogonal matrix, 194 Theorem of, 837 PINVIT, 444 Pivot -wahl, 100 choice of, 99 pivot, 73, 75, 76 pivot row, 73, 76 pivoting, 95 point spread function, 586 polynomial Bernstein, 751 characteristic, 397 Lagrange, 635 polynomial space, 631 polynomiales fit, 502 potentials nodal, 67 power spectrum of a signal, 576 preconditioned CG method, 375 preconditioned inverse iteration, 444 preconditioner, 373 Ôº½ ½¿º Ôº¾ ½¿º preconditioning, 372 predator-prey model, 824 principal axis transformation, 399 principal component, 493 principal component analysis, 481 problem ill conditioned, 136 saddle point, 526 sensitivity, 136 well conditioned, 136 product rule, 306 Punkt stationär, 826 pwer method direct, 422 QR algorithm, 402 QR-algorithm with shift, 403 QR-decomposition computational costs, 209 QR-factorization, QR-decomposition, 202 quadratic convergence, 272 numerical, 519 of a matrix, 70 row rank, 71 rank-1 modification, 79 rank-1-modifications, 216 rate of convergence, 243 Rayleigh quotient, 423, 435 Rayleigh quotient iteration, 442 Rechenaufwand Gausselimination, 78 recursion 3-term, 673 regular matrix, 70 relative tolerance, 878 rem:Fspec, 564 residual quantity, 445 Riccati differential equation, 830, 842 richt hand side of an ODE, 830 right hand side vector, 66, 119 Ritz projection, 456, 459 quadratic eigenvalue problem, 392 quadratic functional, 334 quadratic inverse interpolation, 294 quadratical inverse interpolation, 287 quadrature adaptive, 812 polynomial formulas, 767 quadrature formula, 764 order, 775 quadrature node, 764 quadrature numerical, 761 quadrature weight, 764 Quasi-Newton Method, 324 Quasi-Newton method, 323 Radau RK-method order 3, 932 order 5, 932 radiative heat transfer, 548 rank column rank, 71 computation, 488 Ritz value, 461 Ritz vector, 461 root of unity, 560 rounding up, 111 roundoff for numerical differentiation, 309 row major matrix format, 27 row permutation, 233 row sum norm, 117 row transformation, 72, 83 Rundung, 111 Runge-Kutta increments, 864, 928 Runge-Kutta method, 864, 928 L-stable, 931 Runge-Kutta methods stability function, 909, 930 saddle point problem, 526 scalar ODE, 831 scaling of a matrix, 37 Ôº¿ ½¿º Ôº ½¿º
- Page 1 and 2:
2 Direct Methods for Linear Systems
- Page 3 and 4:
III Integration of Ordinary Differe
- Page 5 and 6:
Extra questions for course evaluati
- Page 7 and 8:
1.1.2 Matrices Matrices = two-dimen
- Page 9 and 10:
Remark 1.2.1 (Row-wise & column-wis
- Page 11 and 12:
1.3 Complexity/computational effort
- Page 13 and 14:
Syntax of BLAS calls: The functions
- Page 15 and 16:
4 { 5 a ssert ( this−>n==B. n &&
- Page 17 and 18:
34 long r t 0 ; 35 bool bStarted ;
- Page 19 and 20:
Obviously, left multiplication with
- Page 21 and 22:
❶: elimination step, ❷: backsub
- Page 23 and 24:
A direct way to LU-decomposition:
- Page 25 and 26:
Solution of LŨx = b: x ( ) 2ǫ = 1
- Page 27 and 28:
numerically equivalent ˆ= same res
- Page 29 and 30:
Code 2.4.8: Finding outeps in MATLA
- Page 31 and 32:
Terminology: Def. 2.5.5 introduces
- Page 33 and 34:
Example 2.5.5 (Instability of multi
- Page 35 and 36:
Note: sensitivity gauge depends on
- Page 37 and 38:
6 for i =1:20 7 n = 2^ i ; m = n /
- Page 39 and 40:
0 20 40 60 80 100 120 140 160 180 2
- Page 41 and 42:
Use sparse matrix format: 10 1 10 2
- Page 43 and 44:
Envelope-aware LU-factorization: 0
- Page 45 and 46:
0 20 40 60 80 100 0 20 0 20 0 20 De
- Page 47 and 48:
Evident: symmetry of à − bbT a 1
- Page 49 and 50:
9 ylabel ( ’ { \ b f c o n d i t
- Page 51 and 52:
Mapping a ∈ K n to a multiple of
- Page 53 and 54:
Then store G ij (a,b) as triple (i,
- Page 55 and 56:
Recall: e i ˆ= i-th unit vector Ch
- Page 57 and 58:
Computation of Choleskyfactorizatio
- Page 59 and 60:
1 ∃ (partial) cyclic row permutat
- Page 61 and 62:
Definition 3.1.3 (Local and global
- Page 63 and 64:
Example 3.1.6 (quadratic convergenc
- Page 65 and 66:
k |x (k) − π| L 1−L |x (k) −
- Page 67 and 68:
(x (k) ) k∈N0 Cauchy sequence ➤
- Page 69 and 70:
Termination criterion for contracti
- Page 71 and 72:
Given x (k) ∈ I, next iterate :=
- Page 73 and 74:
secant method ( MATLAB implementati
- Page 75 and 76:
Assuming p = 1: p > 1: ∥ C ∥e (
- Page 77 and 78:
This is a simple computation: DG(x)
- Page 79 and 80:
k x (k) ǫ k := ‖x ∗ − x (k)
- Page 81 and 82:
Code 3.4.14: Damped Newton method (
- Page 83 and 84:
MATLAB-CODE: Broyden method (3.4.11
- Page 85 and 86:
Algorithm 4.1.3 (Steepest descent).
- Page 87 and 88:
Example 4.1.8 (Convergence of gradi
- Page 89 and 90:
4.2.1 Krylov spaces Definition 4.2.
- Page 91 and 92:
Remark 4.2.3 (A posteriori terminat
- Page 93 and 94:
10 figure ; view ([ −45 ,28]) ; m
- Page 95 and 96:
Idea: Solve Ax = b approximately in
- Page 97 and 98:
eplaced with κ(A) ! 4.4.2 Iteratio
- Page 99 and 100:
For circuit of Fig. 55 at angular f
- Page 101 and 102:
(Linear) generalized eigenvalue pro
- Page 103 and 104:
10 0 10 1 matrix size n d = eig(A)
- Page 105 and 106:
0 50 100 150 200 250 300 350 400 45
- Page 107 and 108:
1 2 3 k ρ (k) EV ρ (k) EW ρ (k)
- Page 109 and 110:
✬ ✩ ✬ ✩ Lemma 5.3.4 (Ncut a
- Page 111 and 112:
In other words, roundoff errors may
- Page 113 and 114:
Theory: linear convergence of (5.3.
- Page 115 and 116:
error in eigenvalue 10 0 10 −2 10
- Page 117 and 118:
✬ Residuals r 0 ,...,r m−1 gene
- Page 119 and 120:
Algebraic view of the Arnoldi proce
- Page 121 and 122:
5.5 Singular Value Decomposition Re
- Page 123 and 124:
Illustration: columns = ONB of Im(A
- Page 125 and 126:
✬ Theorem 5.5.7 (best low rank ap
- Page 127 and 128:
Reassuring: Remark 6.0.4 (Pseudoinv
- Page 129 and 130:
Consider the linear least squares p
- Page 131 and 132:
Goal: Euclidean distance of y ∈ R
- Page 133 and 134:
6.5 Non-linear Least Squares If (6.
- Page 135 and 136:
0 2 4 6 8 10 12 14 16 value of ∥
- Page 137 and 138:
Definition 7.1.1 (Discrete convolut
- Page 139 and 140:
Expand a 0 ,...,a n−1 and b 0 , .
- Page 141 and 142:
(7.2.2) is a simple consequence of
- Page 143 and 144:
Dominant coefficients of a signal a
- Page 145 and 146:
11 c = f f t ( y ) ; 12 13 figure (
- Page 147 and 148:
Two-dimensional trigonometric basis
- Page 149 and 150:
8 end 9 t1 = min ( t1 , toc ) ; 10
- Page 151 and 152:
Step II: for k =: rq + s, 0 ≤ r <
- Page 153 and 154:
MATLAB-CODE Sine transform function
- Page 155 and 156:
△ Example 7.5.2 (Linear regressio
- Page 157 and 158:
[23, Ch. IX] presents the topic fro
- Page 159 and 160:
Code 8.1.3: Horner scheme, polynomi
- Page 161 and 162:
1.2 equality in (8.2.10) for y := (
- Page 163 and 164:
ecursive definition: p i (t) ≡ y
- Page 165 and 166:
a 1 = y 1 − a 0 t 1 − t 0 = y 1
- Page 167 and 168:
Observations: Strong oscillations o
- Page 169 and 170:
−1 −0.8 −0.6 −0.4 −0.2 0
- Page 171 and 172:
8.5.3 Chebychev interpolation: comp
- Page 173 and 174:
9.1 Shape preserving interpolation
- Page 175 and 176:
9.2.2 Piecewise polynomial interpol
- Page 177 and 178:
Interpolation of the function: f(x)
- Page 179 and 180:
2 % Plot convergence of approximati
- Page 181 and 182:
9.4 Splines Definition 9.4.1 (Splin
- Page 183 and 184:
➤ Linear system of equations with
- Page 185 and 186:
y i+1 t i−1 t i t i+1 y i−1 y i
- Page 187 and 188:
35 h= d i f f ( t ) ; 36 d e l t a
- Page 189 and 190: 1 0.9 Function f 1 0.9 Function f
- Page 191 and 192: f 10 Numerical Quadrature Numerical
- Page 193 and 194: f • n = 1: Trapezoidal rule • n
- Page 195 and 196: For fixed local n-point quadrature
- Page 197 and 198: Equidistant trapezoidal rule (order
- Page 199 and 200: Heuristics: A quadrature formula ha
- Page 201 and 202: 20 Zeros of Legendre polynomials in
- Page 203 and 204: |quadrature error| 10 0 Numerical q
- Page 205 and 206: f f • line 9: estimate for global
- Page 207 and 208: Model: autonomous Lotka-Volterra OD
- Page 209 and 210: Example 11.1.6 (Transient circuit s
- Page 211 and 212: y y 1 y(t) y 0 t t 0 t 1 Fig. 133 e
- Page 213 and 214: for discrete evolution defined on I
- Page 215 and 216: ⇒ if y ∈ C 2 ([0, T]), then y(t
- Page 217 and 218: The implementation of an s-stage ex
- Page 219 and 220: Example 11.5.2 (Blow-up). ✸ toler
- Page 221 and 222: However, it would be foolish not to
- Page 223 and 224: 0 0.2 0.4 0.6 0.8 1 1.2 1.4 1.6 1.8
- Page 225 and 226: 4 3 2 abstol = 0.000010, reltol = 0
- Page 227 and 228: ✸ ✸ Motivated by the considerat
- Page 229 and 230: 0 1 2 3 4 5 6 u(t),v(t) 0.01 0.008
- Page 231 and 232: MATLAB-CODE : Explicit integration
- Page 233 and 234: Shorthand notation for Runge-Kutta
- Page 235 and 236: 13 Structure Preservation 13.1 Diss
- Page 237 and 238: [18] G. GOLUB AND C. VAN LOAN, Matr
- Page 239: linear in Gauss-Newton method, 538
- Page 243 and 244: x∗ n y ˆ= discrete periodic conv
- Page 245 and 246: Gaussian elimination with pivoting