21.06.2014 Views

Numerical Methods Contents - SAM

Numerical Methods Contents - SAM

Numerical Methods Contents - SAM

SHOW MORE
SHOW LESS

Create successful ePaper yourself

Turn your PDF publications into a flip-book with our unique Google optimized e-Paper software.

✬<br />

✩<br />

➣<br />

➤<br />

Matrix A ∈ R n,n arising from nodal analysis satisfies<br />

A is s.p.d., see Lemma 2.7.4 below.<br />

• A = A T , a kk > 0 , a kj ≤ 0 for k ≠ j , (2.7.1)<br />

n∑<br />

• a kj ≥ 0 , k = 1,...,n , (2.7.2)<br />

j=1<br />

• A is regular. (2.7.3)<br />

All these properties are obvious except for the fact that A is regular.<br />

Proof of (2.7.3): By Thm. 2.0.3 it suffices to show that the nullspace of A is trivial: Ax = 0 ⇒ x =<br />

0.<br />

Pick x ∈ R n , Ax = 0, and i ∈ {1,...,n} so that<br />

|x i | = max{|x j |, j = 1,...,n} .<br />

Intermediate goal: show that all entries of x are the same<br />

Ax = 0 ⇒<br />

x i = ∑ j≠i<br />

By (2.7.2) and the sign condition from (2.7.1) we conclude<br />

∑<br />

j≠i<br />

a ij<br />

x<br />

a j ⇒ |x i | ≤ ∑ |a ij |<br />

ii<br />

j≠i<br />

Ôº½½ ¾º<br />

|a ii | |x j| . (2.7.4)<br />

|a ij |<br />

|a ii | ≤ 1 . (2.7.5)<br />

Hence, (2.7.5) combined with the above estimate (2.7.4) that tells us that the maximum is smaller<br />

equal than a mean implies |x j | = |x i | for all j = 1, ...,n. Finally, the sign condition a kj ≤ 0 for<br />

k ≠ j enforces the same sign of all x i .<br />

✸<br />

Lemma 2.7.4. A diagonally dominant Hermitian/symmetric matrix with non-negative diagonal<br />

entries is positive semi-definite.<br />

A strictly diagonally dominant Hermitian/symmetric matrix with positive diagonal entries is positive<br />

definite.<br />

✫<br />

Proof. For A = A H diagonally dominant, use inequality between arithmetic and geometric mean<br />

(AGM) ab ≤ 1 2 (a2 + b 2 ):<br />

✬<br />

✫<br />

n∑<br />

x H Ax = a ii |x i | 2 + ∑ n∑<br />

a ij¯x i x j ≥ a ii |x i | 2 − ∑ |a ij ||x i ||x j |<br />

i=1 i≠j i=1 i≠j<br />

n∑<br />

≥ a ii |x i | 2 − 1 ∑<br />

2 |a ij |(|x i | 2 + |x j | 2 )<br />

i=1 i≠j<br />

( n<br />

≥ 2<br />

1 ∑<br />

ii |x i |<br />

i=1{a 2 − ∑ ) (<br />

|a ij ||x i | 2 } + 1 ∑ n<br />

2 ii |x j |<br />

j≠i<br />

j=1{a 2 − ∑ )<br />

|a ij ||x j | 2 }<br />

i≠j<br />

n∑<br />

≥ |x i | 2( a ii − ∑ )<br />

|a ij | ≥ 0 .<br />

i=1 j≠i<br />

Theorem 2.7.5 (Gaussian elimination for s.p.d. matrices).<br />

Every symmetric/Hermitian positive definite matrix (→ Def. 2.7.1) possesses an LUdecomposition<br />

(→ Sect. 2.2).<br />

Equivalent to assertion of theorem: Gaussian elimination feasible without pivoting<br />

In fact, this theorem is a corollary of Lemma 2.2.3, because all principal minors of an s.p.d. matrix<br />

are s.p.d. themselves.<br />

Sketch of alternative self-contained proof.<br />

✪<br />

✩<br />

✪<br />

Ôº½¿ ¾º<br />

Definition 2.7.3 (Diagonally dominant matrix).<br />

A ∈ K n,n is diagonally dominant, if<br />

∑<br />

∀k ∈ {1, ...,n}:<br />

j≠k |a kj| ≤ |a kk | .<br />

The matrix A is called strictly diagonally dominant, if<br />

∑<br />

∀k ∈ {1, . ..,n}:<br />

j≠k |a kj| < |a kk | .<br />

Ôº½¾ ¾º<br />

Proof by induction: consider first step of elimination<br />

( a11 b<br />

A =<br />

T )<br />

1. step<br />

b à −−−−−−−−−−−−→<br />

Gaussian elimination<br />

(<br />

a11 b T )<br />

0 Ã − bbT .<br />

a 11<br />

Ôº½ ¾º<br />

➣ to show: Ã − bbT<br />

a s.p.d. (→ step of induction argument) 11

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!