v2007.11.26 - Convex Optimization

A.6. SINGULAR VALUE DECOMPOSITION, SVD 525Expressions for U , Q , and Σ follow readily from (1386),AA T U = UΣΣ T and A T AQ = QΣ T Σ (1388)demonstrating that the columns of U are the eigenvectors of AA T and thecolumns of Q are the eigenvectors of A T A. −Neil Muller et alii [201]A.6.4Pseudoinverse by SVDMatrix pseudoinverse (E) is nearly synonymous with singular valuedecomposition because of the elegant expression, given A = UΣQ TA † = QΣ †T U T ∈ R n×m (1389)that applies to all three flavors of SVD, where Σ † simply inverts nonzeroentries of matrix Σ .Given symmetric matrix A∈ S n and its diagonalization A = SΛS T(A.5.2), its pseudoinverse simply inverts all nonzero eigenvalues;A.6.5SVD of symmetric matricesA † = SΛ † S T (1390)A.6.5.0.1 Definition. Step function. (confer4.3.2.0.1)Define the signum-like quasilinear function ψ : R n → R n that takes value 1corresponding to a 0-valued entry in its argument:[ψ(a) =∆limx i →a ix i|x i | = { 1, ai ≥ 0−1, a i < 0 , i=1... n ]∈ R n (1391)Eigenvalue signs of a symmetric matrix having diagonalizationA = SΛS T (1374) can be absorbed either into real U or real Q from the fullSVD; [265, p.34] (conferC.4.2.1)orA = SΛS T = Sδ(ψ(δ(Λ))) |Λ|S T ∆ = U ΣQ T ∈ S n (1392)A = SΛS T = S|Λ|δ(ψ(δ(Λ)))S T ∆ = UΣ Q T ∈ S n (1393)where Σ = |Λ| , denoting entrywise absolute value of diagonal matrix Λ .△