06.06.2013 Views

Theory of Statistics - George Mason University

Theory of Statistics - George Mason University

Theory of Statistics - George Mason University

SHOW MORE
SHOW LESS

Create successful ePaper yourself

Turn your PDF publications into a flip-book with our unique Google optimized e-Paper software.

2.11 The Family <strong>of</strong> Normal Distributions 189<br />

1<br />

(2π) nm/2 |Ψ| n/2 |Σ| m/2 e−tr(Ψ −1 (X−M) T Σ −1 (X−M))/2 ,<br />

where M ∈ IR n×m , Ψ ≻ 0 ∈ IR m×m , and Σ ≻ 0 ∈ IR n×n .<br />

The variance-covariance matrix <strong>of</strong> X is V(X) = V(vec(X)) = Ψ ⊗ Σ. The<br />

variance-covariance matrix <strong>of</strong> each row <strong>of</strong> X is Ψ, and the variance-covariance<br />

matrix <strong>of</strong> each column <strong>of</strong> X is Σ.<br />

The multivariate matrix normal distribution <strong>of</strong> the matrix X with PDF<br />

as given above is related to the ordinary multivariate normal for the vector<br />

vec(X) with PDF<br />

1<br />

(2π) nm/2 |Ψ ⊗ Σ| nm/2 e−vec(X−M)T (Ψ⊗Σ) −1 vec(X−M)/2 .<br />

Complex Multivariate Normal Distribution<br />

Consider the random d-vector Z, where<br />

Z = X + iY.<br />

The vector Z has a complex d-variate normal distribution if (X, Y ) has a real<br />

2d-variate normal distribution. The PDF <strong>of</strong> Z has the form<br />

where µ ∈ IC d and Σ ≻ 0 ∈ IC d×d .<br />

1<br />

(2π) d/2 |Σ| 1/2e−(x−µ)H Σ −1 (x−µ)/2 ,<br />

2.11.2 Functions <strong>of</strong> Normal Random Variables<br />

One reason that the normal distribution is useful is that the distributions <strong>of</strong><br />

certain functions <strong>of</strong> normal random variables are easy to derive and they have<br />

nice properties. These distributions can <strong>of</strong>ten be worked out from the CF <strong>of</strong><br />

the normal distribution N(µ, σ 2 ), which has a particularly simple form:<br />

ϕ(t) = e iµt−σ2 t 2 /2 .<br />

Given n iid N(µ, σ2 ) random variables, X1, X2, . . ., Xn, the sample mean<br />

and sample variance<br />

n<br />

X = Xi/n (2.31)<br />

and<br />

S 2 =<br />

are important functions.<br />

n<br />

<br />

Xi −<br />

i=1<br />

i=1<br />

n<br />

Xi/n<br />

i=1<br />

2<br />

<strong>Theory</strong> <strong>of</strong> <strong>Statistics</strong> c○2000–2013 James E. Gentle<br />

/(n − 1) (2.32)

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!