06.06.2013 Views

Theory of Statistics - George Mason University

Theory of Statistics - George Mason University

Theory of Statistics - George Mason University

SHOW MORE
SHOW LESS

You also want an ePaper? Increase the reach of your titles

YUMPU automatically turns print PDFs into web optimized ePapers that Google loves.

we have for fixed k,<br />

1.3 Sequences <strong>of</strong> Events and <strong>of</strong> Random Variables 99<br />

<br />

n<br />

lim =<br />

n→∞ k<br />

nk−1<br />

,<br />

k!<br />

lim<br />

n→∞ fY (y) = 1<br />

Γ(k) yk−1e −y I[0,∞[(y), (1.202)<br />

that is, the limiting distribution <strong>of</strong> {nX(k:n)} is gamma with scale parameter<br />

1 and shape parameter k. (Note, <strong>of</strong> course, k! = kΓ(k).) For finite values<br />

<strong>of</strong> n, the asymptotic distribution provides better approximations when k/n<br />

is relatively small. When k is large, n must be much larger in order for the<br />

asymptotic distribution to approximate the true distribution closely.<br />

If k = 1, the PDF in equation (1.202) is the exponential distribution, as<br />

shown in Example 1.27. For k → n, however, we must apply a limit similar to<br />

what is done in equation (1.201).<br />

While the min and max <strong>of</strong> the uniform distribution considered in Example<br />

1.27 are “extreme” values, the more interesting extremes are those from<br />

distributions with infinite support. In the next example, we consider an extreme<br />

value that has no bound. In such a case, in addition to any normalization,<br />

we must do a shift.<br />

Example 1.29 extreme value distribution from an exponential distribution<br />

Let X(n:n) be the largest order statistic from a random sample <strong>of</strong> size n from<br />

an exponential distribution with PDF e−xIĪR+ (x) and let<br />

We have<br />

Y = X(n:n) − log(n).<br />

lim Pr(Y ≤ y) = e−e−y<br />

n→∞<br />

(1.203)<br />

(Exercise 1.65). The distribution with CDF given in equation (1.203) is called<br />

an extreme value distribution. There are two other classes <strong>of</strong> “extreme value<br />

distributions”, which we will discuss in Section 1.4.3. The one in this example,<br />

which is the most common one, is called a type 1 extreme value distribution<br />

or a Gumbel distribution.<br />

1.3.8 Asymptotic Expectation<br />

The properties <strong>of</strong> the asymptotic distribution, such as its mean or variance,<br />

are the asymptotic values <strong>of</strong> the corresponding properties <strong>of</strong> Tn. Let {Tn}<br />

d<br />

be a sequence <strong>of</strong> random variables with E(|Tn|) < ∞ and Tn → T, with<br />

E(|T |) < ∞. Theorem 1.40 (on page 90) tells us that<br />

E(|Tn| k ) → E(|T | k ).<br />

<strong>Theory</strong> <strong>of</strong> <strong>Statistics</strong> c○2000–2013 James E. Gentle

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!