06.06.2013 Views

Theory of Statistics - George Mason University

Theory of Statistics - George Mason University

Theory of Statistics - George Mason University

SHOW MORE
SHOW LESS

Create successful ePaper yourself

Turn your PDF publications into a flip-book with our unique Google optimized e-Paper software.

738 0 Statistical Mathematics<br />

A related pseudonorm is more useful, however, because it is the limit <strong>of</strong><br />

equation (0.1.75) as p → ∞ (compare equation (0.0.34)). We define<br />

f∞ = ess sup |f(x)w(x)|, (0.1.77)<br />

where ess sup denotes the essential supremum <strong>of</strong> a function, defined for a<br />

given measure µ by<br />

ess sup g(x) = inf{a : µ({x : x ∈ D, g(x) > a}) = 0}.<br />

The essential infimum <strong>of</strong> a function for a given measure µ is defined similarly:<br />

ess inf g(x) = sup{a : µ({x : x ∈ D, g(x) < a}) = 0}.<br />

The pseudonorm defined by equation (0.1.77) is called the L∞ norm, the<br />

Chebyshev norm, or the uniform norm.<br />

Another type <strong>of</strong> function norm, called the total variation, is an L∞-type <strong>of</strong><br />

measure <strong>of</strong> the amount <strong>of</strong> variability <strong>of</strong> the function. For a real-valued scalar<br />

function f on the interval [a, b], the total variation <strong>of</strong> f on [a, b] is<br />

<br />

(f) = sup |f(xi+1) − f(xi)|, (0.1.78)<br />

V b a<br />

where π is a partition <strong>of</strong> [a, b], (a = x0 < x1 < · · · < xn = b).<br />

If f is continuously differentiable over [a, b], then<br />

π<br />

V b a(f) =<br />

i<br />

b<br />

a<br />

|f ′ (x)|dx. (0.1.79)<br />

A normal function is a function whose pseudonorm is 1. A normal function<br />

is also called a normal function a normalized function. Although this term<br />

can be used with respect to any pseudonorm, it is generally reserved for the<br />

L2 pseudonorm (that is, the pseudonorm arising from the inner product). A<br />

function whose integral (over a relevant range, usually IR) is 1 is also called<br />

a normal function. (Although this latter definition is similar to the standard<br />

one, the latter is broader because it may include functions that are not squareintegrable.)<br />

Density and weight functions are <strong>of</strong>ten normalized (that is, scaled<br />

to be normal).<br />

0.1.9.4 Metrics in Function Spaces<br />

Statistical properties such as bias and consistency are defined in terms <strong>of</strong> the<br />

difference <strong>of</strong> the estimator and what is being estimated. For an estimator <strong>of</strong> a<br />

function, first we must consider some ways <strong>of</strong> measuring this difference. These<br />

are general measures for functions and are not dependent on the distribution<br />

<strong>of</strong> a random variable. How well one function approximates another function is<br />

<strong>Theory</strong> <strong>of</strong> <strong>Statistics</strong> c○2000–2013 James E. Gentle

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!