06.06.2013 Views

Theory of Statistics - George Mason University

Theory of Statistics - George Mason University

Theory of Statistics - George Mason University

SHOW MORE
SHOW LESS

Create successful ePaper yourself

Turn your PDF publications into a flip-book with our unique Google optimized e-Paper software.

280 3 Basic Statistical <strong>Theory</strong><br />

Functional equivariance is trivial. This is the equivariance we expect under<br />

a simple change <strong>of</strong> units, for example. If X is a random variable that models<br />

physical temperatures in some application, it should not make any real<br />

difference whether the temperatures are always measured in degrees Celsius<br />

or degrees Fahrenheit. The random variable itself does not include units, <strong>of</strong><br />

course (it is a real number). If the measurements are made in degrees Celsius<br />

at a time when X is the random variable used to model the distribution <strong>of</strong><br />

the data and the estimator T(X) and the estimand h(θ) relates to X in a<br />

linear fashion (if h(θ) is the mean <strong>of</strong> X, for example), and later in a similar<br />

application the measurements are made in degrees Fahrenheit, applying<br />

g ∗ (t) = 9t/5 + 32 to both T(X) and h(θ) preserves the interpretation <strong>of</strong> the<br />

model.<br />

Formal equivariance, however, is not meaningful unless the problem itself<br />

has fundamentally symmetric properties; the family <strong>of</strong> probability distributions<br />

is closed under some group <strong>of</strong> transformations on the sample space one<br />

on the parameter space. In this case, we need a corresponding transformation<br />

on the decision space. The statistical procedure is equivariant if the functional<br />

equivariance is the same as the formal equivariance; that is,<br />

T(g(X)) = g ∗ (T(X)). (3.118)<br />

3.4.2 Optimal Equivariant Statistical Procedures<br />

In the decision-theoretic approach to statistical inference, we generally seek<br />

procedures that have minimum risk with respect to a given loss function. As<br />

we have seen, there are situations where we cannot obtain this uniformly.<br />

By restricting attention to procedures with properties such as L-unbiasedness<br />

or L-invariance, however, we may be able to achieve uniformly best procedures<br />

within that restricted class. Within the class <strong>of</strong> unbiased procedures,<br />

we seek UMVU estimators and UMPU tests. Likewise, within a collection <strong>of</strong><br />

equivariant procedures, we seek ones with minimum risk.<br />

The simplest and most interesting transformations are translations and<br />

scalings, and the combinations <strong>of</strong> these two, that is linear transformations.<br />

Consequently, the two most common types <strong>of</strong> invariant inference problems<br />

are those that are location invariant (or equivariant) and those that are scale<br />

invariant (or equivariant). Because in a linear transformation we scale first,<br />

a scale invariant procedure is invariant to location transformations, but a<br />

location invariant procedure is not invariant to scale transformations.<br />

In the remainder <strong>of</strong> this section, we concentrate on problems <strong>of</strong> point<br />

estimation. In Section 7.2.5 beginning on page 521 we discuss equivariant<br />

(invariant) test procedures, and in Section 7.9.3 beginning on page 545 we<br />

discuss equivariant confidence sets. We discuss equivariance in the context <strong>of</strong><br />

Bayesian analysis in Section 4.3.2 beginning on page 349.<br />

<strong>Theory</strong> <strong>of</strong> <strong>Statistics</strong> c○2000–2013 James E. Gentle

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!