12.07.2015 Views

Fundamentals of Probability and Statistics for Engineers

Fundamentals of Probability and Statistics for Engineers

Fundamentals of Probability and Statistics for Engineers

SHOW MORE
SHOW LESS

Create successful ePaper yourself

Turn your PDF publications into a flip-book with our unique Google optimized e-Paper software.

316 <strong>Fundamentals</strong> <strong>of</strong> <strong>Probability</strong> <strong>and</strong> <strong>Statistics</strong> <strong>for</strong> <strong>Engineers</strong>mass function (pmf) p(x; q), where q may be specified or unspecified. We denoteby hypothesis H the hypothesis that the sample represents n values <strong>of</strong> a r<strong>and</strong>omvariable with pdf f (x; q) or p(x; q). This hypothesis is called a simple hypothesiswhen the underlying distribution is completely specified; that is, the parametervalues are specified together with the functional <strong>for</strong>m <strong>of</strong> the pdf or the pmf;otherwise, it is a composite hypothesis. To construct a criterion <strong>for</strong> hypothesestesting, it is necessary that an alternative hypothesis be established againstwhich hypothesis H can be tested. An example <strong>of</strong> an alternative hypothesis issimply another hypothesized distribution, or, as another example, hypothesisH can be tested against the alternative hypothesis that hypothesis H is not true.In our applications, the latter choice is considered more practical <strong>and</strong> we shallin general deal with the task <strong>of</strong> either accepting or rejecting hypothesis H onthe basis <strong>of</strong> a sample from the population.10.1.1 TYPE-I AND TYPE-II ERRORSAs in parameter estimation, errors or risks are inherent in deciding whether ahypothesis H should be accepted or rejected on the basis <strong>of</strong> sample in<strong>for</strong>mation.Tests <strong>for</strong> hypotheses testing are there<strong>for</strong>e generally compared in terms <strong>of</strong> theprobabilities <strong>of</strong> errors that might be committed. There are basically two types<strong>of</strong> errors that are likely to be made – namely, reject H when in fact H is true or,alternatively, accept H when in fact H is false. We <strong>for</strong>malize the above withDefinition 10.1.D efinition 10. 1. in testing hypothesis H, a Type-I error is committed when His rejected when in fact H is true; a Type-II error is committed when H isaccepted when in fact H is false.In hypotheses testing, an important consideration in constructing statisticaltests is thus to control, ins<strong>of</strong>ar as possible, the probabilities <strong>of</strong> making theseerrors. Let us note that, <strong>for</strong> a given test, an evaluation <strong>of</strong> Type-I errors can bemade when hypothesis H is given, that is, when a hypothesized distribution isspecified. In contrast, the specification <strong>of</strong> an alternative hypothesis dictatesType-II error probabilities. In our problem, the alternative hypothesis is simplythat hypothesis H is not true. The fact that the class <strong>of</strong> alternatives is so largemakes it difficult to use Type-II errors as a criterion. In what follows, methods<strong>of</strong> hypotheses testing are discussed based on Type-I errors only.10.2 CHI-SQUARED GOODNESS-OF-FIT TESTAs mentioned above, the problem to be addressed is one <strong>of</strong> testing hypothesis Hthat specifies the probability distribution <strong>for</strong> a population X compared with theTLFeBOOK

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!