It possesses a number <strong>of</strong> unpleasant properties. First, for an ergodicprocess <strong>the</strong> actual values <strong>of</strong> B(u) rapidly decrease with an <strong>in</strong>crease <strong>of</strong>u. However, <strong>the</strong> st<strong>and</strong>ard deviations <strong>of</strong> <strong>the</strong> estimates B ˆ( u ) are roughly<strong>the</strong> same for any u <strong>and</strong> have order 1/ n − u.Thus, for u <strong>of</strong> <strong>the</strong> order<strong>of</strong> a few dozen <strong>the</strong> magnitudes B(u) <strong>the</strong>mselves are very small, onlyhundredth <strong>and</strong> thous<strong>and</strong>th parts <strong>of</strong> B(0) whereas <strong>the</strong> st<strong>and</strong>arddeviations (if n is not too large), tenth parts <strong>of</strong> B(0) so that <strong>the</strong> estimateis senseless.Second, <strong>the</strong>se estimates B ˆ( u ) when <strong>the</strong> values u are close to eacho<strong>the</strong>r are not scattered chaotically near <strong>the</strong> real values because <strong>the</strong>neighbour<strong>in</strong>g estimates B ˆ( u ) , B ˆ( u + 1) , B ˆ( u + 2) , ... are correlatedwith each o<strong>the</strong>r. When look<strong>in</strong>g at a graph <strong>of</strong> <strong>the</strong>ir values <strong>the</strong> eyeautomatically selects ra<strong>the</strong>r regular oscillations, see Fig. 3, atunreasonably large values <strong>of</strong> u where actually B(u) can not bedist<strong>in</strong>guished from zero. Therefore, when estimat<strong>in</strong>g <strong>the</strong> correlationfunction we can not trust our eyes <strong>and</strong> all our actions becomeuncerta<strong>in</strong>.The estimation <strong>of</strong> <strong>the</strong> spectral density f(λ) is preferable. Whenestimat<strong>in</strong>g it at po<strong>in</strong>ts λ = λ 1 , λ 2 , ..., λ m not too close to each o<strong>the</strong>r, <strong>the</strong>respective estimates f ˆ(λ i) will be almost <strong>in</strong>dependent r<strong>and</strong>omvariables, a fact first discovered by Slutsky. For estimat<strong>in</strong>g <strong>the</strong> spectraldensity we apply <strong>the</strong> same periodogram only suitably normed. It ishowever very <strong>in</strong>dent because its variance does not tend to vanish as <strong>the</strong>number <strong>of</strong> observations <strong>in</strong>creases. Therefore <strong>the</strong> periodogram issmoo<strong>the</strong>d, i. e. a mean value with some weight is taken 8 <strong>and</strong> we obta<strong>in</strong>an estimate not <strong>of</strong> <strong>the</strong> spectral density itself but <strong>of</strong> <strong>the</strong> functionresult<strong>in</strong>g from tak<strong>in</strong>g its mean with <strong>the</strong> same weight. This means that<strong>the</strong> <strong>in</strong>terval <strong>of</strong> tak<strong>in</strong>g <strong>the</strong> mean should be small. However, thatprocedure when a small <strong>in</strong>terval is chosen will little decrease <strong>the</strong>variance <strong>of</strong> <strong>the</strong> periodogram. Practical recommendations are here aresult <strong>of</strong> a compromise between <strong>the</strong>se contradictory dem<strong>and</strong>s.I can not go <strong>in</strong>to details <strong>of</strong> ma<strong>the</strong>matical tricks <strong>and</strong> I ought to saythat textbooks on <strong>the</strong> <strong>the</strong>ory <strong>of</strong> stochastic processes do not usuallydescribe <strong>the</strong> estimation <strong>of</strong> <strong>the</strong> correlation function or spectral density<strong>in</strong> any scientific manner. As I noted above, textbooks prefer to issuefrom a stochastic process given along with its correlation function.As a very reliable source <strong>of</strong> <strong>in</strong>formation concern<strong>in</strong>g statisticalproblems, I can cite Hannan (1960). This book is, however, veryconcise <strong>and</strong> difficult to read. Jenk<strong>in</strong>s & Watts [1971 – 1972] is easierto read, but less reliable. For example, <strong>the</strong>y do not say sufficientlyclearly that none <strong>of</strong> <strong>the</strong> provided formulas for <strong>the</strong> variances <strong>of</strong> <strong>the</strong>estimates <strong>of</strong> <strong>the</strong> correlation function <strong>and</strong> spectral density is at allapplicable to each stationary process; some strong conditionsma<strong>the</strong>matically express<strong>in</strong>g <strong>the</strong> property <strong>of</strong> ergodicity are necessary.Never<strong>the</strong>less, that book is usable although regrettably <strong>the</strong>ir practicalexamples should be studied very critically.I wish to warn <strong>the</strong> reader who will study <strong>the</strong> sources <strong>in</strong>dicated that<strong>the</strong> <strong>in</strong>itial material on which <strong>the</strong> methods <strong>of</strong> <strong>the</strong> <strong>the</strong>ory <strong>of</strong> stochasticprocesses had been developed mostly consisted <strong>of</strong> economic data,70
usually very little <strong>of</strong> <strong>the</strong>m. Indeed, we may trace <strong>the</strong> change <strong>of</strong> someeconomic <strong>in</strong>dicator over decades or at best over a few centuries (as <strong>in</strong><strong>the</strong> case <strong>of</strong> <strong>the</strong> Beveridge series). A year usually means oneobservation (o<strong>the</strong>rwise seasonal periodicity which we should somehowdeal with will <strong>in</strong>terfere, <strong>and</strong> <strong>in</strong> general most economic <strong>in</strong>dicators arecalculated on a yearly basis). We <strong>the</strong>refore have tens or hundreds <strong>of</strong>observations whereas calculations show that for a reliable estimate <strong>of</strong><strong>the</strong> correlation function or spectral density we need thous<strong>and</strong>s <strong>and</strong> tens<strong>of</strong> thous<strong>and</strong>s <strong>of</strong> <strong>the</strong>m. Already Kendall (1946) formulated thisconclusion <strong>in</strong> respect <strong>of</strong> <strong>the</strong> former.As a result, ma<strong>the</strong>maticians attempt to atta<strong>in</strong> someth<strong>in</strong>g by select<strong>in</strong>gan optimal method <strong>of</strong> smooth<strong>in</strong>g periodograms, but with a smallnumber <strong>of</strong> observations this method is generally hopeless. The realapplicability <strong>of</strong> <strong>the</strong> <strong>the</strong>ory <strong>of</strong> stochastic processes is <strong>in</strong> <strong>the</strong> spherewhere any number <strong>of</strong> observations is available. Radio physicists havelong ago developed methods allow<strong>in</strong>g easily <strong>and</strong> simply to obta<strong>in</strong>estimates <strong>of</strong> <strong>the</strong> spectrum <strong>of</strong> a stochastic process if unnecessary toeconomize on <strong>the</strong> number <strong>of</strong> observations. They apply systems <strong>of</strong>filters separat<strong>in</strong>g b<strong>and</strong>s <strong>of</strong> frequencies (Mon<strong>in</strong> & Jaglom 1967, pt. 2).3.4. A survey <strong>of</strong> practical applications. Among <strong>the</strong> creators <strong>of</strong> <strong>the</strong><strong>the</strong>ory <strong>of</strong> stochastic processes who had also dealt with statisticalmaterials we should mention Yale, Slutsky <strong>and</strong> M. G. Kendall (<strong>and</strong>most important are Kolmogorov’s contributions, see below). Thoseworks had appeared even before World War II, that is, when automaticmeans <strong>of</strong> treat<strong>in</strong>g <strong>the</strong> material were unavailable, <strong>and</strong> <strong>the</strong>se pioneershad to work with hundreds <strong>of</strong> observations at <strong>the</strong> most.Thous<strong>and</strong>s <strong>and</strong> tens <strong>of</strong> thous<strong>and</strong>s are needed <strong>in</strong> <strong>the</strong> correlation<strong>the</strong>ory because we are attempt<strong>in</strong>g to f<strong>in</strong>d out too much, not an estimate<strong>of</strong> one or a few parameters, but <strong>in</strong>f<strong>in</strong>itely many magnitudes B(u), u =0, 1, 2, ... i. e. <strong>the</strong> correlation function (or spectral density, <strong>the</strong> functionf(λ) for λ tak<strong>in</strong>g values on [− π, π]).We can choose ano<strong>the</strong>r approach for achiev<strong>in</strong>g practically effectivemethods <strong>of</strong> correlation <strong>the</strong>ory when hav<strong>in</strong>g a small number <strong>of</strong>observations, namely, look<strong>in</strong>g for models depend<strong>in</strong>g on a smallnumber <strong>of</strong> parameters. Slutsky provided one such model, <strong>the</strong> model <strong>of</strong>mov<strong>in</strong>g average. Imag<strong>in</strong>e an <strong>in</strong>f<strong>in</strong>ite sequence <strong>of</strong> <strong>in</strong>dependentidentically distributed r<strong>and</strong>om variables... ξ −1 , ξ 0 , ξ 1 , ..., ξ n , ...<strong>in</strong>stead <strong>of</strong> which we observe <strong>the</strong> sequence... ς −1 , ς 0, ς 1, .. , ς n, ... (3.6)wheremς = ∑ α ξ .(3.7)n k n−kk = 0In o<strong>the</strong>r words, ς n is a sum <strong>of</strong> some number <strong>of</strong> <strong>in</strong>dependentmagnitudes ξ n−k multiplied by suitable α k . Slutsky modelled <strong>the</strong> system71
- Page 1 and 2:
Studies in the History of Statistic
- Page 3 and 4:
Introduction by CompilerI am presen
- Page 5 and 6:
(Lect. Notes Math., No. 1021, 1983,
- Page 7 and 8:
sufficiently securely that a carefu
- Page 9 and 10:
is energy?) from chapter 4 of Feynm
- Page 11 and 12:
demand to apply transfinite numbers
- Page 13 and 14:
for stating that Ω consists of ele
- Page 15 and 16:
chances to draw a more suitable apa
- Page 17 and 18:
Let the space of elementary events
- Page 19 and 20: 2.3. Independence. When desiring to
- Page 21 and 22: Eξ = ∑ aipi.Our form of definiti
- Page 23 and 24: absolutely precisely if the pertine
- Page 25 and 26: where x is any real number. If dens
- Page 27 and 28: probability can be coupled with an
- Page 29 and 30: Nowadays we are sure that no indepe
- Page 31 and 32: λ = λ(T)with λ(T) being actually
- Page 33 and 34: (1/B n )(m − A n )instead of the
- Page 35 and 36: along with ξ. For example, if ξ i
- Page 37 and 38: µ( − p0) ÷np0 (1 − p0)nhas an
- Page 39 and 40: distribution of the maximal term |s
- Page 41 and 42: ξ (ω) + ... + ξ (ω)n1n{ω :|
- Page 43 and 44: P{max ξ(t) ≥ x} = 0.01, 0 ≤ t
- Page 45 and 46: 1. This example and considerations
- Page 47 and 48: IIV. N. TutubalinTreatment of Obser
- Page 49 and 50: structure of statistical methods, d
- Page 51 and 52: Suppose that we have adopted the pa
- Page 53 and 54: and the variances are inversely pro
- Page 55 and 56: It is interesting therefore to see
- Page 57 and 58: is applied with P(t) being a polyno
- Page 59 and 60: ut some mathematical tricks describ
- Page 61 and 62: It is clear therefore that no speci
- Page 63 and 64: of various groups of machines, and
- Page 65 and 66: nnA(λ) x sin λ t, B(λ) = x cosλ
- Page 67 and 68: of the mathematical model of the Br
- Page 69: dF(λ) = f (λ) dλ, so that B( t
- Page 73 and 74: This is the celebrated model of aut
- Page 75 and 76: applications of the theory of stoch
- Page 77 and 78: achieved by differentiating because
- Page 79 and 80: u(x 1 , x 2 , t 1 , t 2 ) = v(x 1 ,
- Page 81 and 82: Reasoning based on common sense and
- Page 83 and 84: answering that question is extremel
- Page 85 and 86: IIIV. N. TutubalinThe Boundaries of
- Page 87 and 88: periodograms. It occurred that work
- Page 89 and 90: at point x = 1. However, preceding
- Page 91 and 92: He concludes that since the action
- Page 93 and 94: The verification of the truth of a
- Page 95 and 96: In the purely scientific sense this
- Page 97 and 98: ought to learn at once the simple t
- Page 99 and 100: the material world science had inde
- Page 101 and 102: values of (2.1) realized in the n e
- Page 103 and 104: *several dozen. The totality µ ica
- Page 105 and 106: Mendelian laws. It is not sufficien
- Page 107 and 108: example, the problem of the objecti
- Page 109 and 110: a linear function is not restricted
- Page 111 and 112: 258 - 82 - 176 cases or 68.5% of al
- Page 113 and 114: The Framingham investigation indeed
- Page 115 and 116: or, for discrete observations,IT(ω
- Page 117 and 118: What objections can be made? First,
- Page 119 and 120: eliability and queuing are known to
- Page 121 and 122:
Kolman E. (1939 Russian), Perversio
- Page 123 and 124:
measurement is provided. Recently,
- Page 125 and 126:
which means that sooner or later th
- Page 127 and 128:
The foundations of the Mises approa
- Page 129 and 130:
A rather subtle arsenal is develope
- Page 131 and 132:
4.3. General remarks on §§ 4.1 an
- Page 133 and 134:
BibliographyAlimov Yu. I. (1976, 19
- Page 135 and 136:
processes are now going on in the s
- Page 137 and 138:
obtaining a deviation from the theo
- Page 139 and 140:
VIOscar SheyninOn the Bernoulli Law