04.08.2013 Views

1 Continuous Time Processes - IPM

1 Continuous Time Processes - IPM

1 Continuous Time Processes - IPM

SHOW MORE
SHOW LESS

Create successful ePaper yourself

Turn your PDF publications into a flip-book with our unique Google optimized e-Paper software.

From (??) and (1.5.6), the desired relation (1.5.5) and the semi-group property<br />

follow. An important feature of continuous time Markov chains is that<br />

Pt satisfied the the Kolmogorov forward and backward equations. In view of<br />

the semi-group property the same is true for Brownian motion and we will<br />

explain in example 1.5.2 below what the infinitesimal generator of Brownian<br />

motion is. With some of the fundamental definitions of Brownian motion in<br />

place we now calculate some quantities of interest.<br />

Example 1.5.1 Since the random variables Zs and Zt are dependent, it is<br />

reasonable to calculate their covaraince. Assume s < t, then we have<br />

Cov(Zs, Zt) = Cov(Zs, Zt − Zs + Zs)<br />

(By independence of increments) = Cov(Zs, Zs)<br />

= sσ2 .<br />

This may appear counter-intuitive at first sight since one expects Zs and Zt<br />

to become more independent as t − s increases while the covariance depends<br />

only on min(s, t) = s. However, if we divide Cov(Zs, Zt) by Var[Zs]Var[Zt]<br />

we see that the correlation tends to 0 as t increases for fixed s. ♠<br />

Example 1.5.2 One of the essential features of continuous time Markov<br />

chains was the existence of the infinitesimal generator. In this example we<br />

derive a formula for the infinitesimal generator of Brownian motion. For a<br />

function ψ on the state space R, the action of the semi-group Pt is given by<br />

(1.5.4). We set uψ(t, x) = u(t, x) = Ptψ. The Gaussian pt(x; σ) has variance<br />

tσ 2 and therefore it tends to the δ-function supported at the origin as t → 0,<br />

i.e.,<br />

It is straightforward to verify that<br />

lim(Ptψ)(x)<br />

= lim u(t, x) = ψ(x).<br />

t→0 t→0<br />

∂u<br />

∂t<br />

= σ2<br />

2<br />

∂2u . (1.5.7)<br />

∂x2 Therefore from the validity of Kolomogorov’s backward equation ( dPt = APt)<br />

dt<br />

we conclude that the infinitesimal generator of Brownian motion is given by<br />

A = σ2<br />

2<br />

d2 . (1.5.8)<br />

dx2 Thus the matrix A is now replaced by a differential operator. ♠<br />

39

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!