02.09.2014 Views

multivariate poisson hidden markov models for analysis of spatial ...

multivariate poisson hidden markov models for analysis of spatial ...

multivariate poisson hidden markov models for analysis of spatial ...

SHOW MORE
SHOW LESS

You also want an ePaper? Increase the reach of your titles

YUMPU automatically turns print PDFs into web optimized ePapers that Google loves.

…<br />

Urn 1 Urn 2 Urn N<br />

P[Red]= b 1<br />

(1) P[Red]= b (1) 2<br />

P[Red]= b (1)<br />

P[Blue]= b 1<br />

(2) P[Blue]= b (2) 2<br />

P[Blue]= b (2)<br />

P[Green]= b (3) P[Green]= 1<br />

b (3) 2<br />

P[Green]= b (3)<br />

…<br />

P[Orange]= b( M ) P[Orange]= b ( M )<br />

P[Orange]= ( )<br />

1 2<br />

b M<br />

The observation sequence is<br />

Y= {Green, Green, Red, Yellow, Blue, …, Orange, Blue}<br />

N<br />

N<br />

N<br />

N<br />

Figure 2.5: The Urn and Ball Model<br />

2.3 Definition <strong>of</strong> the <strong>hidden</strong> Markov model<br />

A <strong>hidden</strong> Markov Model is a doubly stochastic process, with an underlying stochastic<br />

process that is not observable (<strong>hidden</strong>), and can only be observed through another set <strong>of</strong><br />

stochastic processes that produced the sequence <strong>of</strong> observations.<br />

Simply stated, a <strong>hidden</strong> Markov model is a finite set <strong>of</strong> states, each <strong>of</strong> them being<br />

associated with a probability distribution, and the transition between the states being<br />

covered by the transition probability. In particular, the observation can be generated<br />

according to the associated probability distribution so it is only the outcome that is<br />

17

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!