02.09.2014 Views

multivariate poisson hidden markov models for analysis of spatial ...

multivariate poisson hidden markov models for analysis of spatial ...

multivariate poisson hidden markov models for analysis of spatial ...

SHOW MORE
SHOW LESS

You also want an ePaper? Increase the reach of your titles

YUMPU automatically turns print PDFs into web optimized ePapers that Google loves.

indicates the component, and the variables are the latent variables used to construct the<br />

model in section 5.1. Thus, the complete data are the vectors Y , X , Z ) . The vector <strong>of</strong><br />

(<br />

i i i<br />

parameters is defined by Φ, and then the complete loglikelihood takes the following<br />

<strong>for</strong>m:<br />

n k<br />

j<br />

∑∑ ij j ∏ ti tj<br />

i= 1 j= 1<br />

t∈Ω<br />

L( Φ ) = Z (log p + log f( X | θ ))<br />

n k n k<br />

j<br />

j<br />

Zij pj Zij θtj Xti θtj Xti<br />

i= 1 j= 1 i= 1 j= 1 t∈Ω<br />

∑∑ ∑∑ ∑ , (5.16)<br />

= log + ( − + log −log !)<br />

where Ω = {1,2,3,12,13,23}<br />

. The relevant part <strong>of</strong> the complete likelihood is give by<br />

n<br />

k<br />

j<br />

∑∑ ( − Zijθtj + Zij Xti log θtj<br />

) and hence, one needs the expectations E ( Z ij<br />

) and<br />

i= 1 j=<br />

1<br />

E ( X j Z ti ij<br />

) . However <strong>for</strong> the latter, since Z<br />

ij<br />

is a binary random variable, when<br />

j<br />

X<br />

ti<br />

is 0<br />

if the observation does not belong to the j th component and takes the value<br />

j<br />

X<br />

ti<br />

if<br />

j<br />

j<br />

Z =1. Thus E [ X Z ] p(<br />

Z ) E[<br />

X | Z = 1]<br />

.<br />

ij<br />

ti<br />

ij<br />

=<br />

ij ti ij<br />

j<br />

The E [ X ti<br />

| Z = 1]<br />

is the expectation <strong>of</strong> the latent variable<br />

ij<br />

j<br />

X<br />

ti<br />

given that it belongs to<br />

the j th component. Thus, at the E-step one needs the expectations E [ Z ij<br />

| Y i<br />

, Φ]<br />

<strong>for</strong><br />

j<br />

i = 1,...,n<br />

, j = 1,...,<br />

k and E [ X | Y , Z = 1, Φ]<br />

<strong>for</strong> i = 1,...,<br />

n , j = 1,...,<br />

k and t ∈ Ω.<br />

ti<br />

i<br />

ij<br />

More <strong>for</strong>mally, the procedure can be described as follows:<br />

E-step: Using the current values <strong>of</strong> the parameters calculate<br />

py (<br />

i<br />

| θ<br />

j)<br />

wij = E[ Zij | Yi , Φ ] = pj<br />

, i= 1,..., n, j = 1,...,<br />

k . (5.17)<br />

py ( )<br />

i<br />

88

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!