11.07.2015 Views

Causality in Time Series - ClopiNet

Causality in Time Series - ClopiNet

Causality in Time Series - ClopiNet

SHOW MORE
SHOW LESS

You also want an ePaper? Increase the reach of your titles

YUMPU automatically turns print PDFs into web optimized ePapers that Google loves.

Roebroeck Seth Valdes-Sosa1984) and Phillips (Phillips, 1973, 1974) study<strong>in</strong>g the estimation of cont<strong>in</strong>uous timeAutoregressive models (McCrorie, 2002), and cont<strong>in</strong>uous time Autoregressive Mov<strong>in</strong>gAverage Models (Chambers and Thornton, 2009) from discrete data. This work restson the observation that the lag zero covariance matrix Σ e will show contemporaneouscovariance even if the cont<strong>in</strong>uous covariance matrix Σ ω is diagonal. In other words,the discrete noise becomes correlated over the discrete time-series because the randomfluctuations are aggregated over time. Rather than consider<strong>in</strong>g this a disadvantage, thisapproach tries to use both lag <strong>in</strong>formation (the AR part) and zero-lag covariance <strong>in</strong>formationto identify the underly<strong>in</strong>g cont<strong>in</strong>uous l<strong>in</strong>ear model.Notwithstand<strong>in</strong>g the desirability of a cont<strong>in</strong>uous time model for consistent <strong>in</strong>ferenceon WAGS <strong>in</strong>fluence, there are a few <strong>in</strong>variances of discrete VAR models, or moregenerally discrete Vector Autoregressive Mov<strong>in</strong>g Average (VARMA) models that allowtheir carefully qualified usage <strong>in</strong> estimat<strong>in</strong>g causal <strong>in</strong>fluence. The VAR formulation ofWAGS <strong>in</strong>fluence has the property of <strong>in</strong>variance under <strong>in</strong>vertible l<strong>in</strong>ear filter<strong>in</strong>g. Moreprecisely, a general measure of <strong>in</strong>fluence rema<strong>in</strong>s unchanged if channels are each premultipliedwith different <strong>in</strong>vertible lag operators (Geweke, 1982). However, <strong>in</strong> practicethe order of the estimated VAR model would need to be sufficient to accommodatethese operators. Beyond <strong>in</strong>vertible l<strong>in</strong>ear filter<strong>in</strong>g, a VARMA formulation has further<strong>in</strong>variances. Solo (2006) showed that causality <strong>in</strong> a VARMA model is preserved undersampl<strong>in</strong>g and additive noise. More precisely, if both local and contemporaneous <strong>in</strong>fluenceis considered (as def<strong>in</strong>ed above) the VARMA measure is preserved under sampl<strong>in</strong>gand under the addition of <strong>in</strong>dependent but colored noise to the different channels. F<strong>in</strong>ally,Amendola et al. (2010) shows the class of VARMA models to be closed underaggregation operations, which <strong>in</strong>clude both sampl<strong>in</strong>g and time-w<strong>in</strong>dow averag<strong>in</strong>g.3.2. State-space modelsA general state-space model for a cont<strong>in</strong>uous vector time-series y(t)can be formulatedwith the set of equations:ẋ(t) = f (x(t),v(t),Θ) + ω(t)y(t) = g(x(t),v(t),Θ) + ε(t)This expresses the observed time-series y(t)as a function of the state variables x(t),which are possibly hidden (i.e. unobserved) and observed exogenous <strong>in</strong>puts v(t), whichare possibly under control. All parameters <strong>in</strong> the model are grouped <strong>in</strong>to Θ. Notethat some generality is sacrificed from the start s<strong>in</strong>ce f and gdo not depend on t (Themodel is autonomous and generates stationary processes) or on ω(t) or ε(t), that is:noise enters only additively. The first set of equations, the transition equations or stateequations, describe the evolution of the dynamic system over time <strong>in</strong> terms of stochasticdifferential equations (SDEs, though technically only when ω(t) = Σẇ(t) with w(t) aWiener process), captur<strong>in</strong>g relations among the hidden state variables x(t) themselvesand the <strong>in</strong>fluence of exogenous <strong>in</strong>puts v(t). The second set of equations, the observationequations or measurement equations, describe how the measurement variables y(t) areobta<strong>in</strong>ed from the <strong>in</strong>stantaneous values of the hidden state variables x(t) and the <strong>in</strong>puts(12)86

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!