11.07.2015 Views

Causality in Time Series - ClopiNet

Causality in Time Series - ClopiNet

Causality in Time Series - ClopiNet

SHOW MORE
SHOW LESS

Create successful ePaper yourself

Turn your PDF publications into a flip-book with our unique Google optimized e-Paper software.

Popescuwhich would correspond to a vanish<strong>in</strong>g partial correlation. If all A’s are lower triangularG non-causality is satisfied (<strong>in</strong> one direction but not the converse). It is however veryrare that the physical mechanism we are observ<strong>in</strong>g is <strong>in</strong>deed the embodiment of a VAR,and therefore even <strong>in</strong> the case <strong>in</strong> which G non-causality can be safely rejected, it isnot likely that the best VAR approximation of the data observed is strictly lower/uppertriangular. The necessity of a dist<strong>in</strong>ction between strict causality, which has a structural<strong>in</strong>terpretation, and a causality statistic, which does not measure <strong>in</strong>dependence <strong>in</strong>the sense of Granger-non causality, but rather relative degree of dependence <strong>in</strong> bothdirections among two signals (driv<strong>in</strong>g) is most evident <strong>in</strong> this case. If the VAR <strong>in</strong> questionhad very small (and statistically observable) upper triangular elements would adiscussion of causality of the observed time series be rendered moot?One of the most common physical mechanisms which is <strong>in</strong>compatible with VARis alias<strong>in</strong>g, i.e. dynamics which are faster than the (shortest) sampl<strong>in</strong>g <strong>in</strong>terval. Thestandard <strong>in</strong>terpretation of alias<strong>in</strong>g is the false representation of frequency componentsof a signal due to sub-Nyquist frequency sampl<strong>in</strong>g: <strong>in</strong> the multivariate time-series casethis can also lead to spurious correlations <strong>in</strong> the observed <strong>in</strong>novations process (Phillips,1973). Consider a cont<strong>in</strong>uous bivariate VAR of order 1 with Gaussian <strong>in</strong>novations <strong>in</strong>which the sampl<strong>in</strong>g frequency is several orders of magnitude smaller than the Nyquistfrequency. In this case we would observe a covariate time <strong>in</strong>dependent Gaussian processs<strong>in</strong>ce for all practical purposes the <strong>in</strong>formation travels ‘<strong>in</strong>stantaneously’. In economics,this effect could be due to social <strong>in</strong>teractions or market reactions to news whichhappen faster than the sampl<strong>in</strong>g <strong>in</strong>terval (be it daily, hourly or monthly). In fMRI analysissub- sampl<strong>in</strong>g <strong>in</strong>terval bra<strong>in</strong> dynamics are observed over a relatively slow timeconvolution process of hemodynamic response of neural activity (for a detailed expositionof causality <strong>in</strong>ference <strong>in</strong> fMRI see Roebroeck et al. (2011) <strong>in</strong> this volume).Although ‘alias<strong>in</strong>g’ normally refers to temporal alias<strong>in</strong>g, the same process can occurspatially. In neuroscience and <strong>in</strong> economics the observed variables are summations(dimensionality reductions) of a far larger set of <strong>in</strong>teract<strong>in</strong>g agents, be they <strong>in</strong>dividualsor neurons. In electroencephalography (EEG) the propagation of electrical potentialfrom cortical axons arrives via multiple pathways to the same record<strong>in</strong>g location onthe scalp: the summation of micrometer scale electric potentials on the scalp at centimeterscale. Once aga<strong>in</strong> there are spurious observable correlations: this is known asthe mix<strong>in</strong>g problem. Such effects can be modeled, albeit with significant <strong>in</strong>formationloss, by the same DGP class which is a superset of VAR and known <strong>in</strong> econometrics asSVAR (structural vector auto-regression, the time series equivalent of structural equationmodel<strong>in</strong>g (SEM), often used <strong>in</strong> static causality <strong>in</strong>ference (Pearl, 2000)). Anotherbasic problem <strong>in</strong> dynamic system identification is that we not only discard much <strong>in</strong>formationfrom the world <strong>in</strong> sampl<strong>in</strong>g it, but that our observations are susceptible toadditive noise, and that the randomness we see <strong>in</strong> the data is not entirely the randomnessof the mechanism we <strong>in</strong>tend to study. One of the most problematic of additivenoise models is mixed colored noise, <strong>in</strong> which there are structured correlations both <strong>in</strong>time and across elements of the time-series, but not <strong>in</strong> any causal way: there is only al<strong>in</strong>ear transformation of colored noise, sometimes called mix<strong>in</strong>g, due to spatial alias<strong>in</strong>g.40

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!