14.02.2013 Views

Mathematics in Independent Component Analysis

Mathematics in Independent Component Analysis

Mathematics in Independent Component Analysis

SHOW MORE
SHOW LESS

Create successful ePaper yourself

Turn your PDF publications into a flip-book with our unique Google optimized e-Paper software.

90 Chapter 4. Neurocomput<strong>in</strong>g 64:223-234, 2005<br />

Abstract<br />

On model identifiability <strong>in</strong> analytic<br />

postnonl<strong>in</strong>ear ICA<br />

F.J. Theis ∗ , P. Gruber<br />

Institute of Biophysics, University of Regensburg,<br />

D-93040 Regensburg, Germany<br />

An important aspect of successfully analyz<strong>in</strong>g data with bl<strong>in</strong>d source separation is<br />

to know the <strong>in</strong>determ<strong>in</strong>acies of the problem, that is how the separat<strong>in</strong>g model is<br />

related to the orig<strong>in</strong>al mix<strong>in</strong>g model. If l<strong>in</strong>ear <strong>in</strong>dependent component analysis (ICA)<br />

is used, it is well known that the mix<strong>in</strong>g matrix can be found <strong>in</strong> pr<strong>in</strong>ciple, but for<br />

more general sett<strong>in</strong>gs not many results exist. In this work, only consider<strong>in</strong>g random<br />

variables with bounded densities, we prove identifiability of the postnonl<strong>in</strong>ear mix<strong>in</strong>g<br />

model with analytic nonl<strong>in</strong>earities and calculate its <strong>in</strong>determ<strong>in</strong>acies. A simulation<br />

confirms these theoretical f<strong>in</strong>d<strong>in</strong>gs.<br />

Key words: postnonl<strong>in</strong>ear <strong>in</strong>dependent component analysis, postnonl<strong>in</strong>ear bl<strong>in</strong>d<br />

source separation, identifiability, separability, bounded random vectors<br />

1 Introduction<br />

<strong>Independent</strong> component analysis (ICA) f<strong>in</strong>ds statistically <strong>in</strong>dependent data<br />

with<strong>in</strong> a given random vector. It is often applied to bl<strong>in</strong>d source separation<br />

(BSS), where it is furthermore assumed that the given vector has been mixed<br />

us<strong>in</strong>g a fixed set of <strong>in</strong>dependent sources.<br />

In l<strong>in</strong>ear ICA, the mix<strong>in</strong>g model can be written as<br />

n�<br />

Xi = aijSj<br />

i=1<br />

∗ Correspond<strong>in</strong>g author.<br />

Email addresses: fabian@theis.name (F.J. Theis), petergruber@gmx.net (P.<br />

Gruber).<br />

Prepr<strong>in</strong>t submitted to Elsevier Science 13 October 2004

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!