14.02.2013 Views

Mathematics in Independent Component Analysis

Mathematics in Independent Component Analysis

Mathematics in Independent Component Analysis

SHOW MORE
SHOW LESS

Create successful ePaper yourself

Turn your PDF publications into a flip-book with our unique Google optimized e-Paper software.

Chapter 20. Signal Process<strong>in</strong>g 86(3):603-623, 2006 283<br />

1.5<br />

1<br />

0.5<br />

0<br />

SCA<br />

sNMF *<br />

sNMF<br />

NMF *<br />

NMF<br />

sNMF *<br />

sNMF<br />

NMF *<br />

NMF<br />

JADE<br />

(a) matrix comparison by Amari <strong>in</strong>dex<br />

Measure value [a.u.]<br />

2.5<br />

2<br />

1.5<br />

1<br />

0.5<br />

0<br />

KLD<br />

MuIn<br />

QMI<br />

RSD<br />

Renyi<br />

Measure STW<br />

Xcor<br />

JADE<br />

SCA NMFNMF sNMF<br />

*<br />

sNMF Channels<br />

*<br />

Signal<br />

(b) comparison of the recovered sources<br />

Fig. 11. Inter-component performance <strong>in</strong>dex comparisons; (a) comparison of the<br />

Amari <strong>in</strong>dex; (b) mean of various source dependence measures.<br />

JADE NMF NMF∗ sNMF sNMF∗ SCA<br />

mean kurtosis 4.97 4.74 4.80 4.81 4.80 4.82<br />

sparseness 0.387 0.424 0.413 0.408 0.407 0.405<br />

σ(A✷) 0.76 0.50 0.55 0.60 0.62 0.70<br />

Table 3<br />

Comparison of sparseness of the recovered sources (real s-EMG data).<br />

two dimensions is plotted <strong>in</strong> Fig. 10(f). Note that the SCA matrix columns<br />

match two columns of the mix<strong>in</strong>g matrices found by the other methods.<br />

Similar to the toy data set, we compare the recoveries based on the different<br />

methods us<strong>in</strong>g various <strong>in</strong>dices from section 2.3 for mix<strong>in</strong>g matrices and recovered<br />

sources , Fig. 11. In contrast to the artificial signals, here all methods<br />

yield rather similar performance, the mean Amari <strong>in</strong>dices are roughly half the<br />

value of the <strong>in</strong>dices <strong>in</strong> the toy data sett<strong>in</strong>g. This confirms that the methods<br />

recover rather similar sources.<br />

As <strong>in</strong> the case of artificial signals, we aga<strong>in</strong> compare the sparseness of the<br />

recovered sources, see Tab. 3. Due to the noise present <strong>in</strong> the real data, the<br />

signals are clearly less sparse than the artificial data. Furthermore a comparison<br />

between the various methods yields noticeably less differences than <strong>in</strong><br />

the case of artificial signals. At first glance it seems unclear why SCA performs<br />

worse <strong>in</strong> terms of k-sparseness (us<strong>in</strong>g σ(A)) than the NMF methods,<br />

but better than JADE. This however can be expla<strong>in</strong>ed by the fact that the<br />

PCA dimension reduction reduces the number of parameters hence SCA cannot<br />

search the whole space, so it performs worse than NMF <strong>in</strong> that respect.<br />

However it outperforms JADE, which also uses PCA preprocess<strong>in</strong>g.<br />

22

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!