14.02.2013 Views

Mathematics in Independent Component Analysis

Mathematics in Independent Component Analysis

Mathematics in Independent Component Analysis

SHOW MORE
SHOW LESS

Create successful ePaper yourself

Turn your PDF publications into a flip-book with our unique Google optimized e-Paper software.

60 Chapter 2. Neural Computation 16:1827-1850, 2004<br />

A New Concept for Separability Problems <strong>in</strong> BSS 1831<br />

also holds globally (see theorem 1(ii)). In this case, we have for i �= j,<br />

0 ≡ ∂i∂j ln f ≡ f ∂i∂j f − (∂i f )(∂j f )<br />

f 2<br />

,<br />

so f is separated if and only if<br />

f ∂i∂j f ≡ (∂i f )(∂j f )<br />

for i �= j or even i < j. This motivates the follow<strong>in</strong>g def<strong>in</strong>ition:<br />

Def<strong>in</strong>ition 2. For i �= j, the operator<br />

Rij : C 2 (R n , C) → C 0 (R n , C)<br />

is called the ij-separator.<br />

Theorem 1. Let f ∈ C 2 (R n , C).<br />

f ↦→ Rij[ f ]:= f ∂i∂j f − (∂i f )(∂j f )<br />

i. If f is separated, then Rij[ f ] ≡ 0 for i �= j or, equivalently,<br />

f ∂i∂j f ≡ (∂i f )(∂j f ) (2.1)<br />

holds for i �= j.<br />

ii. If f is positive and Rij[ f ] ≡ 0 holds for all i �= j, then f is separated.<br />

If f is assumed to be only nonnegative, then f is locally separated but<br />

not necessarily globally separated (if the support of f has more than one<br />

component). See Figure 1 for an example of a nonseparated density with<br />

R12[ f ] ≡ 0.<br />

Proof of Theorem 1.i. If f is separated, then f (x) = g1(x1) ···gn(xn) or<br />

short f ≡ g1 ⊗···⊗gn,so<br />

and<br />

∂i f ≡ g1 ⊗···⊗gi−1 ⊗ g ′ i ⊗ gi+1 ⊗···⊗gn<br />

∂i∂j f ≡ g1 ⊗···⊗gi−1 ⊗ g ′ i ⊗ gi+1 ⊗···⊗gj−1 ⊗ g ′ j ⊗ gj+1 ⊗···⊗gn<br />

for i < j. Hence equation 2.1 holds.<br />

ii. Now assume the converse and let f be positive. Then accord<strong>in</strong>g to the<br />

remarks after lemma 1, Hln f (x) is everywhere diagonal, so lemma 1 shows<br />

that ln f is l<strong>in</strong>early separated; hence, f is separated.

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!