174 Chapter 11. EURASIP JASP, 2007 Fabian J. Theis et al. 13 [19] M. Zibulevsky and B. A. Pearlmutter, “Bl<strong>in</strong>d source separation by sparse decomposition <strong>in</strong> a signal dictionary,” Neural Computation, vol. 13, no. 4, pp. 863–882, 2001. [20] F. J. Theis, P. Georgiev, and A. Cichocki, “Robust overcomplete matrix recovery for sparse sources us<strong>in</strong>g a generalized Hough transform,” <strong>in</strong> Proceed<strong>in</strong>gs of 12th European Symposium on Artificial Neural Networks (ESANN ’04), pp. 343–348, Bruges, Belgium, April 2004, d-side, Evere, Belgium. [21] P. S. Bradley and O. L. Mangasarian, “k-plane cluster<strong>in</strong>g,” Journal of Global Optimization, vol. 16, no. 1, pp. 23–32, 2000. [22] P. Georgiev, P. Pardalos, F. J. Theis, A. Cichocki, and H. Bakardjian, “Sparse component analysis: a new tool for data m<strong>in</strong><strong>in</strong>g,” <strong>in</strong> Data M<strong>in</strong><strong>in</strong>g <strong>in</strong> Biomedic<strong>in</strong>e, Spr<strong>in</strong>ger, New York, NY, USA, 2005, <strong>in</strong> pr<strong>in</strong>t. [23] P. Georgiev, F. J. Theis, and A. Cichocki, “Optimization algorithms for sparse representations and applications,” <strong>in</strong> Multiscale Optimization Methods, P. Pardalos, Ed., Spr<strong>in</strong>ger, New York, NY, USA, 2005. [24] R. O. Duda and P. E. Hart, “Use of the Hough transformation to detect l<strong>in</strong>es and curves <strong>in</strong> pictures,” Communications of the ACM, vol. 15, no. 1, pp. 204–208, 1972. [25] R. Dudley, Department of <strong>Mathematics</strong>, MIT, course 18.465, 2005. [26] P. J. Rousseeuw and A. M. Leroy, Robust Regression and Outlier Detection, John Wiley & Sons, New York, NY, USA, 1987. [27] P. Ballester, “Applications of the Hough transform,” <strong>in</strong> Astronomical Data <strong>Analysis</strong> Software and Systems III, J. Barnes, D. R. Crabtree, and R. J. Hanisch, Eds., vol. 61 of ASP Conference Series, 1994. [28] A. Goldenshluger and A. Zeevi, “The Hough transform estimator,” Annals of Statistics, vol. 32, no. 5, pp. 1908–1932, 2004. [29] A. Hyvär<strong>in</strong>en and E. Oja, “A fast fixed-po<strong>in</strong>t algorithm for <strong>in</strong>dependent component analysis,” Neural Computation, vol. 9, no. 7, pp. 1483–1492, 1997. [30] F. J. Theis and G. A. García, “On the use of sparse signal decomposition <strong>in</strong> the analysis of multi-channel surface electromyograms,” Signal Process<strong>in</strong>g, vol. 86, no. 3, pp. 603–623, 2006. Fabian J. Theis obta<strong>in</strong>ed his M.S. degree <strong>in</strong> mathematics and physics from the University of Regensburg, Germany, <strong>in</strong> 2000. He also received the Ph.D. degree <strong>in</strong> physics from the same university <strong>in</strong> 2002 and the Ph.D. degree <strong>in</strong> computer science from the University of Granada <strong>in</strong> 2003. He worked as a Visit<strong>in</strong>g Researcher at the Department of Architecture and Computer Technology (University of Granada, Spa<strong>in</strong>), at the RIKEN Bra<strong>in</strong> Science Institute (Wako, Japan), at FAMU-FSU (Florida State University, USA), and at TUAT’s Laboratory for Signal and Image Process<strong>in</strong>g (Tokyo, Japan). Currently, he is head<strong>in</strong>g the Signal Process<strong>in</strong>g & Information Theory Group at the Institute of Biophysics at the University of Regensburg and is work<strong>in</strong>g on his habilitation. He serves as an Associate Editor of “Computational Intelligence and Neuroscience,” and is a Member of IEEE, EURASIP, and ENNS. His research <strong>in</strong>terests <strong>in</strong>clude statistical signal process<strong>in</strong>g, mach<strong>in</strong>e learn<strong>in</strong>g, bl<strong>in</strong>d source separation, and biomedical data analysis. Pando Georgiev received his M.S., Ph.D., and “Doctor of Mathematical Sciences” degrees <strong>in</strong> mathematics (operations research) from Sofia University “St. Kl. Ohridski,” Bulgaria, <strong>in</strong> 1982, 1987, and 2001, respectively. He has been with the Department of Probability, Operations Research, and Statistics at the Faculty of <strong>Mathematics</strong> and Informatics, Sofia University “St. Kl. Ohridski,” Bulgaria, as an Assistant Professor (1989–1994), and s<strong>in</strong>ce 1994, as an Associate Professor. He was a Visit<strong>in</strong>g Professor at the University of Rome II, Italy (CNR grants, several one-month visits), the International Center for Theoretical Physics, Trieste, Italy (ICTP grant, six months), the University of Pau, France (NATO grant, three months), Hirosaki University, Japan (JSPS grant, n<strong>in</strong>e months), and so forth. He has been work<strong>in</strong>g for four years (2000–2004) as a research scientist at the Laboratory for Advanced Bra<strong>in</strong> Signal Process<strong>in</strong>g, Bra<strong>in</strong> Science Institute, the Institute of Physical and Chemical Research (RIKEN), Wako, Japan. After that and currently he is a Visit<strong>in</strong>g Scholar <strong>in</strong> ECECS Department, University of C<strong>in</strong>c<strong>in</strong>nati, USA. His <strong>in</strong>terests <strong>in</strong>clude mach<strong>in</strong>e learn<strong>in</strong>g and computational <strong>in</strong>telligence, <strong>in</strong>dependent and sparse component analysis, bl<strong>in</strong>d signal separation, statistics and <strong>in</strong>verse problems, signal and image process<strong>in</strong>g, optimization, and variational analysis. He is a Member of AMS, IEEE, and UBM. Andrzej Cichocki was born <strong>in</strong> Poland. He received the M.S. (with honors), Ph.D., and Habilitate Doctorate (Dr.Sc.) degrees, all <strong>in</strong> electrical eng<strong>in</strong>eer<strong>in</strong>g, from the Warsaw University of Technology (Poland) <strong>in</strong> 1972, 1975, and 1982, respectively. He is the coauthor of three <strong>in</strong>ternational and successful books (two of them were translated to Ch<strong>in</strong>ese): Adaptive Bl<strong>in</strong>d Signal and Image Process<strong>in</strong>g (John Wiley, 2002) MOS Switched- Capacitor and Cont<strong>in</strong>uous-Time Integrated Circuits and Systems (Spr<strong>in</strong>ger, 1989), and Neural Networks for Optimization and Signal Process<strong>in</strong>g (J. Wiley and Teubner Verlag, 1993/1994) and the author or coauthor of more than three hundred papers. He is the Editor<strong>in</strong>-Chief of the Journal Computational Intelligence and Neuroscience and an Associate Editor of IEEE Transactions on Neural Networks. S<strong>in</strong>ce 1997, he has been the Head of the Laboratory for Advanced Bra<strong>in</strong> Signal Process<strong>in</strong>g <strong>in</strong> the Riken Bra<strong>in</strong> Science Institute, Japan.
Chapter 12 LNCS 3195:718-725, 2004 Paper F.J. Theis and S. Amari. Postnonl<strong>in</strong>ear overcomplete bl<strong>in</strong>d source separation us<strong>in</strong>g sparse sources. In Proc. ICA 2004, volume 3195 of LNCS, pages 718- 725, Granada, Spa<strong>in</strong>, 2004 Reference (Theis and Amari, 2004) Summary <strong>in</strong> section 1.4.1 175
- Page 1 and 2:
Statistical machine learning of bio
- Page 3:
to Jakob
- Page 6 and 7:
vi Preface
- Page 8 and 9:
viii CONTENTS 3 Signal Processing 8
- Page 11 and 12:
Chapter 1 Statistical machine learn
- Page 13 and 14:
1.1. Introduction 5 auditory cortex
- Page 15 and 16:
1.2. Uniqueness issues in independe
- Page 17 and 18:
1.2. Uniqueness issues in independe
- Page 19 and 20:
S U M M A R Y T his �le contains
- Page 21 and 22:
1.3. Dependent component analysis 1
- Page 23 and 24:
Table 1.1: BSS algorithms based on
- Page 25 and 26:
1.3. Dependent component analysis 1
- Page 27 and 28:
1.3. Dependent component analysis 1
- Page 29 and 30:
1.3. Dependent component analysis 2
- Page 31 and 32:
1.3. Dependent component analysis 2
- Page 33 and 34:
1.4. Sparseness 25 1.4 Sparseness O
- Page 35 and 36:
1.4. Sparseness 27 Theorem 1.4.3 (S
- Page 37 and 38:
1.4. Sparseness 29 R 3 R 3 A BSRA R
- Page 39 and 40:
1.4. Sparseness 31 Sparse projectio
- Page 41 and 42:
1.5. Machine learning for data prep
- Page 43 and 44:
1.5. Machine learning for data prep
- Page 45 and 46:
1.5. Machine learning for data prep
- Page 47 and 48:
1.5. Machine learning for data prep
- Page 49 and 50:
1.5. Machine learning for data prep
- Page 51 and 52:
1.6. Applications to biomedical dat
- Page 53 and 54:
1.6. Applications to biomedical dat
- Page 55 and 56:
1.6. Applications to biomedical dat
- Page 57 and 58:
1.6. Applications to biomedical dat
- Page 59 and 60:
1.7. Outlook 51 noise data signal i
- Page 61:
Part II Papers 53
- Page 64 and 65:
56 Chapter 2. Neural Computation 16
- Page 66 and 67:
58 Chapter 2. Neural Computation 16
- Page 68 and 69:
60 Chapter 2. Neural Computation 16
- Page 70 and 71:
62 Chapter 2. Neural Computation 16
- Page 72 and 73:
64 Chapter 2. Neural Computation 16
- Page 74 and 75:
66 Chapter 2. Neural Computation 16
- Page 76 and 77:
68 Chapter 2. Neural Computation 16
- Page 78 and 79:
70 Chapter 2. Neural Computation 16
- Page 80 and 81:
72 Chapter 2. Neural Computation 16
- Page 82 and 83:
74 Chapter 2. Neural Computation 16
- Page 84 and 85:
76 Chapter 2. Neural Computation 16
- Page 86 and 87:
78 Chapter 2. Neural Computation 16
- Page 88 and 89:
80 Chapter 2. Neural Computation 16
- Page 90 and 91:
82 Chapter 3. Signal Processing 84(
- Page 92 and 93:
84 Chapter 3. Signal Processing 84(
- Page 94 and 95:
86 Chapter 3. Signal Processing 84(
- Page 96 and 97:
88 Chapter 3. Signal Processing 84(
- Page 98 and 99:
90 Chapter 4. Neurocomputing 64:223
- Page 100 and 101:
92 Chapter 4. Neurocomputing 64:223
- Page 102 and 103:
94 Chapter 4. Neurocomputing 64:223
- Page 104 and 105:
96 Chapter 4. Neurocomputing 64:223
- Page 106 and 107:
98 Chapter 4. Neurocomputing 64:223
- Page 108 and 109:
100 Chapter 4. Neurocomputing 64:22
- Page 110 and 111:
102 Chapter 4. Neurocomputing 64:22
- Page 112 and 113:
104 Chapter 5. IEICE TF E87-A(9):23
- Page 114 and 115:
106 Chapter 5. IEICE TF E87-A(9):23
- Page 116 and 117:
108 Chapter 5. IEICE TF E87-A(9):23
- Page 118 and 119:
110 Chapter 5. IEICE TF E87-A(9):23
- Page 120 and 121:
112 Chapter 5. IEICE TF E87-A(9):23
- Page 122 and 123:
114 Chapter 6. LNCS 3195:726-733, 2
- Page 124 and 125:
116 Chapter 6. LNCS 3195:726-733, 2
- Page 126 and 127:
118 Chapter 6. LNCS 3195:726-733, 2
- Page 128 and 129:
120 Chapter 6. LNCS 3195:726-733, 2
- Page 130 and 131:
122 Chapter 6. LNCS 3195:726-733, 2
- Page 132 and 133: 124 Chapter 7. Proc. ISCAS 2005, pa
- Page 134 and 135: 126 Chapter 7. Proc. ISCAS 2005, pa
- Page 136 and 137: 128 Chapter 7. Proc. ISCAS 2005, pa
- Page 138 and 139: 130 Chapter 8. Proc. NIPS 2006 Towa
- Page 140 and 141: 132 Chapter 8. Proc. NIPS 2006 1.3
- Page 142 and 143: 134 Chapter 8. Proc. NIPS 2006 stru
- Page 144 and 145: 136 Chapter 8. Proc. NIPS 2006 5.5
- Page 146 and 147: 138 Chapter 8. Proc. NIPS 2006
- Page 148 and 149: 140 Chapter 9. Neurocomputing (in p
- Page 150 and 151: 142 Chapter 9. Neurocomputing (in p
- Page 152 and 153: 144 Chapter 9. Neurocomputing (in p
- Page 154 and 155: 146 Chapter 9. Neurocomputing (in p
- Page 156 and 157: 148 Chapter 9. Neurocomputing (in p
- Page 158 and 159: 150 Chapter 9. Neurocomputing (in p
- Page 160 and 161: 152 Chapter 9. Neurocomputing (in p
- Page 162 and 163: 154 Chapter 9. Neurocomputing (in p
- Page 164 and 165: 156 Chapter 10. IEEE TNN 16(4):992-
- Page 166 and 167: 158 Chapter 10. IEEE TNN 16(4):992-
- Page 168 and 169: 160 Chapter 10. IEEE TNN 16(4):992-
- Page 170 and 171: 162 Chapter 11. EURASIP JASP, 2007
- Page 172 and 173: 164 Chapter 11. EURASIP JASP, 2007
- Page 174 and 175: 166 Chapter 11. EURASIP JASP, 2007
- Page 176 and 177: 168 Chapter 11. EURASIP JASP, 2007
- Page 178 and 179: 170 Chapter 11. EURASIP JASP, 2007
- Page 180 and 181: 172 Chapter 11. EURASIP JASP, 2007
- Page 184 and 185: 176 Chapter 12. LNCS 3195:718-725,
- Page 186 and 187: 178 Chapter 12. LNCS 3195:718-725,
- Page 188 and 189: 180 Chapter 12. LNCS 3195:718-725,
- Page 190 and 191: 182 Chapter 12. LNCS 3195:718-725,
- Page 192 and 193: 184 Chapter 12. LNCS 3195:718-725,
- Page 194 and 195: 186 Chapter 13. Proc. EUSIPCO 2005
- Page 196 and 197: 188 Chapter 13. Proc. EUSIPCO 2005
- Page 198 and 199: 190 Chapter 13. Proc. EUSIPCO 2005
- Page 200 and 201: 192 Chapter 14. Proc. ICASSP 2006 S
- Page 202 and 203: 194 Chapter 14. Proc. ICASSP 2006 A
- Page 204 and 205: 196 Chapter 14. Proc. ICASSP 2006
- Page 206 and 207: 198 Chapter 15. Neurocomputing, 69:
- Page 208 and 209: 200 Chapter 15. Neurocomputing, 69:
- Page 210 and 211: 202 Chapter 15. Neurocomputing, 69:
- Page 212 and 213: 204 Chapter 15. Neurocomputing, 69:
- Page 214 and 215: 206 Chapter 15. Neurocomputing, 69:
- Page 216 and 217: 208 Chapter 15. Neurocomputing, 69:
- Page 218 and 219: 210 Chapter 15. Neurocomputing, 69:
- Page 220 and 221: 212 Chapter 15. Neurocomputing, 69:
- Page 222 and 223: 214 Chapter 15. Neurocomputing, 69:
- Page 224 and 225: 216 Chapter 15. Neurocomputing, 69:
- Page 226 and 227: 218 Chapter 15. Neurocomputing, 69:
- Page 228 and 229: 220 Chapter 15. Neurocomputing, 69:
- Page 230 and 231: 222 Chapter 15. Neurocomputing, 69:
- Page 232 and 233:
224 Chapter 15. Neurocomputing, 69:
- Page 234 and 235:
226 Chapter 15. Neurocomputing, 69:
- Page 236 and 237:
228 Chapter 15. Neurocomputing, 69:
- Page 238 and 239:
230 Chapter 16. Proc. ICA 2006, pag
- Page 240 and 241:
232 Chapter 16. Proc. ICA 2006, pag
- Page 242 and 243:
234 Chapter 16. Proc. ICA 2006, pag
- Page 244 and 245:
236 Chapter 16. Proc. ICA 2006, pag
- Page 246 and 247:
238 Chapter 16. Proc. ICA 2006, pag
- Page 248 and 249:
240 Chapter 17. IEEE SPL 13(2):96-9
- Page 250 and 251:
242 Chapter 17. IEEE SPL 13(2):96-9
- Page 252 and 253:
244 Chapter 17. IEEE SPL 13(2):96-9
- Page 254 and 255:
246 Chapter 18. Proc. EUSIPCO 2006
- Page 256 and 257:
248 Chapter 18. Proc. EUSIPCO 2006
- Page 258 and 259:
250 Chapter 18. Proc. EUSIPCO 2006
- Page 260 and 261:
252 Chapter 19. LNCS 3195:977-984,
- Page 262 and 263:
254 Chapter 19. LNCS 3195:977-984,
- Page 264 and 265:
256 Chapter 19. LNCS 3195:977-984,
- Page 266 and 267:
258 Chapter 19. LNCS 3195:977-984,
- Page 268 and 269:
260 Chapter 19. LNCS 3195:977-984,
- Page 270 and 271:
262 Chapter 20. Signal Processing 8
- Page 272 and 273:
264 Chapter 20. Signal Processing 8
- Page 274 and 275:
266 Chapter 20. Signal Processing 8
- Page 276 and 277:
268 Chapter 20. Signal Processing 8
- Page 278 and 279:
270 Chapter 20. Signal Processing 8
- Page 280 and 281:
272 Chapter 20. Signal Processing 8
- Page 282 and 283:
274 Chapter 20. Signal Processing 8
- Page 284 and 285:
276 Chapter 20. Signal Processing 8
- Page 286 and 287:
278 Chapter 20. Signal Processing 8
- Page 288 and 289:
280 Chapter 20. Signal Processing 8
- Page 290 and 291:
282 Chapter 20. Signal Processing 8
- Page 292 and 293:
284 Chapter 20. Signal Processing 8
- Page 294 and 295:
286 Chapter 20. Signal Processing 8
- Page 296 and 297:
288 Chapter 20. Signal Processing 8
- Page 298 and 299:
290 Chapter 20. Signal Processing 8
- Page 300 and 301:
292 Chapter 21. Proc. BIOMED 2005,
- Page 302 and 303:
294 Chapter 21. Proc. BIOMED 2005,
- Page 304 and 305:
296 Chapter 21. Proc. BIOMED 2005,
- Page 306 and 307:
298 BIBLIOGRAPHY Barber, C., Dobkin
- Page 308 and 309:
300 BIBLIOGRAPHY Georgiev, P. (2001
- Page 310 and 311:
302 BIBLIOGRAPHY Keck, I., Theis, F
- Page 312 and 313:
304 BIBLIOGRAPHY Schießl, I., Sch
- Page 314 and 315:
306 BIBLIOGRAPHY Theis, F. and Inou