Dimensionality Reduction Based on ICA for Regression Problems | SpringerLink
Skip to main content
Springer Nature Link
Log in

Dimensionality Reduction Based on ICA for Regression Problems

  • Conference paper
Artificial Neural Networks – ICANN 2006 (ICANN 2006)

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 4131))

Included in the following conference series:

  • 3443 Accesses

Abstract

In manipulating data such as in supervised learning, we often extract new features from the original features for the purpose of reducing the dimensions of feature space and achieving better performance. In this paper, we show how standard algorithms for independent component analysis (ICA) can be applied to extract features for regression problems. The advantage is that general ICA algorithms become available to a task of feature extraction for regression problems by maximizing the joint mutual information between target variable and new features. Using the new features, we can greatly reduce the dimension of feature space without degrading the regression performance.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Similar content being viewed by others

References

  1. Joliffe, I.T.: Principal Component Analysis. Springer, Heidelberg (1986)

    Google Scholar 

  2. Bell, A.J., Sejnowski, T.J.: An information-maximization approach to blind separation and blind deconvolution. Neural Computation 7(6) (June 1995)

    Google Scholar 

  3. Lee, T.-W., Girolami, M., Sejnowski, T.J.: Independent component analysis using an extended infomax algorithm for mixed sub-gaussian and super-gaussian sources. Neural Computation 11(2) (February 1999)

    Google Scholar 

  4. Fukunaga, K.: Introduction to Statistical Pattern Recognition, 2nd edn. Academic Press, London (1990)

    MATH  Google Scholar 

  5. Kwak, N., Choi, C.-H.: Feature extraction based on ICA for binary classification problems. IEEE Trans. on Knowledge and Data Engineering 15(6), 1374–1388 (2003)

    Article  Google Scholar 

  6. http://www.ics.uci.edu/~mlearn/MLSummary.html

Download references

Author information

Authors and Affiliations

  1. Samsung Electronics, P.O. Box 105, Suwon, Gyeonggi-Do, 442-742, Korea

    Nojun Kwak

  2. School of Electrical Engineering and Computer Science, Seoul National University, #047, San 56-1, Sillim-dong, Gwanak-gu, Seoul, 151-744, Korea

    Chunghoon Kim

Authors
  1. Nojun Kwak
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Chunghoon Kim
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. School of Electrical and Computer Engineering, Image, Video and Multimedia Systems Laboratory, National Technical University of Athens, GR-157 80, Zographou, Greece

    Stefanos D. Kollias

  2. Department of Electrical and Computer Engineering, National Technical University of Athens, 15780, Zographou, Greece

    Andreas Stafylopatis

  3. Department of Informatics, Nicolaus Copernicus University, Toruń, Poland

    Włodzisław Duch

  4. Adaptive Informatics Research Centre, Helsinki University of Technology, HUT, P.O. Box 5400, 02015, Finland

    Erkki Oja

Rights and permissions

Reprints and permissions

Copyright information

© 2006 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Kwak, N., Kim, C. (2006). Dimensionality Reduction Based on ICA for Regression Problems. In: Kollias, S.D., Stafylopatis, A., Duch, W., Oja, E. (eds) Artificial Neural Networks – ICANN 2006. ICANN 2006. Lecture Notes in Computer Science, vol 4131. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11840817_1

Download citation

  • DOI: https://doi.org/10.1007/11840817_1

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-38625-4

  • Online ISBN: 978-3-540-38627-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation