Abstract
We first review some rigorous properties of the Hermite polynomials, and demonstrate their usefulness in estimating probability distributions as series from data samples. We then proceed to explain how these series can be used to obtain precise and robust measures of non-Gaussianity. Our measures of non-Gaussianity detect all kinds of deviations from Gaussianity, and thus provide reliable objective functions for ICA. With a linear computational complexity with respect to the sample size, our method is also suitable for large data sets.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Jones, M.C., Sibson, R.: What is Projection Pursuit? J. of Royal Statistical Society, Ser. A 150, 1–36 (1987)
Comon, P.: Independent component analysis—a new concept? Signal Processing 36, 287–314 (1994)
Blinnikov, S., Moessner, R.: Expansions for nearly Gaussian distributions. Astron. Astrophys. Suppl. Ser. 130, 193–205 (1998)
Szego, G.: Orthogonal Polynomials. AMS, Providence (1939)
Duoandikoetxea, J.: Fourier Analysis. AMS, Providence (2001)
Hyvarinen, A.: New Approximations of Differential Entropy for Independent Component Analysis and Projection Pursuit. In: Advances in Neural Information Processing Systems, vol. 10, pp. 273–279 (1998)
Faivishevsky, L., Goldberger, J.: ICA based on a Smooth Estimation of the Differential Entropy. In: Advances in Neural Information Processing Systems, vol. 21 (2009)
Van Hulle, M.M.: Multivariate Edgeworth-based Entropy Estimation. Neural Computation 17(9), 1903–1910 (2005)
Pal, D., Poczos, P., Szepesvari, C.: Estimation of Renyi Entropy and Mutual Information Based on Generalized Nearest-Neighbor Graphs. In: Advances in Neural Information Processing Systems (2010)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Puuronen, J., Hyvärinen, A. (2011). Hermite Polynomials and Measures of Non-gaussianity. In: Honkela, T., Duch, W., Girolami, M., Kaski, S. (eds) Artificial Neural Networks and Machine Learning – ICANN 2011. ICANN 2011. Lecture Notes in Computer Science, vol 6792. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-21738-8_27
Download citation
DOI: https://doi.org/10.1007/978-3-642-21738-8_27
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-21737-1
Online ISBN: 978-3-642-21738-8
eBook Packages: Computer ScienceComputer Science (R0)