Abstract
To overcome the problems associated with high dimensionality, such as high storage and classification time, dimension reduction is usually applied to the vectors to concentrate relevant information in a low dimension. Locally Linear Embedding (LLE) is a well-known dimension reduction scheme. However, it works with vectorized representations of images and does not take into account the spatial locality relation information of images, thus some information will be lost. In this paper, a new dimension reduction scheme, called Small Matrix Vector Locally Linear Embedding (SMVLLE), is presented. Using SMVLLE which is based on small matrix cover for dimension reduction can reduce the loss of spatial locality relation information among image pixels, because this scheme works directly with images in their native state. Experiments on handwritten digit images and texture images show that SMVLLE is superior to LLE in terms of quality of the dimension reduction.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
MacKay, D.B., Lilly, B.: Percept Variance, Subadditivity and the Metric Classification of Similarity, and Dissimilarity Data. Journal of Classification 21(2), 185–206 (2004)
Cortes, C., Vapnik, V.: Support Vector Networks. Machine Learning 20, 273–297 (1995)
Nishii, R.: A Markov Random Field-based Approach to Decision Level Fusion for Remote Sensing Image Classification. IEEE Transactions on Geoscience and Remote Sensing 41(10), 2316–2319 (2003)
Aggarwal, C.: On the Effects of Dimensionality Reduction on High Dimensional Similarity Search. In: ACM Principles of Database Systems Conference Proceedings, pp. 256–266 (2001)
Roweis, S.T., Saul, L.K.: Nonlinear Dimensionality Reduction by Locally Linear Embedding. Science 290, 2323–2326 (2000)
Yang, Z.Y., Zhu, H., Song, J.T.: Further Study on the Smoothed Analysis of Condition Number of Matrix and Gaussian Algorithm. Journal of Software 15(5), 650–659 (2004)
Dai, H.: Matrix Theory. Science Press 8, 175–176 (2001)
Roweis, S.T., Saul, L.K.: Locally Linear Embedding (2001), http://www.gatsby.ucl.ac.uk/~roweis/lle
Hadid, A., Kouropteva, O., Pietikäinen, M.: Unsupervised Learning Using Locally Linear Embedding: Experiments in Face Pose Analysis. 16th International Conference on Pattern Recognition 1, 111–114 (2002)
Roweis, S.T., Saul, L.K.: Think Globally, Fit Locally: Unsupervised Learning of Nonlinear Manifolds. Journal of Machine Learning Research 4, 119–155 (2003)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Wang, H. (2009). SMVLLE: An Efficient Dimension Reduction Scheme. In: Yu, W., He, H., Zhang, N. (eds) Advances in Neural Networks – ISNN 2009. ISNN 2009. Lecture Notes in Computer Science, vol 5552. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-01510-6_70
Download citation
DOI: https://doi.org/10.1007/978-3-642-01510-6_70
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-01509-0
Online ISBN: 978-3-642-01510-6
eBook Packages: Computer ScienceComputer Science (R0)