Generalizing discriminant analysis using the generalized singular value decomposition
- PMID: 15641730
- DOI: 10.1109/TPAMI.2004.46
Generalizing discriminant analysis using the generalized singular value decomposition
Abstract
Discriminant analysis has been used for decades to extract features that preserve class separability. It is commonly defined as an optimization problem involving covariance matrices that represent the scatter within and between clusters. The requirement that one of these matrices be nonsingular limits its application to data sets with certain relative dimensions. We examine a number of optimization criteria, and extend their applicability by using the generalized singular value decomposition to circumvent the nonsingularity requirement. The result is a generalization of discriminant analysis that can be applied even when the sample size is smaller than the dimension of the sample data. We use classification results from the reduced representation to compare the effectiveness of this approach with some alternatives, and conclude with a discussion of their relative merits.
Similar articles
-
An optimization criterion for generalized discriminant analysis on undersampled problems.IEEE Trans Pattern Anal Mach Intell. 2004 Aug;26(8):982-94. doi: 10.1109/TPAMI.2004.37. IEEE Trans Pattern Anal Mach Intell. 2004. PMID: 15641729
-
A two-stage linear discriminant analysis via QR-decomposition.IEEE Trans Pattern Anal Mach Intell. 2005 Jun;27(6):929-41. doi: 10.1109/TPAMI.2005.110. IEEE Trans Pattern Anal Mach Intell. 2005. PMID: 15943424
-
Dimensionality reduction of clustered data sets.IEEE Trans Pattern Anal Mach Intell. 2008 Mar;30(3):535-40. doi: 10.1109/TPAMI.2007.70819. IEEE Trans Pattern Anal Mach Intell. 2008. PMID: 18195446
-
Discriminant subspace analysis: a Fukunaga-Koontz approach.IEEE Trans Pattern Anal Mach Intell. 2007 Oct;29(10):1732-45. doi: 10.1109/TPAMI.2007.1089. IEEE Trans Pattern Anal Mach Intell. 2007. PMID: 17699919
-
Discriminative learning and recognition of image set classes using canonical correlations.IEEE Trans Pattern Anal Mach Intell. 2007 Jun;29(6):1005-18. doi: 10.1109/TPAMI.2007.1037. IEEE Trans Pattern Anal Mach Intell. 2007. PMID: 17431299
Cited by
-
Supervised Filter Learning for Representation Based Face Recognition.PLoS One. 2016 Jul 14;11(7):e0159084. doi: 10.1371/journal.pone.0159084. eCollection 2016. PLoS One. 2016. PMID: 27416030 Free PMC article.
-
A Comprehensive Survey on Nanophotonic Neural Networks: Architectures, Training Methods, Optimization, and Activations Functions.Sensors (Basel). 2022 Jan 18;22(3):720. doi: 10.3390/s22030720. Sensors (Basel). 2022. PMID: 35161464 Free PMC article.
-
Kernel-based distance metric learning for microarray data classification.BMC Bioinformatics. 2006 Jun 14;7:299. doi: 10.1186/1471-2105-7-299. BMC Bioinformatics. 2006. PMID: 16774678 Free PMC article.
-
DISCO-SCA and properly applied GSVD as swinging methods to find common and distinctive processes.PLoS One. 2012;7(5):e37840. doi: 10.1371/journal.pone.0037840. Epub 2012 May 31. PLoS One. 2012. PMID: 22693578 Free PMC article.
-
Mathematically universal and biologically consistent astrocytoma genotype encodes for transformation and predicts survival phenotype.APL Bioeng. 2018 Sep;2(3):031909. doi: 10.1063/1.5037882. Epub 2018 Sep 19. APL Bioeng. 2018. PMID: 30397684 Free PMC article.
Publication types
MeSH terms
LinkOut - more resources
Full Text Sources
Other Literature Sources