Estimating the support of a high-dimensional distribution
- PMID: 11440593
- DOI: 10.1162/089976601750264965
Estimating the support of a high-dimensional distribution
Abstract
Suppose you are given some data set drawn from an underlying probability distribution P and you want to estimate a "simple" subset S of input space such that the probability that a test point drawn from P lies outside of S equals some a priori specified value between 0 and 1. We propose a method to approach this problem by trying to estimate a function f that is positive on S and negative on the complement. The functional form of f is given by a kernel expansion in terms of a potentially small subset of the training data; it is regularized by controlling the length of the weight vector in an associated feature space. The expansion coefficients are found by solving a quadratic programming problem, which we do by carrying out sequential optimization over pairs of input patterns. We also provide a theoretical analysis of the statistical performance of our algorithm. The algorithm is a natural extension of the support vector algorithm to the case of unlabeled data.
Similar articles
-
A regularized kernel CCA contrast function for ICA.Neural Netw. 2008 Mar-Apr;21(2-3):170-81. doi: 10.1016/j.neunet.2007.12.047. Epub 2008 Jan 10. Neural Netw. 2008. PMID: 18280110
-
Bayesian framework for least-squares support vector machine classifiers, gaussian processes, and kernel Fisher discriminant analysis.Neural Comput. 2002 May;14(5):1115-47. doi: 10.1162/089976602753633411. Neural Comput. 2002. PMID: 11972910
-
Fast and efficient strategies for model selection of Gaussian support vector machine.IEEE Trans Syst Man Cybern B Cybern. 2009 Oct;39(5):1292-307. doi: 10.1109/TSMCB.2009.2015672. Epub 2009 Mar 31. IEEE Trans Syst Man Cybern B Cybern. 2009. PMID: 19342351
-
Combining multivariate voxel selection and support vector machines for mapping and classification of fMRI spatial patterns.Neuroimage. 2008 Oct 15;43(1):44-58. doi: 10.1016/j.neuroimage.2008.06.037. Epub 2008 Jul 11. Neuroimage. 2008. PMID: 18672070
-
Class-incremental generalized discriminant analysis.Neural Comput. 2006 Apr;18(4):979-1006. doi: 10.1162/089976606775774633. Neural Comput. 2006. PMID: 16494698
Cited by
-
Fingerprint Liveness Detection in the Presence of Capable Intruders.Sensors (Basel). 2015 Jun 19;15(6):14615-38. doi: 10.3390/s150614615. Sensors (Basel). 2015. PMID: 26102491 Free PMC article.
-
Using bioinformatic approaches to identify pathways targeted by human leukemogens.Int J Environ Res Public Health. 2012 Jul;9(7):2479-503. doi: 10.3390/ijerph9072479. Epub 2012 Jul 12. Int J Environ Res Public Health. 2012. PMID: 22851955 Free PMC article.
-
Idiosyncratic brain activation patterns are associated with poor social comprehension in autism.J Neurosci. 2015 Apr 8;35(14):5837-50. doi: 10.1523/JNEUROSCI.5182-14.2015. J Neurosci. 2015. PMID: 25855192 Free PMC article.
-
Automatic segmentation of amyloid plaques in MR images using unsupervised support vector machines.Magn Reson Med. 2012 Jun;67(6):1794-802. doi: 10.1002/mrm.23138. Epub 2011 Aug 16. Magn Reson Med. 2012. PMID: 22189675 Free PMC article.
-
Detection of abnormal events via optical flow feature analysis.Sensors (Basel). 2015 Mar 24;15(4):7156-71. doi: 10.3390/s150407156. Sensors (Basel). 2015. PMID: 25811227 Free PMC article.
LinkOut - more resources
Full Text Sources
Other Literature Sources