Abstract
We present a novel algorithm for approximating the parameters of a multivariate t-distribution. At the expense of a slightly decreased accuracy in the estimates, the proposed algorithm is significantly faster and easier to implement compared to the maximum likelihood estimates computed using the expectation-maximization algorithm. The formulation of the proposed algorithm also provides theoretical guidance for solving problems that are intractable with the maximum likelihood equations. In particular, we show how the proposed algorithm can be modified to give an incremental solution for fast online parameter estimation. Finally, we validate the effectiveness of the proposed algorithm by using the approximated t-distribution as a drop in replacement for the conventional Gaussian distribution in two computer vision applications: object recognition and tracking. In both cases the t-distribution gives better performance with no increase in computation.
Chapter PDF
Similar content being viewed by others
Keywords
- Approximate Algorithm
- Multivariate Gaussian Distribution
- Incremental Algorithm
- Scale Matrix
- Parameter Estimation Algorithm
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Aeschliman, C., Park, J., Kak, A.C.: A Probabilistic Framework for Joint Segmentation and Tracking. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (2010)
Chen, F., Lambert, D., Pinheiro, J.C.: Incremental quantile estimation for massive tracking. In: Proceedings of the Sixth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 516–522. ACM, New York (2000)
Geusebroek, J.M., Burghouts, G.J., Smeulders, A.W.M.: The Amsterdam library of object images. International Journal of Computer Vision 61(1), 103–112 (2005)
Iscaps, C.: Pets2006 (2006), http://www.cvg.rdg.ac.uk/pets2006/data.html
Khan, Z., Balch, T., Dellaert, F.: MCMC-based particle filtering for tracking a variable number of interacting targets. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1805–1918 (2005)
Kotz, S., Nadarajah, S.: Multivariate t distributions and their applications. Cambridge Univ. Pr., Cambridge (2004)
Lange, K.L., Little, R.J.A., Taylor, J.M.G.: Robust statistical modeling using the t distribution. Journal of the American Statistical Association, 881–896 (1989)
Liu, C., Rubin, D.B.: ML estimation of the t distribution using EM and its extensions, ECM and ECME. Statistica Sinica 5(1), 19–39 (1995)
Meng, X.L., van Dyk, D.: The EM algorithm–an old folk-song sung to a fast new tune. Journal of the Royal Statistical Society. Series B (Methodological), 511–567 (1997)
Nadarajah, S., Kotz, S.: Estimation Methods for the Multivariate t Distribution. Acta Applicandae Mathematicae: An International Survey Journal on Applying Mathematics and Mathematical Applications 102(1), 99–118 (2008)
Nguyen, H.T., Ji, Q., Smeulders, A.W.M.: Spatio-temporal context for robust multitarget tracking. IEEE Transactions on Pattern Analysis and Machine Intelligence 29(1), 52 (2007)
Peel, D., McLachlan, G.: Robust mixture modelling using the t distribution. Statistics and Computing 10(4), 339–348 (2000)
Rothenberg, T.J., Fisher, F.M., Tilanus, C.B.: A note on estimation from a Cauchy sample. Journal of the American Statistical Association 59(306), 460–463 (1964)
Simoncelli, E.P.: Statistical modeling of photographic images. In: Handbook of Image and Video Processing, pp. 431–441 (2005)
Tierney, L.: A space-efficient recursive procedure for estimating a quantile of an unknown distribution. SIAM Journal on Scientific and Statistical Computing 4, 706 (1983)
Tipping, M., Bishop, C.M.: Probabilistic principal component analysis. Journal of the Royal Statistical Society. Series B (Statistical Methodology) 61(3), 611–622 (1999)
Zhao, J., Jiang, Q.: Probabilistic PCA for t distributions. Neurocomputing 69(16-18), 2217–2226 (2006)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Aeschliman, C., Park, J., Kak, A.C. (2010). A Novel Parameter Estimation Algorithm for the Multivariate t-Distribution and Its Application to Computer Vision. In: Daniilidis, K., Maragos, P., Paragios, N. (eds) Computer Vision – ECCV 2010. ECCV 2010. Lecture Notes in Computer Science, vol 6312. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-15552-9_43
Download citation
DOI: https://doi.org/10.1007/978-3-642-15552-9_43
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-15551-2
Online ISBN: 978-3-642-15552-9
eBook Packages: Computer ScienceComputer Science (R0)