Abstract
Tracking multiple targets with similar appearance is a common task in many computer vision applications as surveillance or sports analysis. We propose a Rao-Blackwellized Resampling Particle Filter (RBRPF) as a real-time multi-target tracking method that solves the data association problem by a Monte Carlo approach. Each particle containing the whole target configuration is predicted by using a process model and resampled by sampling associations and fusing of the predicted state with the assigned measurement(s) instead of the common dispersion. As each target state is modeled as a Gaussian, Rao-Blackwellization can be used to solve some of these steps analytically. The sampling of associations splits the multi-target tracking problem in multiple single target tracking problems, which can be handled by Kalman filters in an optimal way. The method is independent of the order of measurements which is mostly predetermined by the measuring process in contrast to other state-of-the-art approaches. Smart resampling and memoization is introduced to equip the tracking method with real-time capabilities in the first place exploiting the discreteness of the associations. The probabilistic framework allows for consideration of appearance models and the fusion of different sensors. A way to constrain the multiplicity of measurements associated with a single target is proposed and – along with the ability to cope with a high number of targets in clutter – evaluated in a simulation experiment. We demonstrate the applicability of the proposed method to real world applications by tracking soccer players captured by multiple cameras through occlusions in real-time.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Arulampalam, M.S., Maskell, S., Gordon, N., Clapp, T.: A tutorial on particle filters for online nonlinear/non-gaussian bayesian tracking. IEEE Trans. on Signal Processing 50(2) (2002)
Bar-Shalom, Y., Li, X.-R., Kirubarajan, T.: Estimation with Applications to Tracking and Navigation. Wiley Interscience, Hoboken (2001)
Barceló, L., Binefa, X., Kender, J.R.: Robust methods and representations for soccer player tracking and collision resolution. In: Leow, W.-K., Lew, M., Chua, T.-S., Ma, W.-Y., Chaisorn, L., Bakker, E.M. (eds.) CIVR 2005. LNCS, vol. 3568, pp. 237–246. Springer, Heidelberg (2005)
Beetz, M., Bandouch, J., Gedikli, S., von Hoyningen-Huene, N., Kirchlechner, B., Maldonado, A.: Camera-based observation of football games for analyzing multi-agent activities. In: Proc. of Intl. Joint Conf. on Autonomous Agents and Multiagent Systems, AAMAS (2006)
Beetz, M., Gedikli, S., Bandouch, J., Kirchlechner, B., von Hoyningen-Huene, N., Perzylo, A.: Visually tracking football games based on tv broadcasts. In: Proc. of Intl. Joint Conf. on Artificial Intelligence, IJCAI (2007)
Beetz, M., von Hoyningen-Huene, N., Kirchlechner, B., Gedikli, S., Siles, F., Durus, M., Lames, M.: ASPOGAMO: Automated Sports Games Analysis Models. International Journal of Computer Science in Sport 8(1) (2009)
Dearden, A., Demiris, Y., Grau, O.: Tracking football player movment from a single moving camera using particle filters. In: European Conf. on Visual Media Production, CVMP 2006 (2006)
Doucet, A.: On sequential Monte Carlo methods for Bayesian filtering. Technical report, Dept. End., Univ. Cambridge, UK (1998)
Du, W., Hayet, J.-B., Piater, J., Verly, J.: Collaborative multi-camera tracking of athletes in team sports. In: Workshop on Computer Vision Based Analysis in Sport Environments (CVBASE), pp. 2–13 (2006)
Du, W., Piater, J.H.: Multi-camera People Tracking by Collaborative Particle Filters and Principal Axis-Based Integration. In: Yagi, Y., Kang, S.B., Kweon, I.S., Zha, H. (eds.) ACCV 2007, Part I. LNCS, vol. 4843, pp. 365–374. Springer, Heidelberg (2007)
Figueroa, P.J., Leite, N.J., Barros, R.M.L.: Tracking soccer players aiming their kinematical motion analysis. Computer Vision and Image Understanding 101(2), 122–135 (2006)
Gedikli, S., Bandouch, J., von Hoyningen-Huene, N., Kirchlechner, B., Beetz, M.: An Adaptive Vision System for Tracking Soccer Players from Variable Camera Settings. In: Proc. of Intl. Conf. on Computer Vision Systems, ICVS (2007)
Horridge, P., Maskell, S.: Real-time tracking of hundreds of targets with efficient exact jpdaf implementation. In: 9th International Conference on Information Fusion, pp. 1–8 (2006)
Huang, P., Hilton, A.: Football player tracking for video annotation. In: European Conf. on Visual Media Production (2006)
Khan, Z., Balch, T., Dellaert, F.: MCMC data association and sparse factorization updating for real time multitarget tracking with merged and multiple measurements. IEEE Trans. on Pattern Analysis and Machine Intelligence 28(12), 1960–1972 (2006)
Li, Y., Dore, A., Orwell, J.: Evaluating the performance of systems for tracking football players and ball. In: IEEE Intl. Conf. on Advanced Video and Signal Based Surveillance (2005)
Liu, J., Tong, X., Li, W., Wang, T., Zhang, Y., Wang, H., Yang, B., Sun, L., Yang, S.: Automatic player detection, labeling and tracking in broadcast soccer video. In: British Machine Vision Conference (2007)
MacCormick, J., Blake, A.: A probabilistic exclusion principle for tracking multiple objects. In: Proc. of Intl. Conf. on Computer Vision (ICCV), pp. 572–578 (1999)
Nillius, P., Sullivan, J., Carlsson, S.: Multi-target tracking - linking identities using bayesian network inference. In: Proc. of Computer Vision and Pattern Recognition, pp. 2187–2194 (2006)
Särkkä, S., Vehtari, A., Lampinen, J.: Rao-Blackwellized Monte Carlo data association for multiple target tracking. In: Proc. of Intl. Conf. on Information Fusion, Stockholm, vol. 7 (2004)
Särkkä, S., Vehtari, A., Lampinen, J.: Raoblackwellized particle filter for multiple target tracking. Information Fusion Journal 8(1), 2–15 (2007)
Sullivan, J., Carlsson, S.: Tracking and labelling of interacting multiple targets. In: Leonardis, A., Bischof, H., Pinz, A. (eds.) ECCV 2006. LNCS, vol. 3953, pp. 619–632. Springer, Heidelberg (2006)
Yang, C., Duraiswami, R., Davis, L.: Fast multiple object tracking via a hierarchical particle filter. In: Proc. of Intl. Conf. on Computer Vision, vol. 1, pp. 212–219 (2005)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Hoyningen-Huene, N.v., Beetz, M. (2010). Importance Sampling as One Solution to the Data Association Problem in Multi-target Tracking. In: Ranchordas, A., Pereira, J.M., Araújo, H.J., Tavares, J.M.R.S. (eds) Computer Vision, Imaging and Computer Graphics. Theory and Applications. VISIGRAPP 2009. Communications in Computer and Information Science, vol 68. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-11840-1_23
Download citation
DOI: https://doi.org/10.1007/978-3-642-11840-1_23
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-11839-5
Online ISBN: 978-3-642-11840-1
eBook Packages: Computer ScienceComputer Science (R0)