Abstract
This paper proposes a solution to bridge the gap between semantic and visual information formulated as a structural pattern recognition problem. Instances of semantic classes expressed by Description Graphs are detected on a region-based representation of visual data expressed with a Binary Partition Tree. The detection process builds instances of Semantic Trees on the top of the Binary Partition Tree using an encyclopedia of models organised as a hierarchy. At the leaves of the Semantic Tree, classes are defined by perceptual models containing a list of low-level descriptors. The proposed solution is assessed in different environments to show its flexibility.
This work has been partly supported by the EU project IP506909 CHIL, and by the grant TEC2004-01914 of the Spanish Government.
This is a preview of subscription content, log in via an institution to check access.
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Leung, T.K., Burl, M.C., Perona, P.: Finding faces in cluttered scenes using random labeled graph matching. In: IEEE International Conference on Computer Vision, ICCV 1995, Cambridge, USA, pp. 637–644 (1995)
Jaimes, A., Chang, S.-F.: Learning structured visual descriptors from user input at multiple levels. International Journal of Image and Graphics 1, 415–444 (2001)
Naphade, M., Kozintsev, I., Huang, T.: Factor graph framework for semantic video indexing. IEEE Transactions on Circuits and Systems for Video Technology 12, 40–52 (2002)
Salembier, P., Marqués, F.: Region-based representations of image and video: segmentation tools for multimedia services. IEEE Transactions on Circuits and Systems for Video Technology 9, 1147–1169 (1999)
Salembier, P., Garrido, L.: Binary partition tree as an efficient representation for image processing, segmentation and information retrieval. IEEE Trans. on Image Processing 9, 561–576 (2000)
Vilaplana, V., Giró, X., Salembier, P., Marqués, F.: Region-based extraction and analysis of visual objects information. In: 4th Int. Workshop on Content-Based Multimedia Indexing, CBMI 2005, Riga, Latvia, pp. SSI.3.1–SSI.3.9 (2005)
Giró, X., Vilaplana, V., Marqués, F., Salembier, P.: 7. Automatic extraction and analysis of visual objects information. In: Multimedia Content and the Semantic Web, pp. 203–221. Wiley, Chichester (2005)
Ferran Bennstrom, C., Casas, J.: Object representation using colour, shape and structure criteria in a binary partition tree. In: IEEE Intern. Conf. on Image Processing, ICIP 2005, Genova, Italy, vol. 3, pp. 1144–1147 (2005)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Giro, X., Marques, F. (2006). From Partition Trees to Semantic Trees. In: Gunsel, B., Jain, A.K., Tekalp, A.M., Sankur, B. (eds) Multimedia Content Representation, Classification and Security. MRCS 2006. Lecture Notes in Computer Science, vol 4105. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11848035_41
Download citation
DOI: https://doi.org/10.1007/11848035_41
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-39392-4
Online ISBN: 978-3-540-39393-1
eBook Packages: Computer ScienceComputer Science (R0)