Abstract
Performance of state-of-the-art image retrieval systems is strongly limited due to the difficulty of accurately relating semantics conveyed by images to low-level extracted features. Moreover, dealing with the problem of combining modalities for querying is of huge importance in forthcoming retrieval methodologies and is the only solution for achieving significant retrieval performance on image documents. This paper presents an architecture addressing both of these issues which is based on an expressive formalism handling high-level image descriptions. First, it features a multi-facetted conceptual framework which integrates semantics and signal characterizations and operates on image objects (abstractions of visual entities within a physical image) in an attempt to perform indexing and querying operations beyond trivial low-level processes and region-based frameworks. Then, it features a query-by-example framework based on high-level image descriptions instead of their extracted low-level features and operate both on semantics and signal features. The flexibility of this module and the rich query language it offers, consisting of both boolean and quantification operators, lead to optimized user interaction and increased retrieval performance. Experimental results on a test collection of 2500 images show that our approach gives better results in terms of recall and precision measures than state-of-the-art frameworks which couple loosely keyword-based query modules and relevance feedback processes operating on low-level features.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Belkhatir, M., et al.: Integrating perceptual signal features within a multi-facetted conceptual model for automatic image retrieval. In: McDonald, S., Tait, J.I. (eds.) ECIR 2004. LNCS, vol. 2997, pp. 267–282. Springer, Heidelberg (2004)
Belkhatir, M.: Combining semantics and texture characterizations for precision-oriented automatic image retrieval. In: Losada, D.E., Fernández-Luna, J.M. (eds.) ECIR 2005. LNCS, vol. 3408, pp. 457–474. Springer, Heidelberg (2005)
Berlin, B., Kay, P.: Basic color terms: their universality and evolution. UC Press (1991)
Carson, C., et al.: Blobworld: A System for Region-Based Image Indexing and Retrieval. In: International Conference on Visual Information Systems, pp. 509–516 (1999)
Cox, I., et al.: The Bayesian Image Retrieval System, PicHunter: Theory, Implementation and Psychophysical Experiments. IEEE Transactions on Image Processing 9(1), 20–37 (2000)
Gong, Y., et al.: Image Indexing and Retrieval Based on Color Histograms. Multimedia Tools and Applications 2(2), 133–156 (1996)
Koenemann, J., Belkin, N.: A case for interaction: a study of interactive Information retrieval behavior and effectiveness. In: CHI 1996, pp. 205–212 (1996)
Cascia, L., et al.: Combining Textual and Visual Cues for Content-Based Image Retrieval on the World Wide Web. In: IEEE Workshop on Content-Based Access of Image and Video Libraries, pp. 24–28 (1998)
Lim, J.H.: Explicit query formulation with visual keywords. ACM Multimedia, 407–412 (2000)
Lim, J.H., et al.: Home Photo Content Modeling for Personalized Event-Based Retrieval. IEEE Multimedia 10(4) (2003)
Lu, Y., et al.: A unified framework for semantics and feature based relevance feedback in image retrieval systems. ACM Multimedia, 31–37 (2000)
Mechkour, M.: EMIR2: An Extended Model for Image Representation and Retrieval. In: Revell, N., Tjoa, A.M. (eds.) DEXA 1995. LNCS, vol. 978, pp. 395–404. Springer, Heidelberg (1995)
Miyahara, M., Yoshida, Y.: Mathematical Transform of RGB Color Data to Munsell HVC Color Data. SPIE Visual Communications & Image Processing, 650–657 (1988)
Mojsilovic, A., Rogowitz, B.: Capturing image semantics with low-level descriptors. In: ICIP, pp. 18–21 (2001)
Mulhem, P., Lim, J.H.: Symbolic photograph content-based retrieval. In: ACM CIKM, pp. 94–101 (2002)
Niblack, W., et al.: The QBIC project: Querying images by content using color, texture and shape. In: SPIE, Storage and Retrieval for Image and Video Databases, pp. 40–48 (1993)
Ounis, I., Pasca, M.: RELIEF: Combining expressiveness and rapidity into a single system. In: ACM SIGIR, pp. 266–274 (1998)
Smeulders, A.W.M., et al.: Content-based image retrieval at the end of the early years. IEEE Transactions on Pattern Analysis and Machine Intelligence 22(12), 1349–1380 (2000)
Sowa, J.F.: Conceptual structures: information processing in mind and machine. Addison-Wesley publishing company, Reading (1984)
Vapnik, V.: Statistical Learning Theory. Wiley, Chichester (1998)
Zhou, X.S., Huang, T.S.: Unifying Keywords and Visual Contents in Image Retrieval. IEEE Multimedia 9(2), 23–33 (2002)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Belkhatir, M., Mulhem, P., Chiaramella, Y. (2005). A Conceptual Image Retrieval Architecture Combining Keyword-Based Querying with Transparent and Penetrable Query-by-Example. In: Leow, WK., Lew, M.S., Chua, TS., Ma, WY., Chaisorn, L., Bakker, E.M. (eds) Image and Video Retrieval. CIVR 2005. Lecture Notes in Computer Science, vol 3568. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11526346_56
Download citation
DOI: https://doi.org/10.1007/11526346_56
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-27858-0
Online ISBN: 978-3-540-31678-7
eBook Packages: Computer ScienceComputer Science (R0)