Abstract
This paper investigates the applicability of high-level semantic features for video retrieval using the benchmarked data from TRECVID 2003 and 2004, addressing the contributions of features like outdoor, face, and animal in retrieval, and if users can correctly decide on which features to apply for a given need. Pooled truth data gives evidence that some topics would benefit from features. A study with 12 subjects found that people often disagree on the relevance of a feature to a particular topic, including disagreement within the 8% of positive feature-topic associations strongly supported by truth data. When subjects concur, their judgments are correct, and for those 51 topic-feature pairings identified as significant we conduct an investigation into the best interactive search submissions showing that for 29 pairs, topic performance would have improved had users had access to ideal classifiers for those features. The benefits derive from generic features applied to generic topics (27 pairs), and in one case a specific feature applied to a specific topic. Re-ranking submitted shots based on features shows promise for automatic search runs, but not for interactive runs where a person already took care to rank shots well.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Christel, M., Conescu, R.: Addressing the Challenge of Visual Information Access from Digital Image and Video Libraries. In: Proc. ACM/IEEE JCDL. ACM Press, New York (2005)
Christel, M., Moraveji, N.: Finding the Right Shots: Assessing Usability and Performance of a Digital Video Library Interface. In: Proc. ACM Multimedia, pp. 732–739. ACM Press, New York (2004)
Christel, M., Moraveji, N., Huang, C.: Evaluating Content-Based Filters for Image and Video Retrieval. In: Proc. ACM SIGIR, pp. 590–591. ACM Press, New York (2004)
Hollink, L., et al.: User Strategies in Video Retrieval: A Case Study. In: Enser, P.G.B., Kompatsiaris, Y., O’Connor, N.E., Smeaton, A., Smeulders, A.W.M. (eds.) CIVR 2004. LNCS, vol. 3115, pp. 6–14. Springer, Heidelberg (2004)
Kraaij, W., Smeaton, A.F., Over, P., Arlandis, J.: TRECVID 2004 – An Introduction. In: TRECVID 2004 Proc. (2004), http://www-nlpir.nist.gov/projects/tvpubs/tvpapers04/tv4overview.pdf
Markkula, M., Sormunen, E.: End-user searching challenges indexing practices in the digital newspaper photo archive. Information Retrieval 1, 259–285 (2000)
Naphade, M.R., Smith, J.R.: On the Detection of Semantic Concepts at TRECVID. In: Proc. ACM Multimedia, pp. 660–667. ACM Press, New York (2004)
Rodden, K., Basalaj, W., Sinclair, D., Wood, K.R.: Does organization by similarity assist image browsing? In: Proc. CHI 2001, pp. 190–197. ACM Press, New York (2001)
Shatford, S.: Analyzing the Subject of a Picture: A Theoretical Approach. Cataloguing & Classification Quarterly 6, 39–62 (1986)
Smeulders, A.W.M., Worring, M., Santini, S., Gupta, A., Jain, R.: Content based image retrieval at the end of the early years. IEEE Trans. PAMI 22, 1349–1380 (2000)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Christel, M.G., Hauptmann, A.G. (2005). The Use and Utility of High-Level Semantic Features in Video Retrieval. In: Leow, WK., Lew, M.S., Chua, TS., Ma, WY., Chaisorn, L., Bakker, E.M. (eds) Image and Video Retrieval. CIVR 2005. Lecture Notes in Computer Science, vol 3568. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11526346_17
Download citation
DOI: https://doi.org/10.1007/11526346_17
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-27858-0
Online ISBN: 978-3-540-31678-7
eBook Packages: Computer ScienceComputer Science (R0)