Comparative Evaluation of Cross-language Information Retrieval Systems | SpringerLink
Skip to main content
Springer Nature Link
Log in

Comparative Evaluation of Cross-language Information Retrieval Systems

  • Chapter
From Integrated Publication and Information Systems to Information and Knowledge Environments

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 3379))

  • 913 Accesses

Abstract

With the increasing importance of the “Global Information Society“ and as the world’s depositories of online collections proliferate, there is a growing need for systems that enable access to information of interest wherever and however it is stored, regardless of form or language. In recognition of this, five years ago, the DELOS Network for Digital Libraries launched the Cross-Language Evaluation Forum (CLEF), with the objective of promoting multi lingual information access by providing the research community with an infra structure for testing and evaluating systems operating in multilingual contexts and a common platform for the comparison of methodologies and results. In this paper, we outline the various activities initiated by CLEF over the years in order to meet the emerging needs of the application communities, and trace the impact of these activities on advances in multilingual system development.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Similar content being viewed by others

References

  1. Braschler, M., Peters, C.: Cross-Language Evaluation Forum: Objectives, Results, Achievements. Information Retrieval 7(1-2), 7–31 (2004)

    Article  Google Scholar 

  2. Cleverdon, C.: The Cranfield Tests on Index Language Devices. In: Spärck-Jones, K., Willett, P. (eds.) Readings in Information Retrieval, pp. 47–59. Morgan Kaufmann, San Francisco (1997)

    Google Scholar 

  3. Gey, F., Kando, N., Peters, C.: Cross-Language Information Retrieval: the Way Ahead. Information Processing and Management 4(3) (Forthcoming)

    Google Scholar 

  4. Gurrin, C., Smeaton, A.F.: Improving Evaluation of Web Search Systems. In: Sebastiani, F. (ed.) ECIR 2003. LNCS, vol. 2633, pp. 25–40. Springer, Heidelberg (2003)

    Chapter  Google Scholar 

  5. Kando, N.: Evaluation of Information Access Technologies at the NTCIR Workshop. In: Peters, C., Gonzalo, J., Braschler, M., Kluck, M. (eds.) CLEF 2003. LNCS, vol. 3237, pp. 29–43. Springer, Heidelberg (2004) (in print)

    Chapter  Google Scholar 

  6. Bailey, P., Craswell, N., Hawking, D.: Engineering a multi-purpose test collection for web retrieval experiments. Information Processing and Management 39(6), 853–871 (2003)

    Article  Google Scholar 

  7. Oard, D., Gonzalo, J.: The CLEF 2001 Interactive Track. In: Peters, C., Braschler, M., Gonzalo, J., Kluck, M. (eds.) CLEF 2001. LNCS, vol. 2406, pp. 308–319. Springer, Heidelberg (2002)

    Chapter  Google Scholar 

  8. Gonzalo, J., Oard, D.: The CLEF 2002 Interactive Track. In: Peters, C., Braschler, M., Gonzalo, J. (eds.) CLEF 2002. LNCS, vol. 2785, pp. 372–382. Springer, Heidelberg (2003)

    Chapter  Google Scholar 

  9. Oard, D., Gonzalo, J.: The CLEF 2003 Interactive Track. In: Peters, C., Gonzalo, J., Braschler, M., Kluck, M. (eds.) CLEF 2003. LNCS, vol. 3237, pp. 425–434. Springer, Heidelberg (2004) (in print)

    Chapter  Google Scholar 

  10. Gonzalo, J., Oard, D.: CLEF 2004 Working Notes (2004), See, http://clef.isti.cnr.it/2004/working_notes/CLEF2004WN-Contents.html

  11. Maybury, M.: Toward a Question Answering Roadmap, MITRE Tech. Report (2002)

    Google Scholar 

  12. Magnini, B., Romagnoli, S., Vallin, A., Herrera, J., Peñas, A., Peinado, V., Verdejo, F., de Rijke, M.: The Multiple Language Question Answering Track at CLEF 2003. In: Peters, C., Gonzalo, J., Braschler, M., Kluck, M. (eds.) CLEF 2003. LNCS, vol. 3237, pp. 471–486. Springer, Heidelberg (2004) (in print)

    Chapter  Google Scholar 

  13. Magnini, B., Vallin, A., Ayache, C., Erbach, G., Peñas, A., de Rijke, M., Rocha, P., Simov, K., Sutcliffe, R.: Overview of the CLEF (2004), Multilingual Question Answering Track. In: Peters, C., Clough, P., Gonzalo, J., Jones, G.J.F., Kluck, M., Magnini, B. (eds.) CLEF 2004. LNCS, vol. 3491, pp. 371–391. Springer, Heidelberg (2005) See, http://clef.isti.cnr.it/2004/working_notes/CLEF2004WNContents.html

    Chapter  Google Scholar 

  14. Jones, G.J.F., Federico, M.: CLEF 2002 Cross-Language Spoken Document Retrieval Pilot Track Report. In: Peters, C., Braschler, M., Gonzalo, J. (eds.) CLEF 2002. LNCS, vol. 2785, pp. 446–457. Springer, Heidelberg (2003)

    Chapter  Google Scholar 

  15. Federico, M., Jones, G.J.F.: The CLEF 2003 Cross-Language Spoken Document Retrieval Track. In: Peters, C., Gonzalo, J., Braschler, M., Kluck, M. (eds.) CLEF 2003. LNCS, vol. 3237, pp. 646–652. Springer, Heidelberg (2004) (in print)

    Chapter  Google Scholar 

  16. Clough, P.D., Sanderson, M.: The CLEF 2003 Cross Language Image Retrieval Track. In: Peters, C., Gonzalo, J., Braschler, M., Kluck, M. (eds.) CLEF 2003. LNCS, vol. 3237, pp. 581–593. Springer, Heidelberg (2004) (in print)

    Chapter  Google Scholar 

  17. Clough, P.D., Sanderson, M., Müller, H.: The CLEF Cross Language Image Retrieval Track (ImageCLEF). In: Peters, C., Clough, P., Gonzalo, J., Jones, G.J.F., Kluck, M., Magnini, B. (eds.) CLEF 2004. LNCS, vol. 3491, pp. 597–613. Springer, Heidelberg (2005) See, http://clef.isti.cnr.it/2004/working_notes/CLEF2004WN-Contents.html

    Chapter  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. ISTI-CNR, Area di Ricerca CNR, Via Moruzzi, 1, 56124, Pisa, Italy

    Carol Peters

Authors
  1. Carol Peters
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. FernUniversität Hagen, Universitätsstr. 1, 58097, Hagen, Germany

    Matthias Hemmje

  2. L3S Research Center/Leibniz Universität Hannover, Appelstr. 9a, 30167, Hannover, Germany

    Claudia Niederée

  3. Fraunhofer IPSI, Integrated Publication and Information Systems Institute, Dolivostrasse 15, 64293, Darmstadt, Germany

    Thomas Risse

Rights and permissions

Reprints and permissions

Copyright information

© 2005 Springer-Verlag Berlin Heidelberg

About this chapter

Cite this chapter

Peters, C. (2005). Comparative Evaluation of Cross-language Information Retrieval Systems. In: Hemmje, M., Niederée, C., Risse, T. (eds) From Integrated Publication and Information Systems to Information and Knowledge Environments. Lecture Notes in Computer Science, vol 3379. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-31842-2_16

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-31842-2_16

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-24551-3

  • Online ISBN: 978-3-540-31842-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics