Abstract
This paper is concerned with the evaluation of distributed and peer-to-peer information retrieval systems. A new measure is introduced that compares results of a distributed retrieval system to those of a centralised system, fully exploiting the ranking of the latter as an indicator of gradual relevance. Problems with existing evaluation approaches are verified experimentally.
This is a preview of subscription content, log in via an institution to check access.
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Akavipat, R., Wu, L.-S., Menczer, F., Maguitman, A.G.: Emerging semantic communities in peer web search. In: P2PIR 2006. Proceedings of the international workshop on Information retrieval in peer-to-peer networks, pp. 1–8 (2006)
Bawa, M., Manku, G.S., Raghavan, P.: SETS: search enhanced by topic segmentation. In: Proc. of SIGIR 2003, pp. 306–313 (2003)
Callan, J.P., Lu, Z., Croft, W.B.: Searching distributed collections with inference networks. In: Proc. of SIGIR 1995, pp. 21–28 (1995)
Lu, J., Callan, J.: Content-based retrieval in hybrid peer-to-peer networks. In: CIKM 2003. Proceedings of the twelfth international conference on Information and knowledge management, pp. 199–206 (2003)
Michel, S., Bender, M., Ntarmos, N., Triantafillou, P., Weikum, G., Zimmer, C.: Discovering and exploiting keyword and attribute-value co-occurrences to improve P2P routing indices. In: CIKM 2006. Proceedings of the 15th ACM international conference on Information and knowledge management, pp. 172–181 (2006)
Neumann, T., Bender, M., Michel, S., Weikum, G.: A reproducible benchmark for P2P retrieval. In: Proc. of First Int. Workshop on Performance and Evaluation of Data Management Systems, ExpDB (2006)
Powell, A.L., French, J.C., Callan, J., Connell, M., Viles, C.L.: The impact of database selection on distributed searching. In: Proc. of SIGIR 2000, pp. 232–239 (2000)
Puppin, D., Silvestri, F., Laforenza, D.: Query-driven document partitioning and collection selection. In: InfoScale 2006. Proceedings of the 1st international conference on Scalable information systems, pp. 34–41 (2006)
Shokouhi, M., Baillie, M., Azzopardi, L.: Updating collection representations for federated search. In: Proc. of SIGIR 2007, pp. 511–518 (2007)
Witschel, H.F.: Global term weights in distributed environments. Information Processing and Management (2007), DOI: doi:10.1016/j.ipm.2007.09.003
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2008 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Witschel, H.F., Holz, F., Heinrich, G., Teresniak, S. (2008). An Evaluation Measure for Distributed Information Retrieval Systems. In: Macdonald, C., Ounis, I., Plachouras, V., Ruthven, I., White, R.W. (eds) Advances in Information Retrieval. ECIR 2008. Lecture Notes in Computer Science, vol 4956. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-78646-7_64
Download citation
DOI: https://doi.org/10.1007/978-3-540-78646-7_64
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-78645-0
Online ISBN: 978-3-540-78646-7
eBook Packages: Computer ScienceComputer Science (R0)