{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,9,15]],"date-time":"2024-09-15T16:29:34Z","timestamp":1726417774169},"reference-count":68,"publisher":"Wiley","issue":"10","license":[{"start":{"date-parts":[[2003,5,7]],"date-time":"2003-05-07T00:00:00Z","timestamp":1052265600000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/onlinelibrary.wiley.com\/termsAndConditions#vor"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["J. Am. Soc. Inf. Sci."],"published-print":{"date-parts":[[2003,8]]},"abstract":"Abstract<\/jats:title>This article introduces the concept of relevance as viewed and applied in the context of IR evaluation, by presenting an overview of the multidimensional and<\/jats:italic> dynamic nature of the concept. The literature on relevance reveals how the relevance concept, especially in regard to the \nmultidimensionality of relevance, is many faceted, and does not just refer to the various relevance criteria users may apply in the process of judging relevance of retrieved information objects. From our point of view, the multidimensionality of relevance explains why some will argue that no \nconsensus has been reached on the relevance concept. Thus, the objective of this article is to present an overview of the many different views and ways by which the concept of relevance is used\u2014leading to a consistent and compatible understanding of the concept. In addition, special attention \nis paid to the type of situational relevance. Many researchers perceive situational relevance as the most realistic type of user relevance, and therefore situational relevance is discussed with reference to its potential dynamic nature, and as a requirement for interactive information retrieval \n(IIR) evaluation.<\/jats:p>","DOI":"10.1002\/asi.10286","type":"journal-article","created":{"date-parts":[[2003,6,27]],"date-time":"2003-06-27T13:00:59Z","timestamp":1056718859000},"page":"913-925","source":"Crossref","is-referenced-by-count":291,"title":["The concept of relevance in IR"],"prefix":"10.1002","volume":"54","author":[{"given":"Pia","family":"Borlund","sequence":"first","affiliation":[]}],"member":"311","published-online":{"date-parts":[[2003,5,7]]},"reference":[{"key":"e_1_2_7_2_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0306-4573(97)00078-2"},{"key":"e_1_2_7_3_1","doi-asserted-by":"publisher","DOI":"10.1002\/(SICI)1097-4571(199404)45:3<149::AID-ASI5>3.0.CO;2-J"},{"key":"e_1_2_7_4_1","unstructured":"Bateman J.(1998).Changes in relevance criteria: A longitudinal study. In: ASIS Proceedings.1998(pp.23\u201332)."},{"key":"e_1_2_7_5_1","first-page":"187","volume-title":"International workshop on the cognitive viewpoint","author":"Belkin N.J.","year":"1977"},{"key":"e_1_2_7_6_1","doi-asserted-by":"publisher","DOI":"10.1108\/eb026653"},{"key":"e_1_2_7_7_1","doi-asserted-by":"publisher","DOI":"10.1108\/EUM0000000007198"},{"key":"e_1_2_7_8_1","first-page":"324","volume-title":"Measures of relative relevance and ranked half\u2010life: Performance indicators for interactive IR","author":"Borlund P.","year":"1998"},{"volume-title":"Evaluation of interactive information retrieval systems. Doctoral dissertation, \u00c5bo Akademi University","year":"2000","author":"Borlund P.","key":"e_1_2_7_9_1"},{"key":"e_1_2_7_10_1","doi-asserted-by":"publisher","DOI":"10.1108\/EUM0000000007110"},{"key":"e_1_2_7_11_1","series-title":"Informatics","first-page":"42","author":"Brookes B.C.","year":"1975"},{"key":"e_1_2_7_12_1","first-page":"115","volume-title":"Problems of information science, FID 530","author":"Brookes B.C.","year":"1975"},{"key":"e_1_2_7_13_1","first-page":"195","volume-title":"International workshop on the cognitive viewpoint","author":"Brookes B.C.","year":"1977"},{"key":"e_1_2_7_14_1","doi-asserted-by":"publisher","DOI":"10.1177\/016555158000200302"},{"key":"e_1_2_7_15_1","doi-asserted-by":"publisher","DOI":"10.1002\/(SICI)1097-4571(199404)45:3<142::AID-ASI4>3.0.CO;2-6"},{"key":"e_1_2_7_16_1","first-page":"251","volume-title":"The ostensive model of developing information needs","author":"Campbell I.","year":"1996"},{"volume-title":"Aslib Cranfield research project: Report on the first stage of an investigation into the comparative efficiency of indexing systems","year":"1960","author":"Cleverdon C.W.","key":"e_1_2_7_17_1"},{"key":"e_1_2_7_18_1","doi-asserted-by":"publisher","DOI":"10.1016\/0020-0271(71)90024-6"},{"key":"e_1_2_7_19_1","doi-asserted-by":"publisher","DOI":"10.1177\/002224378001700401"},{"key":"e_1_2_7_20_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0306-4573(99)00072-2"},{"volume-title":"Project summary (TM\u20103520\/001\/00)","year":"1967","author":"Cuadra C.A.","key":"e_1_2_7_21_1"},{"key":"e_1_2_7_22_1","doi-asserted-by":"publisher","DOI":"10.1108\/eb026436"},{"key":"e_1_2_7_23_1","first-page":"49","volume-title":"Theory and application of information research","author":"De Mey M.","year":"1980"},{"key":"e_1_2_7_24_1","unstructured":"Doyle L.B.(1963).Is Relevance an adequate criterion in retrieval system evaluation?Proceedings of the American Documentation Institute; 26th annual meeting (pp.199\u2013200). Chicago IL."},{"key":"e_1_2_7_25_1","doi-asserted-by":"publisher","DOI":"10.1002\/(SICI)1097-4571(198809)39:5<293::AID-ASI1>3.0.CO;2-I"},{"key":"e_1_2_7_26_1","unstructured":"Eisenberg M. &Hu X.(1987).Dichotomous relevance judgments and the evaluation of information systems. In: ASIS Proceedings (pp.66\u201369)."},{"key":"e_1_2_7_27_1","unstructured":"Eisenberg M. &Schamber L.(1988).Relevance: The Search for a definition. In ASIS Proceedings (pp.164\u2013168)."},{"key":"e_1_2_7_28_1","doi-asserted-by":"publisher","DOI":"10.1016\/0306-4573(88)90042-8"},{"key":"e_1_2_7_29_1","doi-asserted-by":"publisher","DOI":"10.1002\/(SICI)1097-4571(199404)45:3<124::AID-ASI2>3.0.CO;2-8"},{"key":"e_1_2_7_30_1","doi-asserted-by":"publisher","DOI":"10.1002\/(SICI)1097-4571(199510)46:9<646::AID-ASI2>3.0.CO;2-1"},{"key":"e_1_2_7_31_1","doi-asserted-by":"publisher","DOI":"10.1002\/asi.5090070408"},{"key":"e_1_2_7_32_1","doi-asserted-by":"publisher","DOI":"10.1002\/(SICI)1097-4571(199210)43:9<602::AID-ASI3>3.0.CO;2-Q"},{"key":"e_1_2_7_33_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0953-5438(02)00023-1"},{"volume-title":"Information seeking and subject representation: An activity\u2013theoretical approach to information science","year":"1997","author":"Hj\u00f8rland B.","key":"e_1_2_7_34_1"},{"key":"e_1_2_7_35_1","doi-asserted-by":"publisher","DOI":"10.1108\/eb026960"},{"key":"e_1_2_7_36_1","doi-asserted-by":"publisher","DOI":"10.2307\/3150242"},{"key":"e_1_2_7_37_1","doi-asserted-by":"publisher","DOI":"10.1002\/(SICI)1097-4571(199404)45:3<160::AID-ASI6>3.0.CO;2-4"},{"key":"e_1_2_7_38_1","first-page":"41","volume-title":"IR evaluation methods for retrieving highly relevant documents","author":"J\u00e4rvelin K.","year":"2000"},{"volume-title":"Seeking meaning: A process approach to library and information science","year":"1993","author":"Kuhlthau C.C.","key":"e_1_2_7_39_1"},{"key":"e_1_2_7_40_1","doi-asserted-by":"publisher","DOI":"10.1002\/asi.4630200204"},{"volume-title":"Attitudes and their measurement","year":"1973","author":"Lemon N.","key":"e_1_2_7_41_1"},{"key":"e_1_2_7_42_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0953-5438(98)00012-5"},{"key":"e_1_2_7_43_1","doi-asserted-by":"publisher","DOI":"10.1016\/0306-4573(93)90026-A"},{"key":"e_1_2_7_44_1","doi-asserted-by":"publisher","DOI":"10.1086\/602592"},{"key":"e_1_2_7_45_1","doi-asserted-by":"publisher","DOI":"10.1002\/(SICI)1097-4571(199404)45:3<135::AID-ASI3>3.0.CO;2-1"},{"year":"1967","series-title":"A field experiment approach to the study of relevance assessments in relation to document searching","author":"Rees A.M.","key":"e_1_2_7_46_1"},{"key":"e_1_2_7_47_1","first-page":"97","volume-title":"A New, task\u2010oriented paradigm for information retrieval: Implications for evaluation of information retrieval systems","author":"Reid J.","year":"1999"},{"key":"e_1_2_7_48_1","doi-asserted-by":"publisher","DOI":"10.1016\/0306-4573(92)90004-J"},{"key":"e_1_2_7_49_1","unstructured":"Robins D.(1997).Shifts of focus in information retrieval interaction. In ASIS Proceedings (pp.123\u2013134)."},{"key":"e_1_2_7_50_1","unstructured":"Saracevic T.(1969).Comparative effects of titles abstracts and full texts on relevance judgments. In ASIS Proceedings (pp.293\u2013299)."},{"key":"e_1_2_7_51_1","doi-asserted-by":"publisher","DOI":"10.1002\/asi.4630260604"},{"key":"e_1_2_7_52_1","first-page":"201","volume-title":"Relevance Reconsidered '96","author":"Saracevic T.","year":"1996"},{"key":"e_1_2_7_53_1","unstructured":"Saracevic T. &Su L.(1989).Modelling and measuring user\u2013intermediary\u2013computer interaction online searching: Design of study. In ASIS Proceedings (pp.75\u201380)."},{"key":"e_1_2_7_54_1","first-page":"3","volume-title":"Annual review of information science and technology (ARIST)","author":"Schamber L.","year":"1994"},{"key":"e_1_2_7_55_1","doi-asserted-by":"publisher","DOI":"10.1016\/0306-4573(90)90050-C"},{"volume-title":"Relevance: Communication and cognition","year":"1986","author":"Sperber D.","key":"e_1_2_7_56_1"},{"key":"e_1_2_7_57_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0306-4573(98)00025-9"},{"key":"e_1_2_7_58_1","doi-asserted-by":"publisher","DOI":"10.1016\/0306-4573(92)90007-M"},{"key":"e_1_2_7_59_1","doi-asserted-by":"publisher","DOI":"10.1086\/620653"},{"key":"e_1_2_7_60_1","doi-asserted-by":"publisher","DOI":"10.1086\/601800"},{"key":"e_1_2_7_61_1","doi-asserted-by":"publisher","DOI":"10.1002\/(SICI)1097-4571(1999)50:3<254::AID-ASI8>3.0.CO;2-Y"},{"key":"e_1_2_7_62_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0306-4573(97)00081-2"},{"key":"e_1_2_7_63_1","doi-asserted-by":"publisher","DOI":"10.1108\/eb026215"},{"key":"e_1_2_7_64_1","doi-asserted-by":"publisher","DOI":"10.1108\/EUM0000000007127"},{"volume-title":"Information retrieval","year":"1979","author":"van Rijsbergen C.J.","key":"e_1_2_7_65_1"},{"key":"e_1_2_7_66_1","first-page":"41","volume-title":"Evaluation by highly relevant documents","author":"Voorhees E.","year":"2001"},{"key":"e_1_2_7_67_1","first-page":"315","volume-title":"Variations in relevance judgments and the measurement of retrieval effectiveness","author":"Voorhees E.M.","year":"1998"},{"key":"e_1_2_7_68_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0306-4573(00)00010-8"},{"key":"e_1_2_7_69_1","doi-asserted-by":"publisher","DOI":"10.1016\/0020-0271(73)90096-X"}],"container-title":["Journal of the American Society for Information Science and Technology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/api.wiley.com\/onlinelibrary\/tdm\/v1\/articles\/10.1002%2Fasi.10286","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/asi.10286","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,10,13]],"date-time":"2023-10-13T11:08:01Z","timestamp":1697195281000},"score":1,"resource":{"primary":{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/10.1002\/asi.10286"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2003,5,7]]},"references-count":68,"journal-issue":{"issue":"10","published-print":{"date-parts":[[2003,8]]}},"alternative-id":["10.1002\/asi.10286"],"URL":"https:\/\/doi.org\/10.1002\/asi.10286","archive":["Portico"],"relation":{},"ISSN":["1532-2882","1532-2890"],"issn-type":[{"type":"print","value":"1532-2882"},{"type":"electronic","value":"1532-2890"}],"subject":[],"published":{"date-parts":[[2003,5,7]]}}}