{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,9,13]],"date-time":"2024-09-13T09:10:11Z","timestamp":1726218611666},"reference-count":44,"publisher":"SAGE Publications","issue":"6","license":[{"start":{"date-parts":[[2010,11,5]],"date-time":"2010-11-05T00:00:00Z","timestamp":1288915200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Journal of Information Science"],"published-print":{"date-parts":[[2010,12]]},"abstract":" This paper reports on the findings of a user study which investigated the effects of structure, highlighting and quantity of information on university students\u2019 interaction with metadata surrogates of learning object repositories (LORs) during the relevance judgement process. The literature review revealed a lack of studies investigating how metadata surrogates should be designed to meet users\u2019 needs and improve the effectiveness of relevance judgement. In order to address this issue, different versions of a prototype system, called META-LOR 2, were developed and evaluated in terms of the time needed for users to find relevant information, the accuracy of their relevance judgements and their satisfaction. To evaluate the prototype, a user study was conducted where participants were asked to complete a set of tasks and fill in satisfaction questionnaires. The findings showed that participants performed better and were more satisfied with those versions of the prototype which highlighted metadata elements that included the query terms, used clusters or categories to organize metadata elements in the surrogates and included metadata elements which were relevant to the query or task at hand. The paper concludes with some recommendations for improving the design of metadata surrogates in search result interfaces. <\/jats:p>","DOI":"10.1177\/0165551510386174","type":"journal-article","created":{"date-parts":[[2010,11,6]],"date-time":"2010-11-06T00:52:22Z","timestamp":1289004742000},"page":"780-797","source":"Crossref","is-referenced-by-count":3,"title":["Design factors affecting relevance judgment behaviour in the context of metadata surrogates"],"prefix":"10.1177","volume":"36","author":[{"given":"Panos","family":"Balatsoukas","sequence":"first","affiliation":[{"name":"Department of Computer and Information Sciences, University of Strathclyde, Glasgow,"}]},{"given":"Ann","family":"O'Brien","sequence":"additional","affiliation":[{"name":"Department of Information Science, Loughborough University, Leicester"}]},{"given":"Anne","family":"Morris","sequence":"additional","affiliation":[{"name":"Department of Information Science, Loughborough University, Leicester"}]}],"member":"179","published-online":{"date-parts":[[2010,11,5]]},"reference":[{"volume-title":"Metadata (Facet","year":"2008","author":"M. Zeng","key":"atypb1"},{"key":"atypb2","doi-asserted-by":"publisher","DOI":"10.1002\/(SICI)1097-4571(1998)49:14<1293::AID-ASI7>3.0.CO;2-E"},{"volume-title":"Towards multimedia surrogates","year":"2007","author":"G. Marchionini","key":"atypb3"},{"key":"atypb4","doi-asserted-by":"publisher","DOI":"10.1016\/j.ipm.2007.02.004"},{"volume-title":"Proceedings of the 3rd International Workshop on New Developments in Digital Library (NDDL 2003)","author":"O. Drori","key":"atypb5"},{"volume-title":"Proceedings of the 49th Annual Meeting of Human Factors and Ergonomics Society","author":"R. Rele","key":"atypb6"},{"key":"atypb7","doi-asserted-by":"publisher","DOI":"10.1177\/0165551508099090"},{"volume-title":"Proceedings of the 11th International Conference on Electronic Publishing","author":"P. Balatsoukas","key":"atypb8"},{"volume-title":"Draft standard for learning object metadata","year":"2002","author":"Ieee","key":"atypb9"},{"key":"atypb10","doi-asserted-by":"publisher","DOI":"10.1002\/asi.20682"},{"issue":"200034","key":"atypb11","author":"O. Drori","year":"2000","journal-title":"Technical report"},{"key":"atypb12","doi-asserted-by":"publisher","DOI":"10.1002\/asi.20839"},{"key":"atypb13","doi-asserted-by":"publisher","DOI":"10.1016\/0306-4573(91)90004-6"},{"volume-title":"Proceedings of the 3rd ACM\/IEEE-CS Joint Conference on Digital Libraries","author":"E. Liddy","key":"atypb14"},{"key":"atypb15","doi-asserted-by":"publisher","DOI":"10.1016\/S0306-4573(97)00078-2"},{"key":"atypb16","doi-asserted-by":"publisher","DOI":"10.1002\/(SICI)1097-4571(199802)49:2<115::AID-ASI3>3.0.CO;2-T"},{"key":"atypb17","doi-asserted-by":"publisher","DOI":"10.1002\/asi.20436"},{"key":"atypb18","doi-asserted-by":"crossref","DOI":"10.1002\/bult.134","volume":"25","author":"B. Fraser","year":"1999","journal-title":"Bulletin of the American Society for Information Science"},{"volume-title":"evaluation report","year":"2002","author":"Search LT","key":"atypb19"},{"volume-title":"Evaluating metadata from different perspectives","year":"2008","author":"A. Diekema","key":"atypb20"},{"key":"atypb21","doi-asserted-by":"publisher","DOI":"10.1002\/asi.20203"},{"volume-title":"Proceedings of SIGCHI Conference on Human Factors in Computing Systems (CHI2004)","author":"T. Paek","key":"atypb22"},{"volume-title":"Proceedings of the Tenth International Conference on Enterprise Information Systems (ICEIS Press","author":"V. Mordechai","key":"atypb23"},{"volume-title":"Do thumbnail previews help people make better decisions about web search results?","year":"2002","author":"S. Dziadosz","key":"atypb24"},{"key":"atypb25","doi-asserted-by":"publisher","DOI":"10.1177\/0165551506067123"},{"volume-title":"Proceedings of Informing Science 2003 Conference (Informing Science","author":"O. Drori","key":"atypb26"},{"key":"atypb27","doi-asserted-by":"publisher","DOI":"10.1177\/0165551505052345"},{"issue":"2","key":"atypb28","first-page":"106","volume":"29","author":"N. Alon","year":"2003","journal-title":"Journal of Information Science"},{"key":"atypb29","doi-asserted-by":"publisher","DOI":"10.1002\/(SICI)1097-4571(2000)51:4<380::AID-ASI7>3.0.CO;2-5"},{"volume-title":"Proceedings of the 6th ACM\/IEEE Joint Conference on Digital Libraries-CS","author":"B. Kules","key":"atypb30"},{"volume-title":"Proceedings of the SIGCHI Conference on Human Factors in Computing Systems","author":"S. Dumais","key":"atypb31"},{"volume-title":"IADIS International Conference: Informatics 2008","author":"P. Balatsoukas","key":"atypb32"},{"key":"atypb33","doi-asserted-by":"publisher","DOI":"10.1016\/0749-5978(86)90044-0"},{"key":"atypb34","doi-asserted-by":"publisher","DOI":"10.1016\/j.ipm.2007.08.002"},{"volume-title":"Handbook of Usability Testing","year":"2007","author":"J. Rubin","key":"atypb35"},{"key":"atypb36","doi-asserted-by":"publisher","DOI":"10.1002\/(SICI)1097-4571(198809)39:5<293::AID-ASI1>3.0.CO;2-I"},{"key":"atypb37","doi-asserted-by":"publisher","DOI":"10.1002\/asi.20826"},{"issue":"3","key":"atypb38","volume":"8","author":"P. Borlund","year":"2003","journal-title":"Information Research"},{"volume-title":"UK LOM Core update","year":"2004","author":"L. Campbell","key":"atypb39"},{"journal-title":"ISO\/IEC JTCI\/SC36","year":"2004","author":"N. Friesen","key":"atypb40"},{"volume-title":"Cognition and Categorisation","year":"1978","author":"E. Rosch","key":"atypb41"},{"key":"atypb42","doi-asserted-by":"publisher","DOI":"10.1207\/s15327051hci0403_3"},{"key":"atypb43","doi-asserted-by":"publisher","DOI":"10.1006\/ijhc.2002.0527"},{"volume-title":"Cognitive Psychology","year":"2003","author":"R. Sternberg","key":"atypb44"}],"container-title":["Journal of Information Science"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/0165551510386174","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/0165551510386174","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,9,13]],"date-time":"2024-09-13T08:21:34Z","timestamp":1726215694000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/0165551510386174"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2010,11,5]]},"references-count":44,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2010,12]]}},"alternative-id":["10.1177\/0165551510386174"],"URL":"https:\/\/doi.org\/10.1177\/0165551510386174","relation":{},"ISSN":["0165-5515","1741-6485"],"issn-type":[{"type":"print","value":"0165-5515"},{"type":"electronic","value":"1741-6485"}],"subject":[],"published":{"date-parts":[[2010,11,5]]}}}