{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,10,30]],"date-time":"2024-10-30T20:47:23Z","timestamp":1730321243812,"version":"3.28.0"},"publisher-location":"New York, NY, USA","reference-count":40,"publisher":"ACM","license":[{"start":{"date-parts":[[2019,7,18]],"date-time":"2019-07-18T00:00:00Z","timestamp":1563408000000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2019,7,18]]},"DOI":"10.1145\/3331184.3331215","type":"proceedings-article","created":{"date-parts":[[2019,7,19]],"date-time":"2019-07-19T13:40:26Z","timestamp":1563543626000},"page":"595-604","update-policy":"http:\/\/dx.doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":32,"title":["Which Diversity Evaluation Measures Are \"Good\"?"],"prefix":"10.1145","author":[{"given":"Tetsuya","family":"Sakai","sequence":"first","affiliation":[{"name":"Waseda University, Tokyo, Japan"}]},{"given":"Zhaohao","family":"Zeng","sequence":"additional","affiliation":[{"name":"Waseda University, Tokyo, Japan"}]}],"member":"320","published-online":{"date-parts":[[2019,7,18]]},"reference":[{"key":"e_1_3_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/1498759.1498766"},{"key":"e_1_3_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/1390334.1390347"},{"key":"e_1_3_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-15712-8_39"},{"key":"e_1_3_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/3291992.3291996"},{"key":"e_1_3_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/2484028.2484081"},{"key":"e_1_3_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/3209978.3210024"},{"key":"e_1_3_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/3209978.3210027"},{"key":"e_1_3_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/2009916.2010037"},{"key":"e_1_3_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/2484028.2484094"},{"key":"e_1_3_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.5555\/2070786.2070817"},{"key":"e_1_3_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/1645953.1646033"},{"key":"e_1_3_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/1935826.1935847"},{"volume-title":"Proceedings of TREC","year":"2012","author":"Clarke Charles L. A.","key":"e_1_3_2_2_13_1","unstructured":"Charles L. A. Clarke , Nick Craswell , and Ellen M. Voorhees . 2013. Overview of the TREC 2012 Web Track . In Proceedings of TREC 2012 . Charles L. A. Clarke, Nick Craswell, and Ellen M. Voorhees. 2013. Overview of the TREC 2012 Web Track. In Proceedings of TREC 2012."},{"key":"e_1_3_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/1390334.1390446"},{"key":"e_1_3_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-04417-5_17"},{"volume-title":"Ji-Rong Wen, and Tetsuya Sakai.","year":"2019","author":"Dou Zhicheng","key":"e_1_3_2_2_16_1","unstructured":"Zhicheng Dou , Xue Yang nad Diya Li , Ji-Rong Wen, and Tetsuya Sakai. 2019 . Low-cost, Bottom-up Measures for Evaluating Search Result Diversification. Information Retrieval Journal . Zhicheng Dou, Xue Yang nad Diya Li, Ji-Rong Wen, and Tetsuya Sakai. 2019. Low-cost, Bottom-up Measures for Evaluating Search Result Diversification. Information Retrieval Journal."},{"key":"e_1_3_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10791-012-9218-8"},{"key":"e_1_3_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/582415.582418"},{"volume-title":"Content Analysis: An Introduction to Its Methodology","year":"2018","author":"Krippendorff Klaus","key":"e_1_3_2_2_19_1","unstructured":"Klaus Krippendorff . 2018 . Content Analysis: An Introduction to Its Methodology ( Fourth Edition). SAGE Publications . Klaus Krippendorff. 2018. Content Analysis: An Introduction to Its Methodology (Fourth Edition). SAGE Publications."},{"key":"e_1_3_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.2044-8317.1997.tb01100.x"},{"key":"e_1_3_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/2911451.2911507"},{"key":"e_1_3_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/3052768"},{"key":"e_1_3_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/1416950.1416952"},{"key":"e_1_3_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-31871-2_22"},{"key":"e_1_3_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/1277741.1277756"},{"key":"e_1_3_2_2_26_1","doi-asserted-by":"crossref","unstructured":"Tetsuya Sakai. 2014. Metrics Statistics Tests. In PROMISE Winter School 2013: Bridging between Information Retrieval and Databases (LNCS 8173). 116--163. Tetsuya Sakai. 2014. Metrics Statistics Tests. In PROMISE Winter School 2013: Bridging between Information Retrieval and Databases (LNCS 8173). 116--163.","DOI":"10.1007\/978-3-642-54798-0_6"},{"volume-title":"Effect Sizes, and Statistical Power","author":"Sakai Tetsuya","key":"e_1_3_2_2_27_1","unstructured":"Tetsuya Sakai . 2018. Laboratory Experiments in Information Retrieval: Sample Sizes , Effect Sizes, and Statistical Power . Springer . Tetsuya Sakai. 2018. Laboratory Experiments in Information Retrieval: Sample Sizes, Effect Sizes, and Statistical Power. Springer."},{"key":"e_1_3_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10791-008-9059-7"},{"volume-title":"Proceedings of EVIA","year":"2008","author":"Sakai Tetsuya","key":"e_1_3_2_2_29_1","unstructured":"Tetsuya Sakai and Stephen Robertson . 2008 . Modelling A User Population for Designing Information Retrieval Metrics . In Proceedings of EVIA 2008. 30--41. Tetsuya Sakai and Stephen Robertson. 2008. Modelling A User Population for Designing Information Retrieval Metrics. In Proceedings of EVIA 2008. 30--41."},{"key":"e_1_3_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/2009916.2010055"},{"key":"e_1_3_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10791-012-9208-x"},{"key":"e_1_3_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/1835449.1835542"},{"volume-title":"Proceedings of NTCIR-9. 82--105","year":"2011","author":"Song Ruihua","key":"e_1_3_2_2_33_1","unstructured":"Ruihua Song , Min Zhang , Tetsuya Sakai , Makoto P. Kato , Yiqun Liu , Miho Sugimoto , Qinglei Wang , and Naoki Orii . 2011 . Overview of the NTCIR-9 INTENT Task . In Proceedings of NTCIR-9. 82--105 . Ruihua Song, Min Zhang, Tetsuya Sakai, Makoto P. Kato, Yiqun Liu, Miho Sugimoto, Qinglei Wang, and Naoki Orii. 2011. Overview of the NTCIR-9 INTENT Task. In Proceedings of NTCIR-9. 82--105."},{"key":"e_1_3_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/1148170.1148176"},{"key":"e_1_3_2_2_35_1","first-page":"156","article-title":"Search Result Diversity Evaluation Based on Intent Hierarchies","volume":"30","author":"Wang Xiaojie","year":"2018","unstructured":"Xiaojie Wang , Ji-Rong Wen , Zhicheng Dou , Tetsuya Sakai , and Rui Zhang . 2018 . Search Result Diversity Evaluation Based on Intent Hierarchies . IEEE TKDE , Vol. 30 (2018), 156 -- 169 . Issue 1. Xiaojie Wang, Ji-Rong Wen, Zhicheng Dou, Tetsuya Sakai, and Rui Zhang. 2018. Search Result Diversity Evaluation Based on Intent Hierarchies. IEEE TKDE, Vol. 30 (2018), 156--169. Issue 1.","journal-title":"IEEE TKDE"},{"volume-title":"Proceedings of NTCIR-12","year":"2016","author":"Yamamoto Takehiro","key":"e_1_3_2_2_36_1","unstructured":"Takehiro Yamamoto , Yiqun Liu , Min Zhang , Zhicheng Dou , Ke Zhou , Ilya Markov , Makoto P. Kato , Hiroaki Ohshima , and Sumio Fujita . 2016 . Overview of the NTCIR-12 IMine-2 Task . In Proceedings of NTCIR-12 . 8--26. Takehiro Yamamoto, Yiqun Liu, Min Zhang, Zhicheng Dou, Ke Zhou, Ilya Markov, Makoto P. Kato, Hiroaki Ohshima, and Sumio Fujita. 2016. Overview of the NTCIR-12 IMine-2 Task. In Proceedings of NTCIR-12. 8--26."},{"key":"e_1_3_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-04417-5_15"},{"key":"e_1_3_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/860435.860440"},{"key":"e_1_3_2_2_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/3077136.3080841"},{"key":"e_1_3_2_2_40_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10791-009-9099-7"}],"event":{"name":"SIGIR '19: The 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval","sponsor":["SIGIR ACM Special Interest Group on Information Retrieval"],"location":"Paris France","acronym":"SIGIR '19"},"container-title":["Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3331184.3331215","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,1,7]],"date-time":"2023-01-07T16:02:30Z","timestamp":1673107350000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3331184.3331215"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,7,18]]},"references-count":40,"alternative-id":["10.1145\/3331184.3331215","10.1145\/3331184"],"URL":"https:\/\/doi.org\/10.1145\/3331184.3331215","relation":{},"subject":[],"published":{"date-parts":[[2019,7,18]]},"assertion":[{"value":"2019-07-18","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}