{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2023,9,13]],"date-time":"2023-09-13T19:05:12Z","timestamp":1694631912381},"reference-count":66,"publisher":"Emerald","issue":"2","license":[{"start":{"date-parts":[[1988,2,1]],"date-time":"1988-02-01T00:00:00Z","timestamp":570672000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/www.emerald.com\/insight\/site-policies"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[1988,2,1]]},"abstract":"The psychological literature on subjective probability estimation is reviewed to determine the feasibility of designing probabilistic information retrieval systems using such estimates. Their use has been considered by some writers, but psychological issues have not been addressed. Research pertinent to probabilistic information retrieval is examined and implications for probabilistic information retrieval are drawn. It is shown that accurate human probability estimation is possible, both in the laboratory and in real world tasks, e.g., in meteorological forecasting; but that it is also a task subject to systematic bias, or inaccuracy. Proposed techniques for debiasing are considered. The highly task\u2010dependent nature of such estimates is also discussed; two implications are that results from laboratory studies may have limited relevance to real world tasks and that empirical studies specific to the context of information retrieval need to be made. Human probability estimation appears to be a difficult task, but one which can be done well with proper training and use of debiasing techniques. It is premature to say how useful such estimates would be in probabilistic information retrieval, but their use should not yet be ruled out.<\/jats:p>","DOI":"10.1108\/eb026821","type":"journal-article","created":{"date-parts":[[2008,1,19]],"date-time":"2008-01-19T12:41:40Z","timestamp":1200746500000},"page":"119-143","source":"Crossref","is-referenced-by-count":6,"title":["SUBJECTIVE PROBABILITY AND INFORMATION RETRIEVAL: A REVIEW OF THE PSYCHOLOGICAL LITERATURE"],"prefix":"10.1108","volume":"44","author":[{"given":"PAUL","family":"THOMPSON","sequence":"first","affiliation":[]}],"member":"140","reference":[{"key":"p_1","doi-asserted-by":"publisher","DOI":"10.1145\/321033.321035"},{"key":"p_2","doi-asserted-by":"publisher","DOI":"10.1016\/0020-0271(73)90063-6"},{"key":"p_3","doi-asserted-by":"publisher","DOI":"10.1002\/asi.4630290302"},{"key":"p_4","volume-title":"SALTON, G. and SCHNEIDER, H.-J., eds. Lecture notes in computer science: research and development in information retrieval, proceedings.","author":"SMITH L. C.","year":"1982"},{"key":"p_5","doi-asserted-by":"publisher","DOI":"10.1093\/comjnl\/26.3.239"},{"issue":"4","key":"p_6","first-page":"129","volume":"2","author":"YU C. T.","year":"1983","journal-title":"Information Technology: Research and Development"},{"key":"p_7","first-page":"2","volume":"2","author":"MURPHY A. H.","year":"1977","journal-title":"National Weather Digest"},{"key":"p_8","volume-title":"Human judgment and decision making","author":"HAMMOND K. R.","year":"1980"},{"key":"p_9","doi-asserted-by":"publisher","DOI":"10.1016\/0030-5073(71)90033-X"},{"key":"p_10","volume-title":"Personal communication","author":"WHITE H.","year":"1986"},{"key":"p_11","volume-title":"A CM Computing Surveys, 73(1)","author":"MORAN T. P.","year":"1981"},{"key":"p_12","doi-asserted-by":"publisher","DOI":"10.1002\/asi.4630260107"},{"key":"p_13","doi-asserted-by":"publisher","DOI":"10.1145\/322017.322022"},{"issue":"5","key":"p_14","first-page":"139","volume":"19","author":"SPETZLER C. S.","year":"1975","journal-title":"Management Science"},{"key":"p_15","doi-asserted-by":"publisher","DOI":"10.1287\/mnsc.29.2.151"},{"key":"p_16","doi-asserted-by":"publisher","DOI":"10.1080\/01621459.1980.10477562"},{"key":"p_17","doi-asserted-by":"crossref","unstructured":"NAU, R. F. Coherent assessment of subjective probability. Ph.D. dissertation.University of California, Berkeley, 1981.","DOI":"10.21236\/ADA099722"},{"key":"p_18","doi-asserted-by":"publisher","DOI":"10.2307\/1402448"},{"key":"p_19","volume-title":"Judgment under uncertainty: heuristics and biases","author":"FISCHHOFF B.","year":"1982"},{"key":"p_20","doi-asserted-by":"publisher","DOI":"10.1093\/biomet\/45.3-4.562"},{"key":"p_21","doi-asserted-by":"publisher","DOI":"10.1080\/01621459.1971.10482346"},{"key":"p_22","volume-title":"Calibration of probabilities: the state of the art to","author":"LICHTENSTEIN S.","year":"1980"},{"key":"p_23","doi-asserted-by":"publisher","DOI":"10.1037\/h0053870"},{"key":"p_24","doi-asserted-by":"publisher","DOI":"10.1037\/h0044139"},{"key":"p_25","doi-asserted-by":"crossref","first-page":"59","DOI":"10.1177\/001872086200400201","volume":"4","author":"EDWARDS W","year":"1962","journal-title":"Human Factors"},{"key":"p_26","author":"EDWARDS W.","year":"1966","journal-title":"IEEE Transactions on Human Factors in Electronics, HFE-7"},{"key":"p_27","first-page":"35","volume":"5","author":"SAGE A. P.","year":"1983","journal-title":"Large Scale Systems"},{"key":"p_28","doi-asserted-by":"publisher","DOI":"10.1037\/0033-295X.90.3.239"},{"key":"p_29","doi-asserted-by":"publisher","DOI":"10.1016\/0030-5073(69)90029-4"},{"key":"p_30","doi-asserted-by":"publisher","DOI":"10.1016\/0010-4809(73)90071-2"},{"key":"p_31","doi-asserted-by":"publisher","DOI":"10.1016\/0030-5073(72)90008-6"},{"key":"p_32","doi-asserted-by":"publisher","DOI":"10.2307\/2981918"},{"key":"p_33","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9780511809477"},{"key":"p_34","doi-asserted-by":"publisher","DOI":"10.1016\/0010-0285(73)90033-9"},{"key":"p_35","doi-asserted-by":"publisher","DOI":"10.1126\/science.185.4157.1124"},{"key":"p_36","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9780511809477.022"},{"key":"p_37","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9780511809477.007"},{"key":"p_38","doi-asserted-by":"publisher","DOI":"10.1146\/annurev.ps.35.020184.001035"},{"key":"p_39","doi-asserted-by":"publisher","DOI":"10.1146\/annurev.ps.28.020177.000245"},{"key":"p_40","doi-asserted-by":"publisher","DOI":"10.2307\/1914185"},{"key":"p_41","volume-title":"TIMS Studies in the management sciences, 12","author":"KAHNEMAN D.","year":"1979"},{"key":"p_42","volume-title":"Mind over machine: the power of human intuition and expertise in the era of the computer","author":"DREYFUS H. L.","year":"1986"},{"key":"p_43","doi-asserted-by":"publisher","DOI":"10.1002\/asi.4630370410"},{"key":"p_44","doi-asserted-by":"publisher","DOI":"10.2307\/2345078"},{"key":"p_45","volume-title":"The conceptualframework of psychology","author":"BRUNSWIK E.","year":"1952"},{"key":"p_46","volume-title":"Formal representations of human judgment.","author":"HOFFMAN P. J.","year":"1968"},{"key":"p_47","doi-asserted-by":"publisher","DOI":"10.1037\/h0024722"},{"key":"p_48","doi-asserted-by":"publisher","DOI":"10.1016\/0030-5073(79)90047-3"},{"key":"p_49","doi-asserted-by":"publisher","DOI":"10.1016\/0030-5073(75)90012-4"},{"key":"p_50","doi-asserted-by":"publisher","DOI":"10.1016\/0030-5073(81)90040-4"},{"key":"p_51","doi-asserted-by":"publisher","DOI":"10.1002\/asi.4630280107"},{"key":"p_52","doi-asserted-by":"publisher","DOI":"10.1037\/0033-2909.90.2.197"},{"key":"p_53","doi-asserted-by":"crossref","unstructured":"BORGMAN, C. L. The user's mental model of an information retrieval system: effects on performance. Ph.D. dissertation.Stanford University, 1983.","DOI":"10.1145\/1013230.511818"},{"key":"p_54","volume-title":"Foundations of information integration theory","author":"ANDERSON N. H.","year":"1981"},{"key":"p_55","doi-asserted-by":"publisher","DOI":"10.1037\/10628-000"},{"key":"p_56","doi-asserted-by":"publisher","DOI":"10.1016\/0030-5073(73)90017-2"},{"key":"p_57","doi-asserted-by":"publisher","DOI":"10.1111\/j.2044-8317.1978.tb00570.x"},{"key":"p_58","doi-asserted-by":"publisher","DOI":"10.1111\/j.2044-8317.1981.tb00629.x"},{"key":"p_59","doi-asserted-by":"publisher","DOI":"10.1016\/0001-6918(82)90042-7"},{"key":"p_60","volume-title":"Expectations and actions: expectancy-value models in psychology.","author":"BEACH B. H.","year":"1982"},{"key":"p_61","volume-title":"Weather analysis and forecasting","volume":"1","author":"PETTERSSEN S.","year":"1956","edition":"2"},{"key":"p_62","doi-asserted-by":"publisher","DOI":"10.1016\/0030-5073(80)90052-5"},{"key":"p_63","volume":"439","author":"BENBASAT I.","year":"1982","journal-title":"IEEE Transactions on Systems, Man, and Cybernetics, SMC-12"},{"key":"p_64","doi-asserted-by":"publisher","DOI":"10.1287\/mnsc.19.5.475"},{"key":"p_65","volume-title":"Probability, induction and statistics: the art of guessing","author":"DE FINETTI B.","year":"1972"},{"key":"p_66","doi-asserted-by":"publisher","DOI":"10.1016\/0030-5073(82)90226-4"}],"container-title":["Journal of Documentation"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.emerald.com\/insight\/content\/doi\/10.1108\/eb026821\/full\/xml","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.emerald.com\/insight\/content\/doi\/10.1108\/eb026821\/full\/html","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,3,8]],"date-time":"2022-03-08T21:00:42Z","timestamp":1646773242000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.emerald.com\/insight\/content\/doi\/10.1108\/eb026821\/full\/html"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[1988,2,1]]},"references-count":66,"journal-issue":{"issue":"2","published-print":{"date-parts":[[1988,2,1]]}},"alternative-id":["10.1108\/eb026821"],"URL":"https:\/\/doi.org\/10.1108\/eb026821","relation":{},"ISSN":["0022-0418"],"issn-type":[{"value":"0022-0418","type":"print"}],"subject":[],"published":{"date-parts":[[1988,2,1]]}}}