{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,9,16]],"date-time":"2024-09-16T01:18:19Z","timestamp":1726449499325},"reference-count":75,"publisher":"Institute for Operations Research and the Management Sciences (INFORMS)","issue":"4","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Decision Analysis"],"published-print":{"date-parts":[[2019,12]]},"abstract":"We explore some recent, and not so recent, developments concerning the use of probability forecasts and their combination in decision making. Despite these advances, challenges still exist. We expand on some important challenges influencing the \u201cgoodness\u201d of combined probability forecasts such as miscalibration, dependence among forecasters, and selection of an appropriate evaluation measure while connecting the processes of aggregating and evaluating forecasts to decision making. Through three important applications from the domains of meteorology, economics, and political science, we illustrate state-of-the-art usage of probability forecasts: how they are combined, evaluated, and communicated to stakeholders. We expect to see greater use and aggregation of probability forecasts, especially given developments in statistical modeling, machine learning, and expert forecasting; the popularity of forecasting competitions; and the increased reporting of probabilities in the media. Our vision is that increased exposure to and improved visualizations of probability forecasts will enhance the public\u2019s understanding of probabilities and how they can contribute to better decisions.<\/jats:p>","DOI":"10.1287\/deca.2019.0391","type":"journal-article","created":{"date-parts":[[2019,11,6]],"date-time":"2019-11-06T14:00:32Z","timestamp":1573048832000},"page":"239-260","source":"Crossref","is-referenced-by-count":50,"title":["Probability Forecasts and Their Combination: A Research Perspective"],"prefix":"10.1287","volume":"16","author":[{"ORCID":"http:\/\/orcid.org\/0000-0002-1051-6639","authenticated-orcid":false,"given":"Robert L.","family":"Winkler","sequence":"first","affiliation":[{"name":"Fuqua School of Business, Duke University, Durham, North Carolina 27708;"}]},{"ORCID":"http:\/\/orcid.org\/0000-0002-4781-9174","authenticated-orcid":false,"given":"Yael","family":"Grushka-Cockayne","sequence":"additional","affiliation":[{"name":"Harvard Business School, Harvard University, Boston, Massachusetts 02163;"},{"name":"Darden School of Business, University of Virginia, Charlottesville, Virginia 22903;"}]},{"ORCID":"http:\/\/orcid.org\/0000-0003-1303-8676","authenticated-orcid":false,"suffix":"Jr.","given":"Kenneth C.","family":"Lichtendahl","sequence":"additional","affiliation":[{"name":"Darden School of Business, University of Virginia, Charlottesville, Virginia 22903;"}]},{"ORCID":"http:\/\/orcid.org\/0000-0001-8078-368X","authenticated-orcid":false,"given":"Victor Richmond R.","family":"Jose","sequence":"additional","affiliation":[{"name":"McDonough School of Business, Georgetown University, Washington, DC 20057"}]}],"member":"109","reference":[{"key":"B1","doi-asserted-by":"publisher","DOI":"10.1007\/978-0-306-47630-3_19"},{"key":"B2","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0149817"},{"key":"B3","doi-asserted-by":"publisher","DOI":"10.1287\/mnsc.2015.2374"},{"key":"B5","doi-asserted-by":"publisher","DOI":"10.1057\/jors.1969.103"},{"key":"B6","doi-asserted-by":"publisher","DOI":"10.1016\/j.jbusvent.2013.07.003"},{"key":"B7","doi-asserted-by":"crossref","unstructured":"Bennett J, Lanning S (2007) The Netflix Prize.Proc. KDD Cup Workshop 2007(ACM, New York), 3\u20136.","DOI":"10.1145\/1345448.1345459"},{"key":"B8","doi-asserted-by":"publisher","DOI":"10.1287\/deca.1070.0089"},{"key":"B9","doi-asserted-by":"publisher","DOI":"10.1111\/j.1468-0262.2006.00691.x"},{"key":"B10","doi-asserted-by":"publisher","DOI":"10.1023\/A:1010933404324"},{"key":"B11","doi-asserted-by":"publisher","DOI":"10.1175\/1520-0493(1950)078<0001:VOFEIT>2.0.CO;2"},{"key":"B12","doi-asserted-by":"publisher","DOI":"10.1287\/mnsc.2014.1909"},{"key":"B13","doi-asserted-by":"publisher","DOI":"10.1287\/mnsc.1070.0727"},{"key":"B14","doi-asserted-by":"publisher","DOI":"10.1287\/deca.2016.0337"},{"key":"B15","doi-asserted-by":"publisher","DOI":"10.1142\/S179300570600052X"},{"key":"B16","doi-asserted-by":"crossref","unstructured":"Chen Y, Chu CH, Mullen T, Pennock DM (2005) Information markets vs. option pools: An empirical comparison.Proc. 6th ACM Conf. Electronic Commerce(ACM, New York), 58\u201367.","DOI":"10.1145\/1064009.1064016"},{"key":"B17","doi-asserted-by":"publisher","DOI":"10.1016\/0169-2070(89)90012-5"},{"key":"B18","doi-asserted-by":"publisher","DOI":"10.1287\/opre.33.2.427"},{"key":"B19","doi-asserted-by":"publisher","DOI":"10.1111\/j.1539-6924.1999.tb00399.x"},{"key":"B20","doi-asserted-by":"crossref","DOI":"10.1093\/oso\/9780195064650.001.0001","volume-title":"Experts in Uncertainty: Opinion and Subjective Probability in Science","author":"Cooke RM","year":"1991"},{"key":"B21","doi-asserted-by":"publisher","DOI":"10.1111\/risa.12353"},{"key":"B22","first-page":"3","volume":"3","author":"Croushore D","year":"1993","journal-title":"Bus. Rev. Federal Reserve Bank Philadelphia"},{"key":"B24","doi-asserted-by":"publisher","DOI":"10.1214\/aos\/1013203451"},{"key":"B25","doi-asserted-by":"publisher","DOI":"10.1287\/deca.2016.0340"},{"key":"B26","doi-asserted-by":"publisher","DOI":"10.1038\/075450a0"},{"key":"B27","doi-asserted-by":"publisher","DOI":"10.1214\/ss\/1177013825"},{"key":"B28","doi-asserted-by":"publisher","DOI":"10.1198\/016214506000001437"},{"key":"B29","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-9868.2007.00587.x"},{"issue":"1","key":"B30","doi-asserted-by":"crossref","first-page":"107","DOI":"10.1111\/j.2517-6161.1952.tb00104.x","volume":"14","author":"Good IJ","year":"1952","journal-title":"J. Roy. Statist. Soc. B"},{"key":"B31","doi-asserted-by":"publisher","DOI":"10.1287\/mnsc.2015.2389"},{"key":"B32","doi-asserted-by":"publisher","DOI":"10.1287\/opre.2017.1588"},{"key":"B33","doi-asserted-by":"publisher","DOI":"10.5750\/jpm.v1i1.417"},{"key":"B34","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijforecast.2016.02.001"},{"key":"B35","doi-asserted-by":"publisher","DOI":"10.1287\/mnsc.1040.0205"},{"issue":"6","key":"B36","first-page":"1","volume":"14","author":"Howe J","year":"2006","journal-title":"Wired"},{"key":"B39","doi-asserted-by":"publisher","DOI":"10.1007\/s11238-006-9006-2"},{"key":"B40","doi-asserted-by":"publisher","DOI":"10.1287\/deca.1070.0091"},{"key":"B42","doi-asserted-by":"publisher","DOI":"10.1287\/deca.1110.0216"},{"key":"B43","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijforecast.2007.06.001"},{"key":"B44","doi-asserted-by":"publisher","DOI":"10.1287\/opre.1080.0665"},{"key":"B45","doi-asserted-by":"publisher","DOI":"10.1287\/mnsc.2013.1781"},{"key":"B46","doi-asserted-by":"publisher","DOI":"10.1287\/opre.1070.0498"},{"key":"B47","doi-asserted-by":"publisher","DOI":"10.1002\/j.1538-7305.1956.tb03809.x"},{"key":"B49","doi-asserted-by":"publisher","DOI":"10.1056\/NEJMsa1803972"},{"key":"B50","doi-asserted-by":"publisher","DOI":"10.1287\/mnsc.1110.1441"},{"key":"B51","doi-asserted-by":"publisher","DOI":"10.1016\/j.jet.2014.03.012"},{"key":"B52","doi-asserted-by":"publisher","DOI":"10.1287\/mnsc.1050.0459"},{"key":"B54","doi-asserted-by":"publisher","DOI":"10.1287\/mnsc.1070.0729"},{"key":"B55","doi-asserted-by":"publisher","DOI":"10.1287\/opre.2013.1213"},{"key":"B56","doi-asserted-by":"publisher","DOI":"10.1287\/mnsc.1120.1667"},{"key":"B57","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9780511809477.023"},{"key":"B58","doi-asserted-by":"publisher","DOI":"10.1287\/mnsc.38.11.1562"},{"key":"B60","doi-asserted-by":"publisher","DOI":"10.1080\/00431672.2013.746592"},{"key":"B61","doi-asserted-by":"publisher","DOI":"10.1287\/mnsc.22.10.1087"},{"key":"B62","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.42.9.654"},{"issue":"6","key":"B63","first-page":"983","volume":"7","author":"Meinshausen N","year":"2006","journal-title":"J. Machine Learn. Res."},{"key":"B64","doi-asserted-by":"publisher","DOI":"10.1287\/deca.2013.0280"},{"issue":"12","key":"B65","author":"Miller K","year":"2018","journal-title":"Palm Beach Post"},{"issue":"387","key":"B66","first-page":"489","volume":"79","author":"Murphy AH","year":"1984","journal-title":"J. Amer. Statist. Assoc."},{"key":"B68","doi-asserted-by":"publisher","DOI":"10.1002\/0470033312"},{"key":"B69","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-9868.2009.00726.x"},{"key":"B70","doi-asserted-by":"publisher","DOI":"10.1287\/mnsc.2016.2720"},{"key":"B72","doi-asserted-by":"publisher","DOI":"10.1111\/1468-0262.00163"},{"key":"B73","volume-title":"The Foundations of Statistics","author":"Savage LJ","year":"1954"},{"key":"B74","doi-asserted-by":"publisher","DOI":"10.1080\/01621459.1971.10482346"},{"key":"B75","volume-title":"The Signal and the Noise: Why So Many Predictions Fail\u2014But Some Don\u2019t","author":"Silver N","year":"2012"},{"key":"B79","volume-title":"The Wisdom of Crowds","author":"Surowiecki J","year":"2005"},{"key":"B80","volume-title":"Superforecasting: The Art and Science of Prediction","author":"Tetlock PE","year":"2015"},{"key":"B81","doi-asserted-by":"publisher","DOI":"10.1007\/s10994-013-5401-4"},{"key":"B83","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijforecast.2015.11.014"},{"key":"B84","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-65052-4_9"},{"key":"B85","doi-asserted-by":"publisher","DOI":"10.1287\/mnsc.27.4.479"},{"key":"B86","doi-asserted-by":"publisher","DOI":"10.1287\/mnsc.40.11.1395"},{"key":"B87","doi-asserted-by":"publisher","DOI":"10.1007\/BF02562681"},{"key":"B88","doi-asserted-by":"publisher","DOI":"10.1287\/opre.40.3.609"},{"key":"B89","doi-asserted-by":"publisher","DOI":"10.1257\/0895330041371321"}],"container-title":["Decision Analysis"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/pubsonline.informs.org\/doi\/pdf\/10.1287\/deca.2019.0391","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,7,26]],"date-time":"2024-07-26T10:22:29Z","timestamp":1721989349000},"score":1,"resource":{"primary":{"URL":"https:\/\/pubsonline.informs.org\/doi\/10.1287\/deca.2019.0391"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,12]]},"references-count":75,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2019,12]]}},"alternative-id":["10.1287\/deca.2019.0391"],"URL":"https:\/\/doi.org\/10.1287\/deca.2019.0391","relation":{},"ISSN":["1545-8490","1545-8504"],"issn-type":[{"value":"1545-8490","type":"print"},{"value":"1545-8504","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,12]]}}}