{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,2,21]],"date-time":"2025-02-21T14:56:48Z","timestamp":1740149808230,"version":"3.37.3"},"reference-count":55,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2022,1,31]],"date-time":"2022-01-31T00:00:00Z","timestamp":1643587200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"Information theory can be used to analyze the cost\u2013benefit of visualization processes. However, the current measure of benefit contains an unbounded term that is neither easy to estimate nor intuitive to interpret. In this work, we propose to revise the existing cost\u2013benefit measure by replacing the unbounded term with a bounded one. We examine a number of bounded measures that include the Jenson\u2013Shannon divergence, its square root, and a new divergence measure formulated as part of this work. We describe the rationale for proposing a new divergence measure. In the first part of this paper, we focus on the conceptual analysis of the mathematical properties of these candidate measures. We use visualization to support the multi-criteria comparison, narrowing the search down to several options with better mathematical properties. The theoretical discourse and conceptual evaluation in this part provides the basis for further data-driven evaluation based on synthetic and experimental case studies that are reported in the second part of this paper.<\/jats:p>","DOI":"10.3390\/e24020228","type":"journal-article","created":{"date-parts":[[2022,2,1]],"date-time":"2022-02-01T14:59:21Z","timestamp":1643727561000},"page":"228","source":"Crossref","is-referenced-by-count":5,"title":["A Bounded Measure for Estimating the Benefit of Visualization (Part I): Theoretical Discourse and Conceptual Evaluation"],"prefix":"10.3390","volume":"24","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5320-5729","authenticated-orcid":false,"given":"Min","family":"Chen","sequence":"first","affiliation":[{"name":"Oxford e-Research Centre (OeRC), Department of Engineering Science, University of Oxford, Oxford OX1 3QG, UK"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2164-6858","authenticated-orcid":false,"given":"Mateu","family":"Sbert","sequence":"additional","affiliation":[{"name":"Department of Inform\u00e0tica i Matem\u00e0tica Aplicada, University of Girona, 17071 Girona, Spain"}]}],"member":"1968","published-online":{"date-parts":[[2022,1,31]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"2619","DOI":"10.1109\/TVCG.2015.2513410","article-title":"What May Visualization Processes Optimize?","volume":"22","author":"Chen","year":"2016","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"79","DOI":"10.1214\/aoms\/1177729694","article-title":"On information and sufficiency","volume":"22","author":"Kullback","year":"1951","journal-title":"Ann. Math. Stat."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Ishizaka, A., and Nemery, P. (2013). Multi-Criteria Decision Analysis: Methods and Software, John Wiley & Sons.","DOI":"10.1002\/9781118644898"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"145","DOI":"10.1109\/18.61115","article-title":"Divergence measures based on the Shannon entropy","volume":"37","author":"Lin","year":"1991","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Chen, M., Abdul-Rahman, A., Silver, D., and Sbert, M. (arXiv, 2022). A Bounded Measure for Estimating the Benefit of Visualization (Part II): Case Studies and Empirical Evaluation. (earlier version: arXiv:2103.02502), arXiv, under review.","DOI":"10.3390\/e24020282"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"379","DOI":"10.1002\/j.1538-7305.1948.tb01338.x","article-title":"A mathematical theory of communication","volume":"27","author":"Shannon","year":"1948","journal-title":"Bell Syst. Tech. J."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Cover, T.M., and Thomas, J.A. (2006). Elements of Information Theory, John Wiley & Sons.","DOI":"10.1002\/047174882X"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Chen, M., Feixas, M., Viola, I., Bardera, A., Shen, H.W., and Sbert, M. (2016). Information Theory Tools for Visualization, A K Peters.","DOI":"10.1201\/9781315369228"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"95","DOI":"10.1111\/1467-8659.00331","article-title":"An Information Theory Framework for the Analysis of Scene Complexity","volume":"18","author":"Feixas","year":"1999","journal-title":"Comput. Graph. Forum"},{"key":"ref_10","unstructured":"Rigau, J., Feixas, M., and Sbert, M. (2005, January 13\u201317). Shape Complexity Based on Mutual Information. Proceedings of the IEEE Shape Modeling and Applications, Cambridge, MA, USA."},{"key":"ref_11","unstructured":"Gumhold, S. (November, January 27). Maximum entropy light source placement. Proceedings of the IEEE Visualization, Boston, MA, USA."},{"key":"ref_12","first-page":"689","article-title":"Automatic View Selection Using Viewpoint Entropy and its Application to Image-Based Modelling","volume":"22","author":"Feixas","year":"2004","journal-title":"Comput. Graph. Forum"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/1462055.1462056","article-title":"A unified information-theoretic framework for viewpoint selection and mesh saliency","volume":"6","author":"Feixas","year":"2009","journal-title":"ACM Trans. Appl. Percept."},{"key":"ref_14","unstructured":"Ng, C.U., and Martin, G. (2004, January 14\u201316). Automatic selection of attributes by importance in relevance feedback visualisation. Proceedings of the Information Visualisation, London, UK."},{"key":"ref_15","unstructured":"Bordoloi, U., and Shen, H.W. (2005, January 23\u201328). View selection for volume rendering. Proceedings of the IEEE Visualization, Minneapolis, MN, USA."},{"key":"ref_16","unstructured":"Takahashi, S., and Takeshima, Y. (2005, January 23\u201328). A Feature-Driven Approach to Locating Optimal Viewpoints for Volume Visualization. Proceedings of the IEEE Visualization, Minneapolis, MN, USA."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"1029","DOI":"10.1109\/TVCG.2006.159","article-title":"LOD Map\u2014A Visual Interface for Navigating Multiresolution Volume Visualization","volume":"12","author":"Wang","year":"2005","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"933","DOI":"10.1109\/TVCG.2006.152","article-title":"Importance-Driven Focus of Attention","volume":"12","author":"Viola","year":"2006","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_19","first-page":"1384","article-title":"Multifield Visualization Using Local Statistical Complexity","volume":"13","author":"Wiebel","year":"2007","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"40","DOI":"10.1109\/MCG.2010.17","article-title":"Visual Analysis of Flow Features Using Information Theory","volume":"30","author":"Scheuermann","year":"2010","journal-title":"IEEE Comput. Graph. Appl."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"1547","DOI":"10.1109\/TVCG.2008.140","article-title":"Importance-Driven Time-Varying Data Visualization","volume":"14","author":"Wang","year":"2008","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"773","DOI":"10.1111\/j.1467-8659.2009.01689.x","article-title":"Isosurface similarity maps","volume":"29","author":"Bruckner","year":"2010","journal-title":"Comput. Graph. Forum"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"1932","DOI":"10.1109\/TVCG.2011.173","article-title":"Automatic transfer functions based on informational divergence","volume":"17","author":"Ruiz","year":"2011","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"870","DOI":"10.1109\/JBHI.2013.2263227","article-title":"Information Theory-Based Automatic Multimodal Transfer Function Design","volume":"17","author":"Bramon","year":"2013","journal-title":"IEEE J. Biomed. Health Inform."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"1574","DOI":"10.1109\/TVCG.2011.280","article-title":"Multimodal Data Fusion based on Mutual Information","volume":"18","author":"Bramon","year":"2012","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1111\/cgf.12087","article-title":"Evaluating Isosurfaces with Level-set-based Information Maps","volume":"32","author":"Wei","year":"2013","journal-title":"Comput. Graph. Forum"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"411","DOI":"10.1111\/cgf.12128","article-title":"An Information-Theoretic Observation Channel for Volume Visualization","volume":"32","author":"Bramon","year":"2013","journal-title":"Comput. Graph. Forum"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"2683","DOI":"10.1109\/TVCG.2013.133","article-title":"An Information-Aware Framework for Exploring Multivariate Data Sets","volume":"19","author":"Biswas","year":"2013","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"1206","DOI":"10.1109\/TVCG.2010.132","article-title":"An Information-theoretic Framework for Visualization","volume":"16","author":"Chen","year":"2010","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"241","DOI":"10.1111\/cgf.12380","article-title":"Visual multiplexing","volume":"33","author":"Chen","year":"2014","journal-title":"Comput. Graph. Forum"},{"key":"ref_31","unstructured":"Purchase, H.C., Andrienko, N., Jankun-Kelly, T.J., and Ward, M. (2008). Theoretical Foundations of Information Visualization. Information Visualization: Human-Centered Issues and Perspectives, Springer. LNCS 4950."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"1216","DOI":"10.1109\/TVCG.2010.131","article-title":"An information-theoretic framework for flow visualization","volume":"16","author":"Xu","year":"2010","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"254","DOI":"10.3390\/e13010254","article-title":"Information Theory in Scientific Visualization","volume":"13","author":"Wang","year":"2011","journal-title":"Entropy"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"71","DOI":"10.1109\/TVCG.2016.2598829","article-title":"An analysis of machine- and human-analytics in classification","volume":"23","author":"Tam","year":"2017","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"73","DOI":"10.1111\/cgf.13169","article-title":"Empirically measuring soft knowledge in visualization","volume":"36","author":"Kijmongkolchai","year":"2017","journal-title":"Comput. Graph. Forum"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"32","DOI":"10.1109\/TVCG.2018.2865025","article-title":"cost\u2013benefit analysis of visualization in virtual environments","volume":"25","author":"Chen","year":"2019","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"131","DOI":"10.1111\/cgf.13677","article-title":"An ontological framework for supporting the design and evaluation of visual analytics systems","volume":"38","author":"Chen","year":"2019","journal-title":"Comput. Graph. Forum"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"2220","DOI":"10.1109\/TVCG.2019.2940026","article-title":"Why visualize? Untangling a large network of arguments","volume":"27","author":"Streeb","year":"2019","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Viola, I., Chen, M., and Isenberg, T. (2020). Visual Abstraction. Foundations of Data Visualization, Springer.","DOI":"10.1007\/978-3-030-34444-3_2"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"323","DOI":"10.1111\/cgf.14310","article-title":"Design Space of Origin-Destination Data Visualization","volume":"40","author":"Tennekes","year":"2021","journal-title":"Computer Graphics Forum"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"103","DOI":"10.1109\/MCG.2017.3271463","article-title":"Pathways for Theoretical Advances in Visualization","volume":"37","author":"Chen","year":"2017","journal-title":"IEEE Comput. Graph. Appl."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Chen, M. (2020). Cost\u2013benefit Analysis of Data Intelligence\u2014Its Broader Interpretations. Advances in Info-Metrics: Information and Information Processing across Disciplines, Oxford University Press.","DOI":"10.1093\/oso\/9780190636685.003.0016"},{"key":"ref_43","unstructured":"Chen, M. (2021). A Short Introduction to Information-Theoretic cost\u2013benefit Analysis. arXiv."},{"key":"ref_44","unstructured":"Chen, M., and Sbert, M. (2019). On the Upper Bound of the Kullback\u2013Leibler Divergence and Cross Entropy. arXiv."},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Moser, S.M. (2012). A Student\u2019s Guide to Coding and Information Theory, Cambridge University Press.","DOI":"10.1017\/CBO9781139059534"},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"1858","DOI":"10.1109\/TIT.2003.813506","article-title":"A new metric for probability distributions","volume":"49","author":"Endres","year":"2003","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"639","DOI":"10.1007\/BF02517812","article-title":"A new class of metric divergences on probability spaces and its statistical applications","volume":"55","author":"Vajda","year":"2003","journal-title":"Ann. Inst. Stat. Math."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"4394","DOI":"10.1109\/TIT.2006.881731","article-title":"On divergences and informations in statistics and information theory","volume":"52","author":"Liese","year":"2006","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"3797","DOI":"10.1109\/TIT.2014.2320500","article-title":"R\u00e9nyi Divergence and Kullback\u2013Leibler Divergence","volume":"60","author":"Harremos","year":"2014","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_50","unstructured":"Klein, H.A. (2012). The Science of Measurement: A Historical Survey, Dover Publications."},{"key":"ref_51","unstructured":"Pedhazur, E.J., and Schmelkin, L.P. (1991). Measurement, Design, and Analysis: An Integrated Approach, Lawrence Erlbaum Associates."},{"key":"ref_52","first-page":"79","article-title":"Base-criterion on multi-criteria decision-making method and its applications","volume":"15","author":"Haseli","year":"2020","journal-title":"Int. J. Manag. Sci. Eng. Manag."},{"key":"ref_53","unstructured":"Chen, M., and Sbert, M. (2021). Is the Chen-Sbert Divergence a Metric?. arXiv."},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"824","DOI":"10.1098\/rstl.1700.0082","article-title":"Scala graduum caloris","volume":"22","author":"Newton","year":"1701","journal-title":"Philos. Trans."},{"key":"ref_55","unstructured":"Golin, M.J. (2020, March 15). Lecture 17: Huffman Coding. Available online: http:\/\/home.cse.ust.hk\/faculty\/golin\/COMP271Sp03\/Notes\/MyL17.pdf."}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/24\/2\/228\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,7,25]],"date-time":"2024-07-25T12:22:58Z","timestamp":1721910178000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/24\/2\/228"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,1,31]]},"references-count":55,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2022,2]]}},"alternative-id":["e24020228"],"URL":"https:\/\/doi.org\/10.3390\/e24020228","relation":{},"ISSN":["1099-4300"],"issn-type":[{"type":"electronic","value":"1099-4300"}],"subject":[],"published":{"date-parts":[[2022,1,31]]}}}