An evolutional model for operation-driven visualization design | Journal of Visualization Skip to main content
Springer Nature Link
Log in

An evolutional model for operation-driven visualization design

  • Regular Paper
  • Published:
Journal of Visualization Aims and scope Submit manuscript

Abstract

Although there are many visualization authoring tools, often the design process is confirmatory in that the user either selects and refines pre-built visualization templates or manually constructs the visualization following the standard visual mapping pipelines. During this process, an amount of time is spent on the interactive specification of visual forms or visual encoding configurations. In this paper, we present a novel visualization design scheme that provides operational guidance for progressive refinements when designing a visualization. The key idea is an evolutional operation model that models the design flowchart as a composition of a sequence of operations based on the current design and recommends available evolutions in the design space. One distinct advantage of our approach is that it facilitates discovering design subtasks relevant to the visualizations and enables the composition of a visualization based on the evolutional operations. As a demonstration of the concept, we implement a prototype and test its efficiency on a set of challenging design examples. Case studies verify that the proposed scheme effectively enhances the creativity of designs and releases the user from having to interpret their data and design intention with toolkit-specific abstractions.

Graphic abstract

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
¥17,985 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price includes VAT (Japan)

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

Notes

  1. https://archive.ics.uci.edu/ml/datasets/Auto+MPG.

  2. http://archive.ics.uci.edu/ml/datasets/Wine+Quality.

References

  • Bigelow A, Drucker S, Fisher D, Meyer M (2014) Reflections on how designers design with data. In: Proceedings of the 2014 international working conference on advanced visual interfaces. ACM, pp 17–24

  • Bostock M, Ogievetsky V, Heer J (2011) D\(^3\) data-driven documents. IEEE Trans Vis Comput Graph 17(12):2301–2309

    Article  Google Scholar 

  • Brehmer M, Munzner T (2013) A multi-level typology of abstract visualization tasks. IEEE Trans Vis Comput Graph 19(12):2376–2385

    Article  Google Scholar 

  • Brodlie K, Poon A, Wright H, Brankin L, Banecki G (1993) A Gay GRASPARC: a problem solving environment integrating computation and visualization. In: Proceedings of the 4th conference on visualization’93. IEEE Computer Society, pp 102–109

  • Card SK, Mackinlay JD, Shneiderman B (1999) Readings in information visualization: using vision to think. Morgan Kaufmann

    Google Scholar 

  • Derthick M, Roth SF (2001) Enhancing data exploration with a branching history of user operations. Knowl-Based Syst 14(1):65–74

    Article  Google Scholar 

  • Gotz D, Wen Z (2009) Behavior-driven visualization recommendation. In: Proceedings of the 14th international conference on Intelligent user interfaces. ACM, pp 315–324

  • Grammel L, Tory M, Storey M-A (2010) How information visualization novices construct visualizations. IEEE Trans Vis Comput Graph 16(6):943–952

    Article  Google Scholar 

  • Heer J, Shneiderman B (2012) Interactive dynamics for visual analysis. Queue 10(2):30

    Article  Google Scholar 

  • Heer J, Mackinlay J, Stolte C, Agrawala M (2008) Graphical histories for visualization: supporting analysis, communication, and evaluation. IEEE Trans Vis Comput Graph 14(6):1189–1196

    Article  Google Scholar 

  • Heer J, Van Ham F, Carpendale S, Weaver C, Isenberg P (2008) Creation and collaboration: Engaging new audiences for information visualization. In: Information visualization. Springer, pp 92–133

  • Hoarau R, Conversy S (2012) Augmenting the scope of interactions with implicit and explicit graphical structures. In: ACM SIGCHI, pp 1937–1946

  • Horvitz E (1999) Principles of mixed-initiative user interfaces. In: ACM SIGCHI, pp 159–166

  • Javed W, Elmqvist N (213) ExPlates: spatializing interactive analysis to scaffold visual exploration. In: Computer graphics forum, vol 32, Wiley Online Library, pp 441–450

  • Kandel S, Paepcke A, Hellerstein J, and Heer JW (2011) Interactive visual specification of data transformation scripts. In: Proceedings of the SIGCHI conference on human factors in computing systems. ACM, pp 3363–3372

  • Kim NW, Schweickart E, Liu Z, Dontcheva M, Li W, Popovic J, Pfister H (2017) Data-driven guides: supporting expressive design for information graphics. IEEE Trans Vis Comput Graph 23(1):491–500

    Article  Google Scholar 

  • Kim Y, Wongsuphasawat K, Hullman J, Heer JG (2017) A model for automated reasoning about visualization similarity and sequencing. In: Proceedings of the 2017 CHI conference on human factors in computing systems, pp 2628–2638

  • Klemmer SR, Thomsen M, Phelps-Goodman E, Lee R, Landay JA (2002) Where do web sites come from?: capturing and interacting with design history. In: Proceedings of the SIGCHI conference on human factors in computing systems. ACM, pp 1–8

  • Lillicrap TP, Hunt JJ, Pritzel A, Heess N, Erez T, Tassa Y, Silver D, Wierstra D (2015) Continuous control with deep reinforcement learning. arXiv:1509.02971

  • Ma K-L (1999) Image graphs-a novel approach to visual data exploration. In: Proceedings of the conference on Visualization’99: celebrating ten years. IEEE Computer Society Press, pp 81–88

  • Mackinlay J (1986) Automating the design of graphical presentations of relational information. ACM Trans Graph (TOG) 5(2):110–141

    Article  Google Scholar 

  • Mackinlay J, Hanrahan P, Stolte C (2007) Show me: automatic presentation for visual analysis. IEEE Trans Vis Comput Graph 13(6):1137–1144

    Article  Google Scholar 

  • Méndez GG, Hinrichs U, Nacenta M (2017) Bottom-up vs. top-down: trade-offs in efficiency, understanding, freedom and creativity with InfoVis tools. In: Proceedings of the 2017 CHI conference on human factors in computing systems. ACM Press-Association for Computing Machinery

  • Méndez GG, Nacenta MA, Vandenheste S (2016) iVoLVER: interactive visual language for visualization extraction and reconstruction. In: Proceedings of the 2016 CHI conference on human factors in computing systems .ACM, pp 4073–4085

  • Mnih V, Kavukcuoglu K, Silver D, Graves A, Antonoglou I, Wierstra D, Riedmiller M (2013) Playing atari with deep reinforcement learning. arXiv:1312.5602

  • Perry DB, Howe B, Key AM, Aragon C (2013) Vizdeck: Streamlining exploratory visual analytics of scientific data

  • Ren D, Höllerer T, Yuan X (2014) iVisDesigner: expressive interactive design of information visualizations. IEEE Trans Vis Comput Graph 20(12):2092–2101

    Article  Google Scholar 

  • Saket B, Kim H, Brown ET, Endert A (2017) Visualization by demonstration: an interaction paradigm for visual data exploration. IEEE Trans Vis Comput Graph 23(1):331–340

    Article  Google Scholar 

  • Satyanarayan A, Moritz D, Wongsuphasawat K, Heer J (2017) Vega-lite: a grammar of interactive graphics. IEEE Trans Vis Comput Graph 23(1):341–350

    Article  Google Scholar 

  • Satyanarayan A, Heer AL (2014) An interactive visualization design environment. In: Computer graphics forum, vol 33. Wiley Online Library, pp 351–360

  • Scull C, Johnson S, Aliaga F, Paris S, Su SL, Durand F (2009) Interactive visual histories for vector graphics

  • Shneiderman B (1994) Dynamic queries for visual information seeking. IEEE Softw 11(6):70–77

    Article  Google Scholar 

  • Stolte C, Tang D, Hanrahan P (2002) Polaris: a system for query, analysis, and visualization of multidimensional relational databases. IEEE Trans Vis Comput Graph 8(1):52–65

    Article  Google Scholar 

  • Tableau Software https://www.tableau.com. Accessed Mar 2017

  • Tukey JW (1977) Exploratory data analysis. Reading, Mass

    MATH  Google Scholar 

  • Vartak M, Rahman S, Madden S, Parameswaran A, Polyzotis N (2015) S eeDB: efficient data-driven visualization recommendations to support visual analytics. Proc VLDB Endowment 8(13):2182–2193

    Article  Google Scholar 

  • Victor B (2017) Drawing dynamic visualizations. http://vimeo.com/66085662. Accessed Mar 2017

  • Wei Y, Mei H, Zhao Y, Zhou S, Lin B, Jiang H, Chen W (2019) Evaluating perceptual bias during geometric scaling of scatterplots. IEEE Trans Vis Comput Graph 26(1):321–331

    Article  Google Scholar 

  • Wilkinson L (2006) The grammar of graphics. Springer, Berlin

    MATH  Google Scholar 

  • Wirth N (1971) Program development by stepwise refinement. Commun ACM 14(4):221–227

    Article  Google Scholar 

  • Wongsuphasawat K, Moritz D, Anand A, Mackinlay J, Howe B, Voyager HJ (2016) Exploratory analysis via faceted browsing of visualization recommendations. IEEE Trans Vis Comput Graph 22(1):649–658

    Article  Google Scholar 

  • Wongsuphasawat K, Moritz D, Anand A, Mackinlay J, Howe B, Heer J (2016) Towards a general-purpose query language for visualization recommendation. In: Proceedings of the workshop on human-in-the-loop data analytics, number 4. ACM

  • Wongsuphasawat K, Qu Z, Moritz D, Chang R, Ouk F, Anand AJ, Mackinlay BH, Voyager JH (2017) 2: augmenting visual analysis with partial view specifications. In : Proceedings of the 2017 CHI conference on human factors in computing systems. ACM, pp 2648–2659

  • Yalçın MA, Elmqvist N, Bederson BB (2016) Cognitive stages in visual data exploration. In: Proceedings of the beyond time and errors on novel evaluation methods for visualization, pp 86–95

  • Yee K-P, Swearingen K, Li K, Hearst M (2003) Faceted metadata for image search and browsing. In: Proceedings of the SIGCHI conference on Human factors in computing systems. ACM, pp 401–408

  • Zhao Y, Luo X, Lin X, Wang H, Kui X, Zhou F, Wang J, Chen Y, Chen W (2019) Visual analytics for electromagnetic situation awareness in radio monitoring and management. IEEE Trans Vis Comput Graph 26(1):590–600

    Article  Google Scholar 

  • Zhao X, Zhang L, Xia L, Ding Z, Yin D, Tang J (2017) Deep reinforcement learning for list-wise recommendations. arXiv:1801.00209

  • Zhou F, Lin X, Liu C, Zhao Y, Xu P, Ren L, Xue T, Ren L (2019) A survey of visualization for smart manufacturing. J Vis 22(2):419–435

    Article  Google Scholar 

Download references

Acknowledgements

We wish to thank all the participants for their active participation. The work is supported by the National Natural Science Foundation of China (No. 61772456, 61972122).

Author information

Authors and Affiliations

  1. The State Key Lab of CAD& CG, Zhejiang University, Hangzhou, 310058, Zhejiang, China

    Yating Wei & Wei Chen

  2. Zhejiang University - China Southern Power Grid Joint Research Centre on AI, Hangzhou, China

    Wei Chen

  3. Alibaba Group, Hangzhou, 311121, China

    Honghui Mei

  4. Digital Grid Research Institute, China Southern Power Grid, Guangzhou, 510670, China

    Wenqi Huang

  5. Hangzhou Dianzi University, Hangzhou, 310018, China

    Xiangyang Wu

  6. Zhengzhou University, Zhengzhou , 450001, China

    Mingliang Xu

Authors
  1. Yating Wei
    View author publications

    You can also search for this author inPubMed Google Scholar

  2. Honghui Mei
    View author publications

    You can also search for this author inPubMed Google Scholar

  3. Wenqi Huang
    View author publications

    You can also search for this author inPubMed Google Scholar

  4. Xiangyang Wu
    View author publications

    You can also search for this author inPubMed Google Scholar

  5. Mingliang Xu
    View author publications

    You can also search for this author inPubMed Google Scholar

  6. Wei Chen
    View author publications

    You can also search for this author inPubMed Google Scholar

Corresponding author

Correspondence to Wei Chen.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Wei, Y., Mei, H., Huang, W. et al. An evolutional model for operation-driven visualization design. J Vis 25, 95–110 (2022). https://doi.org/10.1007/s12650-021-00784-w

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12650-021-00784-w

Keywords