Abstract
In recent years, many data visualization tools have appeared on the market that can potentially guarantee citizens and users of the Public Administration (PA) the ability to create dashboards and data stories with just a few clicks, using open and unopened data from the PA. The Data Analytics Framework (DAF), a project of the Italian government launched at the end of 2017 and currently being tested, has the goal to improve and simplify the interoperability and exchange of data between Public Administrations, thanks to its big data platform and the integrated use of data visualization tools and semantic technologies. The DAF also has the objective of facilitating data analysis, improving the management of Open Data and facilitating the spread of linked open data (LOD) thanks to the integration of OntoPiA, a network of controlled vocabularies and ontologies, such as “IoT Events”, an ontology for representing and modelling the knowledge within the domain of the Internet of Things. This paper contributes to the enhancement of the project by introducing a case study created by the author, concerns tourism of Sardinia (a region of Italy). The case study follows a process in the DAF in 5 steps, starting from selection of the dataset to the creation phase of the real dashboard through Apache Superset (a business intelligence tool) and the related data story. This case study is one of the few demonstrations of use on a real case of DAF and highlights the ability of this national platform to transform the analysis of a large amount of data into simple visual representations with clear and effective language.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
Notes
- 1.
The science of visual representation of ‘data’, which has been abstracted in some schematic form, including attributes or variables for the units of information.
- 2.
Open Government Data. http://www.oecd.org/gov/digital-government/open-government-data.htm.
- 3.
Lightweight Directory Access Protocol. http://foldoc.org/ldap.
- 4.
Superset Github repository. https://github.com/apache/incubator-superset.
- 5.
- 6.
- 7.
Data stories are an extension of the dashboards, which allow you to express what you can see from the views.
- 8.
- 9.
- 10.
Contest dedicated to open data, promoted by the Sardinia Region and held in the period from 16/10/2017 to 21/01/2018. http://contest.formez.it/.
- 11.
The complete dashboard is accessible online at http://bit.ly/storia-turismo-sardo-story.
References
AgID Advance digital transformation. https://avanzamentodigitale.italia.it/it/progetto/open-data. Accessed 10 Aug 2019
Temiz, S., Brown, T.: Open data project for e-government: case study of Stockholm open data project. Int. J. Electron. Gov. 9, 55 (2017). https://doi.org/10.1504/IJEG.2017.10005479
Drakopoulou, S.: Open data today and tomorrow: the present challenges and possibilities of open data. Int. J. Electron. Gov. 10, 157 (2018). https://doi.org/10.1504/IJEG.2018.10015213
Team Transformation D GitHub - italia/daf: Data & Analytics Framework (DAF). https://github.com/italia/daf. Accessed 10 Sept 2018
Digital Transformation Team (2019). https://teamdigitale.governo.it. Accessed 1 Jun 2018
HDFS Architecture Guide. https://hadoop.apache.org/docs/r1.2.1/hdfs_design.html. Accessed 12 Sept 2018
Desouza, K.C., Jacob, B.: Big Data in the Public Sector: Lessons for Practitioners and Scholars. Adm. Soc. (2017). https://doi.org/10.1177/0095399714555751
Gomes, E., Foschini, L., Dias, J., et al.: An infrastructure model for smart cities based on big data. Int. J. Grid Util. Comput. 9, 322 (2018). https://doi.org/10.1504/IJGUC.2018.10016122
European Interoperability Framework (EIF). https://ec.europa.eu/isa2/eif_en. Accessed 10 Dec 2018
Agid & Team Digitale (2018) OntoPia. https://github.com/italia/daf-ontologie-vocabolari-controllati. Accessed 10 Nov 2018
Apache Superset. https://superset.incubator.apache.org. Accessed 19 Aug 2018
Sabotta, C.: Introducing Microsoft BI Reporting and Analysis Tools. In: Microsoft (2015). http://msdn.microsoft.com/en-us/library/d0e16108-7123-4788-87b3-05db962dbc94
Tableau. Free Data Visualization Software. Tableau Public (2011)
Google Data Studio. https://datastudio.google.com/. Accessed 15 Sept 2018
Plotly. Modern Visualization for the Data Era – Plotly (2017). https://plot.ly/
MySql. https://www.mysql.com/i. Accessed 15 Sept 2018
PostgreSQL. PostgreSQL: The world’s most advanced open source database (2014). http://www.postgresql.org/. http://www.postgresql.org/
Metabase. https://www.metabase.com/. Accessed 16 Sept 2018
Redash. https://github.com/getredash/redash. Accessed 15 Sept 2018
Graves, A., Hendler, J.: Visualization tools for open government data. In: Proceedings of the 14th Annual International Conference on Digital Government Research - dg.o 2013, p. 136 (2013)
Ronacher A Flask MicroFramework. http://flask.pocoo.org/. Accessed 10 Sept 2018
Python. https://www.python.org/. Accessed 15 Sept 2018
NVD3 Project. http://nvd3.org/. Accessed 15 Sept 2018
van Dierendonck, R., van Tienhoven, S., Elid, T.: D3.JS: Data-Driven Documents (2015)
Team Transformation D Data & Analytics Framework (DAF) - Developer Documentation. https://daf-docs.readthedocs.io/. Accessed 15 Sept 2018
DAF - Public Dataportal. https://dataportal.daf.teamdigitale.it. Accessed 5 Jan 2019
DAF Private Dataportal. https://dataportal.daf.teamdigitale.it/#/login. Accessed 5 Jan 2019
Kong. https://konghq.com/. Accessed 15 Sept 2018
Apache Software Foundation, Apache Superset Contributors. Apache Superset — Apache Superset documentation (2018). https://superset.incubator.apache.org/
Jupyter Project. Project Jupyter | Project (2016). http://jupyter.org/about.html
CKAN (2018). https://github.com/ckan/ckan. Accessed 12 Sept 2018
Redis. https://redis.io. Accessed 15 Sept 2018
FreeIPA LDAP. https://www.freeipa.org/. Accessed 19 Sept 2018
StumbleUpon. OpenTSDB - A Distributed, Scalable Monitoring System (2012)
Apache Livy. https://livy.incubator.apache.org/. Accessed 19 Sept 2018
The Apache Software Foundation. Apache NiFi (2017)
Apache hadoop. https://hadoop.apache.org/. Accessed 3 Feb 2018
Apache HBase (2015). https://hbase.apache.org/. Accessed 12 Sept 2018
Apache Kudu. https://kudu.apache.org/. Accessed 11 Sept 2018
Fallucchi, F., Petito, M., De Luca, E.W.: Analysing and visualising open data within the data and analytics framework. In: Garoufallou, E., Sartori, F., Siatri, R., Zervas, M. (eds.) MTSR 2018. CCIS, vol. 846, pp. 135–146. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-14401-2_13
(SEMIC) SIC Core Vocabularies. https://joinup.ec.europa.eu/collection/semantic-interoperability-community-semic/core-vocabularies. Accessed 1 Dec 2018
Fayyad, U., Piatetsky-Shapiro, G., Smyth, P.: The KDD process for extracting useful knowledge from volumes of data. Commun. ACM (1996). https://doi.org/10.1145/240455.240464
ISO/IEC ISO/IEC 25024:2015 Systems and software engineering — Systems and software Quality Requirements and Evaluation (SQuaRE) — Measurement of data quality. Int. Stand. ISO/IEC 250242015. https://www.iso.org/obp/ui/#iso:std:iso-iec:25024:ed-1:v1:en. Accessed 14 Sept 2018
Sriparasa, S.S.: JavaScript and JSON Essentials (2013)
Apache Impala. https://impala.apache.org/. Accessed 15 Sept 2018
SQLite. https://www.sqlite.org/. Accessed 15 Sept 2018
Ansa. Turismo: 2,9mln arrivi in Sardegna 2016 (2018). http://bit.ly/AnsaTurismo2016. Accessed 15 Dec 2018
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Michele, P., Fallucchi, F., De Luca, E.W. (2019). Create Dashboards and Data Story with the Data & Analytics Frameworks. In: Garoufallou, E., Fallucchi, F., William De Luca, E. (eds) Metadata and Semantic Research. MTSR 2019. Communications in Computer and Information Science, vol 1057. Springer, Cham. https://doi.org/10.1007/978-3-030-36599-8_24
Download citation
DOI: https://doi.org/10.1007/978-3-030-36599-8_24
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-36598-1
Online ISBN: 978-3-030-36599-8
eBook Packages: Computer ScienceComputer Science (R0)