Skip to main content

Analysing and Visualising Open Data Within the Data and Analytics Framework

  • Conference paper
  • First Online:
Metadata and Semantic Research (MTSR 2018)

Abstract

The principles of open data and the five-star model allow companies to develop low-cost services and Public Administrations (PA) to improve efficiency. However, the process of implementing open data models and principles is not easy unless it is supported by an appropriate technology platform. Today there is a huge number of technological platforms which each promise to be the ideal solution for opening data. Current solutions (commercial or free) do not provide users with easy access to data, nor tools for analysing and displaying data. In this paper, we discuss the potential of the DAF (Data Analytics Framework), a project based on big data, which was created by the Italian government in 2017 and which fosters the integration and standardisation of data, as well as providing three powerful tools for analysis and data visualisation. The paper will then illustrate a concrete case of dashboard development within the DAF, released at an important hackathon organised by the Italian PA sector in October 2017. The project serves as a use case in DAF implementation, where its analytical tools are used for data analysis & visualisation. They also translate a large amount of data into simple representations and use clear and effective language.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    https://cad.readthedocs.io/it/v2017-12-13/_rst/capo5_sezione1_art50-ter.html.

  2. 2.

    http://www1.finanze.gov.it/finanze2/analisi_stat/v_4_0_0/contenuti/analisi_dati_2015_irpef.pdf?d=1494338400.

References

  1. Lillo, R., et al.: Data & Analytics Framework. https://developers.italia.it/en/daf/

  2. Government Digital Service, Digital Transf. (2014). https://www.gov.uk/transformation

  3. DCAT-AP_IT v1.0 – Profilo italiano di DCAT-AP | Dati.gov.it. https://www.dati.gov.it/content/dcat-ap-it-v10-profilo-italiano-dcat-ap-0

  4. EIF, European Interoperability Framework, White Pages (2004). https://ec.europa.eu/isa2/eif_en

  5. Lillo, R.: Data and Analytics Framework. How Public Sector Can Profit from Its Immense Asset, Data, pp. 3–9 (2018)

    Google Scholar 

  6. Sedkaoui, S., Monino, J.L.: Big Data, Open Data and Data Development. ISTE-Wiley, New York (2016). https://books.google.it/books?id=IfpRCgAAQBAJ. ISBN 9781848218802

  7. Beccaceci, R., et al.: Education with ‘living artworks’ in museums. In: CSEDU 2009 - Proceedings of the 1st Inter. Conference on Computer Supported Education, vol. 1 (2009)

    Google Scholar 

  8. Arcidiacono, G., et al.: The use of lean six sigma methodology in digital curation. In: CEUR Workshop Proceedings, no. 2014 (2016)

    Google Scholar 

  9. Fallucchi, F., et al.: Connecting and mapping LOD and CMDI through knowledge organization. In: Track Digital Humanities and Digital Curation of the 12th Metadata and Semantics Research Conference, 23–26 October 2018, Limassol, Cyprus (2018)

    Google Scholar 

  10. Fallucchi, F. et al.: Creating CMDI-profiles for textbook resources. In: Track Digital Humanities and Digital Curation of the 12th Metadata and Semantics Research Conference, 23–26 October 2018, Limassol, Cyprus (2018)

    Google Scholar 

  11. Fallucchi, F., Alfonsi, E., Ligi, A., Tarquini, M.: Ontology-driven public administration web hosting monitoring system. In: Meersman, R., et al. (eds.) On the Move to Meaningful Internet Systems: OTM 2014. LNCS, vol. 8842, pp. 618–625. Springer, Heidelberg (2014). https://doi.org/10.1007/978-3-662-45550-0_63

    Chapter  Google Scholar 

  12. Bianchi, M., et al.: Service level agreement constraints into processes for document classification. In: Proceedings of 16th International Conference on Enterprise Information Systems vol. 1 (2014)

    Google Scholar 

  13. Zhang, D., et al.: A knowledge management framework for the support of decision making in humanitarian assistance/disaster relief. Knowl. Inf. Syst. 4(3), 370–385 (2002)

    Article  Google Scholar 

  14. Fallucchi, F., et al.: Supporting humanitarian logistics with intelligent applications for disaster management. In: INTELLI 2016, p. 64 (2016)

    Google Scholar 

  15. Fallucchi, F., Tarquini, M., De Luca, E.W.: Knowledge Management for the Support of Logistics During Humanitarian Assistance and Disaster Relief (HADR). In: Díaz, P., Bellamine Ben Saoud, N., Dugdale, J., Hanachi, C. (eds.) ISCRAM-med 2016. LNBIP, vol. 265, pp. 226–233. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-47093-1_19

    Chapter  Google Scholar 

  16. Ferroni, P., et al.: Risk assessment for venous thromboembolism in chemotherapy-treated ambulatory cancer patients. Med. Decis. Mak. 37(2), 234–242 (2017)

    Article  Google Scholar 

  17. Ferroni, P., et al.: Validation of a machine learning approach for venous thromboembolism risk prediction in oncology. Dis. Markers 2017, 1–7 (2017)

    Article  Google Scholar 

  18. Scarpato, N., Pieroni, A., Di Nunzio, L., Fallucchi, F.: E-health-IoT universe: a review. Int. J. Adv. Sci. Eng. Inf. Technol. 7(6), 2328–2336 (2017)

    Article  Google Scholar 

  19. Pieroni, A., Scarpato, N., Brilli, M:. Industry 4.0 revolution in autonomous and connected vehicle a non-conventional approach to manage big data. J. Theor. Appl. Inf. Technol. 96(1), 10–18 (2018)

    Google Scholar 

  20. Pieroni, A., Scarpato, N., Di Nunzio, L., Fallucchi, F., Raso, M.: Smarter City: smart energy grid based on blockchain technology. Int. J. Adv. Sci. Eng. Inf. Technol. 8(1), 298–306 (2018)

    Article  Google Scholar 

  21. Tableau, Business Intelligence and Analytics (2016). https://www.tableau.com/

  22. Google Data Board. http://think.withgoogle.com/databoard/#lang=en-us&study=23&topic=59

  23. Modern Visualization for the Data Era - Plotly. https://plot.ly/

  24. Alvaro Graves, J.H.: Visualization tools for open government data (2013)

    Google Scholar 

  25. Tableau, Free Data Visualization Software, Tableau Public (2011). http://www.tableausoftware.com/public

  26. Socrata: Data-Driven Innovation of Government Programs. https://socrata.com/

  27. Open Data Regione Lombardia. https://www.dati.lombardia.it/

  28. Presentation - Smartdatanet. http://www.smartdatanet.it/presentation.html

  29. The world’s leading software development platform GitHub. https://github.com/

  30. Yucca - Cerca Dati. https://userportal.smartdatanet.it/userportal/#/dataexplorer/search

  31. Dashboard - Smartdatanet. http://www.smartdatanet.it/yuccadashboard/dashboard.html

  32. Correa, A.S., et al.: Investigating open data portals automatically. In: Proceedings of 19th Annual International Conference on Digital Government Research Governance in the Data Age, pp. 1–10 (2018)

    Google Scholar 

  33. CKAN. https://ckan.org/

  34. affero.org: affero general public license faqs. http://www.affero.org/oagf.html

  35. U.S. government’s data portal Data.gov relaunched on CKAN – ckan. https://ckan.org/2013/05/23/data-gov-relaunch-on-ckan/

  36. Deliverable 2.1 now available | ROUTE-TO-PA. https://routetopa.eu/deliverable-2-1-state-of-the-art-report-and-evaluation-of-existing-open-data-platforms-now-available/

  37. Linked Data - Design Issues. https://www.w3.org/DesignIssues/LinkedData.html

  38. GitHub - italia/daf-ontologie-vocabolari-controllati: Elenco di ontologie e vocabolari controllati. https://github.com/italia/daf-ontologie-vocabolari-controllati

  39. RDF - Semantic Web Standards. https://www.w3.org/RDF/

  40. Camarda, D.V., et al.: LodLive, exploring the web of data. In: Proceedings of the 8th International Conference on Semantic Systems - I-SEMANTICS 2012, p. 197 (2012)

    Google Scholar 

  41. Aliprand, J., Unicode Consortium: The Unicode standard. Addison-Wesley, Reading (2003)

    Google Scholar 

  42. Project Jupyter, Project Jupyter | Home (2017). http://jupyter.org/

  43. Apache SparkTM - Unified Analytics Engine for Big Data. https://spark.apache.org/

  44. R. C. Team: The R Project for Statistical Computing, Http://Www.R-Project.Org/ (2013). https://www.r-project.org/

  45. Edelman, A.: The Julia Language (2013). http://julialang.org/

  46. Scala, The Scala Programming Language (2011). http://www.scala-lang.org/

  47. R. T. Fielding: Architectural Styles and the Design of Network-based Software Architectures (2000)

    Google Scholar 

  48. Metabase https://www.metabase.com/

  49. Apache Superset (incubating) (2016). https://superset.incubator.apache.org/index.html

  50. StumbleUpon, OpenTSDB - A Distributed, Scalable Monitoring System (2012). http://opentsdb.net/

  51. Apache Livy. https://livy.incubator.apache.org/

  52. The Apache Software Foundation, Apache NiFi, Website (2017). https://nifi.apache.org/

  53. GitHub - italia/daf: Data Analytics Framework (DAF). https://github.com/italia/daf

  54. Daf Semantics repository. https://github.com/italia/daf-semantics/

  55. PostgreSQL, PostgreSQL: The world’s most advanced open source database, Http://Www.Postgresql.Org/ (2014). http://www.postgresql.org/. Accessed 07 June 2018

  56. MongoDB, MongoDB for GIANT Ideas | MongoDB, MongoDB (2018). https://www.mongodb.com/

  57. Adhikari, M., Kar, S.: NoSQL databases, Handbook of Research on Securing Cloud-Based Databases with Biometric Applications (2014). https://www.scopus.com/inward/record.uri?eid=2-s2.0-84945404497&doi=10.4018%2F978-1-4666-65590.ch006&partnerID=40&md5=227b5b6488851b9879d98ddc127ab017

  58. Redis. https://redis.io/

  59. D3.js - Data-Driven Documents. https://d3js.org/

  60. Hack.Developers - Cambia la PA, Riavvia il sistema Operativo del Paese. https://hack.developers.italia.it/

  61. ISO 3166-2:IT - Wikipedia. https://it.wikipedia.org/wiki/ISO_3166-2:IT

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Francesca Fallucchi .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Fallucchi, F., Petito, M., De Luca, E.W. (2019). Analysing and Visualising Open Data Within the Data and Analytics Framework. In: Garoufallou, E., Sartori, F., Siatri, R., Zervas, M. (eds) Metadata and Semantic Research. MTSR 2018. Communications in Computer and Information Science, vol 846. Springer, Cham. https://doi.org/10.1007/978-3-030-14401-2_13

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-14401-2_13

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-14400-5

  • Online ISBN: 978-3-030-14401-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics