Data Processing and Harmonization for Intelligent Transportation Systems: An Application Scenario on Highway Traffic Flows

  • Paulo Figueiras
  • Guilherme Guerreiro
  • Ricardo Silva
  • Ruben Costa
  • Ricardo Jardim-Gonçalves
Part of the Studies in Computational Intelligence book series (SCI, volume 756)


In the advent of ITS (Intelligent Transportation Systems) the transportation sector generates large volumes of real-time data that needs to be collected, harmonized, interpreted, aggregated, and analysed. To this end, innovative big data processing and mining, together with optimization techniques, need to be developed and applied to better support real-time decision-making capabilities. This chapter presents an ETL (Extract-Transform-Load) architecture for intelligent transportation systems, addressing an application scenario on dynamic toll charging for highways. The ETL approach presented is responsible for preparing the data to be used by traffic prediction services, which will dynamically affect toll prices within different contexts. It relies on the adoption of “big data” technologies, to process and store large volumes of data from heterogeneous sources, provided by different highway operators, and is capable of handling real-time and historical data. The DATEX-II data model is adopted, enabling harmonization of traffic data provided by the highway operators.


  1. 1.
    Fiosina, J., Fiosins, M., Müller, J.P.: Big data processing and mining for next generation intelligent transportation systems. Jurnal Teknologi 63(3), 21–38 (2013)Google Scholar
  2. 2.
    Caserta, J., Cordo, E.: Big ETL: The Next ‘Big’ Thing, 9 Feb 2015 [Online].
  3. 3.
    Luckow, A., Kennedy, K., Manhardt, F., Djerekarov, E., Vorster, B., Apon, A.: Automotive big data: applications, workloads and infrastructures. In: IEEE International Conference on Big Data, Santa Clara, CA (2015)Google Scholar
  4. 4.
    Ma, S., Liang, Z.: Design and implementation of smart city big data processing platform based on distributed architecture. In: 10th International Conference on Intelligent Systems and Knowledge Engineering (ISKE), Taipei (2015)Google Scholar
  5. 5.
    OPTIMUM consortium, OPTIMUM Project, 1 Oct 2015 [Online]. [Acedido em 20 April 2016]
  6. 6.
    De Mauro, A., Greco, M., Grimaldi, M.: What is big data? A consensual definition and a review of key research topics. In: proceedings of the 4th International Conference on Integrated Information, Madrid (2015)Google Scholar
  7. 7.
    The Apache Software Foundation, Hadoop (2014) [Online]. [Acedido 2016]Google Scholar
  8. 8.
    The Apache Software Foundation, Apache Spark (2014) [Online].
  9. 9.
    The Apache Software Foundation, Apache Storm (2014) [Online].
  10. 10.
  11. 11.
    The Apache Software Foundation, Apache Cassandra Project (2015) [Online].
  12. 12.
    MongoDB, Inc., MongoDB (2015) [Online].
  13. 13.
    Andersen, O., Krogh, B.B., Torp, K.: An open-source based ITS platform. In: Proceedings of IEEE International Conference on Mobile Data Management, vol. 2, pp. 27–32 (2013)Google Scholar
  14. 14.
    Taneja, M.: A mobility analytics framework for internet of things, pp. 113–118 (2015)Google Scholar
  15. 15.
    EIP/EIP + Project, Datex Easyway (2014) [Online].
  16. 16.
    European Telecommunications Standards Institute (2015) [Online].
  17. 17.
    Freudenstein, J., Cornwell, I.: Tailoring a reference model for C-ITS architectures and using a DATEX II profile to communicate traffic signal information. In: Transport Research Arena, Paris, France (2014)Google Scholar
  18. 18.
    Duperet, A., Damas, C., Scemama, G.: Public authorities support for a large scale data infrastructure for mobility (LaSDIM). In: 22nd ITS World Congress, Bordeaux, France (2015)Google Scholar

Copyright information

© Springer International Publishing AG, part of Springer Nature 2018

Authors and Affiliations

  • Paulo Figueiras
    • 1
  • Guilherme Guerreiro
    • 1
  • Ricardo Silva
    • 1
  • Ruben Costa
    • 1
  • Ricardo Jardim-Gonçalves
    • 1
  1. 1.CTS, UNINOVA, Dep. de Eng.ª EletrotécnicaFaculdade de Ciências e Tecnologia, FCT, Universidade Nova de LisboaCaparicaPortugal

Personalised recommendations