Advertisement

Trajectory ETL Modeling

  • Assawer ZekriEmail author
  • Marwa Massaâbi
  • Olfa Layouni
  • Jalel Akaichi
Conference paper
Part of the Smart Innovation, Systems and Technologies book series (SIST, volume 76)

Abstract

Extraction-Transformation-Loading (ETL) tools are pieces of software responsible for the extraction of data from heterogeneous sources, their cleansing, customization and insertion into data warehouse. In fact, ETL are the key component of data warehousing process because incorrect or misleading data will produce wrong business decisions. Therefore, a correct design of the ETL process at early stages of data warehouse project is absolutely necessary to improve data quality. So, it is essential to overcome the ETL modeling phase with elegance in order to produce simple and understandable models. Many researches are dealt with the modeling of ETL process but today with the advent of trajectory data we need interactive modeling that manages the mobility aspect. In this paper, we extend existing model by incorporating a trajectory as a first class concept. So, we propose to model the ETL workflows as directed acyclic graphs that comprise three main components which are: the data sources, all the activities and the data stores.

Keywords

Trajectory data ETL Modeling Graph Activity Moving object 

References

  1. 1.
    Bala, M., Alimazighi, Z.: Modélisation de processus ETL dans un modèle MapReduce. In: Conférence Maghrébine sur les Avancées des Systèmes Décisionnels (ASD 2013), Marrakech, Maroc, pp. 1–12 (2013)Google Scholar
  2. 2.
    El Akkaoui, Z., Zemányi, E.: Defining ETLWorfklows using BPMN and BPEL. In: DOLAP 2009, Hong Kong, China, pp. 41–48 (2009)Google Scholar
  3. 3.
    El Akkaoui, Z., Zimányi, E., Mazón, J.N., Trujillo, J.: A model-driven framework for ETL process development. In: DOLAP 2011, Glasgow, Scotland, UK, pp. 45–52 (2011)Google Scholar
  4. 4.
    Krishna, R., Sreekanth: An object oriented modeling and implementation of web based ETL process. IJCSNS Int. J. Comput. Sci. Netw. Secur. 10(2), 192–196 (2010)Google Scholar
  5. 5.
    Lujan-Mora, S., Trujillo, J.: A UML based approach for modeling ETL processes in data warehouses. In: Song, I.-Y., Liddle, S.W., Ling, T.-W., Scheuermann, P. (eds.) Conceptual Modeling - ER 2003, vol. 2813, pp. 307–320. Springer, Heidelberg (2003)CrossRefGoogle Scholar
  6. 6.
    Lujan-Mora, S., Vassiliadis, P., Trujillo, J.: Data mapping diagrams for data warehouse design with UML. In: Atzeni, P., Chu, W., Lu, H., Zhou, S., Ling, T.-W. (eds.) Conceptual Modeling – ER 2004, vol. 3288, pp. 191–204. Springer, Heidelberg (2004)CrossRefGoogle Scholar
  7. 7.
    Mrunalini, M., Suresh Kumar, T.V., Evangelin Geetha, D., Rajanikanth, K.: Modelling of data extraction in ETL processes using UML 2.0. DESIDOC Bull. Inf. Technol. 26, 3–9 (2006). DESIDOCCrossRefGoogle Scholar
  8. 8.
    Marketos, G.: Datawarehousing and mining techniques for moving object databases. Thesis, Greece (2009)Google Scholar
  9. 9.
    Misra, S., Saha, S.K., Mazumdar, C.: Performance comparison of hadoop based tools with commercial ETL tools – a case study. In: Bhatnagar, V., Srinivasa, S. (eds.) Big Data Analytics (BDA 2013). LNCS, vol. 8302, pp. 176–184. Springer, Cham (2013)CrossRefGoogle Scholar
  10. 10.
    Nabli, A., Bouaziz, S., Yangui, R., Gargouri, F.: Two-ETL phases for data warehouse creation: design and implementation. In: Morzy, T., Valduriez, P., Bellatreche, L. (eds.) Advances in Databases and Information Systems, vol. 9282, pp. 138–150. Springer, Cham (2015)CrossRefGoogle Scholar
  11. 11.
    Simitsis, A.: Mapping conceptual to logical models for ETL processes. In: Proceedings of the 8th ACM International Workshop on Data Warehousing and OLAP, Germany, pp. 67–76 (2005)Google Scholar
  12. 12.
    Simitsis, A., Wilkinson, K., Dayal, U., Castellanos, M.: Leveraging business process models for ETL design. In: Proceedings of the 29th International Conference on Conceptual Modeling, Canada, pp. 15–30 (2010)Google Scholar
  13. 13.
    Vassiliadis, P., Simitsis, A., Skiadopoulos, S.: Conceptual modeling for ETL processes. In: Proceedings of the 5th ACM International Workshop on Data Warehousing and OLAP, USA, pp. 14–21 (2002)Google Scholar
  14. 14.
    Vučković, M., Petrović, M., Turajlić, N., Stanojević, M.: The specification of ETL transformation operations based on weaving models. Int. J. Comput. Commun. Control 7(5), 968–975 (2012)Google Scholar
  15. 15.
    Wagner, R., Macedo, J., Raffaeta, A., Renso, C., Roncato, A., Trasarti, R.: Mob-Warehouse: a semantic approach for mobility analysis with a trajectory data warehouse. In: Parsons, J., Chiu, D. (eds.) Advances in Conceptual Modeling. LNCS, vol. 8697, pp. 127–136. Springer, Cham (2014)Google Scholar
  16. 16.
    Zekri, A., Akaichi, J.: An ETL for integrating trajectory data: a medical delegate activities use case study. In: The International Conference on Automation, Control, Engineering and Computer Science (ACECS 2014), Monastir, Tunisia, pp. 138–147 (2014)Google Scholar

Copyright information

© Springer International Publishing AG 2018

Authors and Affiliations

  • Assawer Zekri
    • 1
    Email author
  • Marwa Massaâbi
    • 1
  • Olfa Layouni
    • 1
  • Jalel Akaichi
    • 2
  1. 1.Computer Science Department, BESTMOD, High Institute of ManagementUniversity of TunisTunisTunisia
  2. 2.College of Computer ScienceKing Khalid UniversityAbhaSaudi Arabia

Personalised recommendations