Advertisement

BPMN-Based Conceptual Modeling of ETL Processes

  • Zineb El Akkaoui
  • José-Norberto Mazón
  • Alejandro Vaisman
  • Esteban Zimányi
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7448)

Abstract

Business Intelligence (BI) solutions require the design and implementation of complex processes (denoted ETL) that extract, transform, and load data from the sources to a common repository. New applications, like for example, real-time data warehousing, require agile and flexible tools that allow BI users to take timely decisions based on extremely up-to-date data. This calls for new ETL tools able to adapt to constant changes and quickly produce and modify executable code. A way to achieve this is to make ETL processes become aware of the business processes in the organization, in order to easily identify which data are required, and when and how to load them in the data warehouse. Therefore, we propose to model ETL processes using the standard representation mechanism denoted BPMN (Business Process Modeling and Notation). In this paper we present a BPMN-based metamodel for conceptual modeling of ETL processes. This metamodel is based on a classification of ETL objects resulting from a study of the most used commercial and open source ETL tools.

Keywords

Business Process Data Warehouse Object Constraint Language Business Intelligence Aggregation Task 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Deutch, D., Milo, T.: A quest for beauty and wealth (or, business processes for database researchers). In: Proceedings of PODS 2011, pp. 1–12 (2011)Google Scholar
  2. 2.
    El Akkaoui, Z., Zimányi, E.: Defining ETL worfklows using BPMN and BPEL. In: Proceedings of DOLAP 2009, pp. 41–48 (2009)Google Scholar
  3. 3.
    El Akkaoui, Z., Zimányi, E., Mazón, J.N., Trujillo, J.: A model-driven framework for ETL process development. In: Proceedings of DOLAP 2011, pp. 45–52 (2011)Google Scholar
  4. 4.
    Muñoz, L., Mazón, J.N., Trujillo, J.: Automatic generation of ETL processes from conceptual models. In: Proceedings of DOLAP 2009, pp. 33–40 (2009)Google Scholar
  5. 5.
    Muñoz, L., Mazón, J.-N., Pardillo, J., Trujillo, J.: Modelling ETL Processes of Data Warehouses with UML Activity Diagrams. In: Meersman, R., Tari, Z., Herrero, P. (eds.) OTM-WS 2008. LNCS, vol. 5333, pp. 44–53. Springer, Heidelberg (2008)CrossRefGoogle Scholar
  6. 6.
    Papastefanatos, G., Vassiliadis, P., Simitsis, A., Sellis, T., Vassiliou, Y.: Rule-Based Management of Schema Changes at ETL Sources. In: Grundspenkis, J., Kirikova, M., Manolopoulos, Y., Novickis, L. (eds.) ADBIS 2009. LNCS, vol. 5968, pp. 55–62. Springer, Heidelberg (2010)CrossRefGoogle Scholar
  7. 7.
    Simitsis, A.: Mapping conceptual to logical models for ETL processes. In: Proceedings of DOLAP 2005, pp. 67–76 (2005)Google Scholar
  8. 8.
    Simitsis, A., Vassiliadis, P.: A methodology for the conceptual modeling of ETL processes. In: Proceedings of CAiSE 2003, CEUR Workshop Proceedings (2003)Google Scholar
  9. 9.
    Simitsis, A., Vassiliadis, P.: A method for the mapping of conceptual designs to logical blueprints for ETL processes. Decision Support System 45(1), 22–40 (2008)CrossRefGoogle Scholar
  10. 10.
    Thomsen, C., Pedersen, T.B.: pygrametl: a powerful programming framework for extract-transform-load programmers. In: Proceedings of DOLAP 2009, pp. 49–56 (2009)Google Scholar
  11. 11.
    Thomsen, C.: Pedersen T. B, and W. Lehner. Rite: Providing on-demand data for right-time data warehousing. In: ICDE, pp. 456–465. IEEE (2008)Google Scholar
  12. 12.
    Trujillo, J., Luján-Mora, S.: A UML Based Approach for Modeling ETL Processes in Data Warehouses. In: Song, I.-Y., Liddle, S.W., Ling, T.-W., Scheuermann, P. (eds.) ER 2003. LNCS, vol. 2813, pp. 307–320. Springer, Heidelberg (2003)CrossRefGoogle Scholar
  13. 13.
    Vassiliadis, P., Simitsis, A., Baikous, E.: A taxonomy of ETL activities. In: Proceedings of DOLAP 2009, pp. 25–32 (2009)Google Scholar
  14. 14.
    Vassiliadis, P., Simitsis, A., Georgantas, P., Terrovitis, M., Skiadopoulos, S.: A generic and customizable framework for the design of ETL scenarios. Information Systems 30(7), 492–525 (2005)CrossRefGoogle Scholar
  15. 15.
    Wyatt, L., Caufield, B., Pol, D.: Principles for an ETL Benchmark. In: Nambiar, R., Poess, M. (eds.) TPCTC 2009. LNCS, vol. 5895, pp. 183–198. Springer, Heidelberg (2009)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2012

Authors and Affiliations

  • Zineb El Akkaoui
    • 1
  • José-Norberto Mazón
    • 2
  • Alejandro Vaisman
    • 1
  • Esteban Zimányi
    • 1
  1. 1.Department of Computer and Decision Engineering (CoDE)Université Libre de BruxellesBrusselsBelgium
  2. 2.Department of Software and Computing Systems (WaKe)Universidad de AlicanteAlicanteSpain

Personalised recommendations