Advertisement

Principles for an ETL Benchmark

  • Len Wyatt
  • Brian Caufield
  • Daniel Pol
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5895)

Abstract

Conditions in the marketplace for ETL tools suggest that an industry standard benchmark is needed. The benchmark should provide useful data for comparing the performance of ETL systems, be based on a meaningful scenario, and be scalable over a wide range of data set sizes. This paper gives a general scoping of the proposed benchmark and outlines some key decision points. The Transaction Processing Performance Council (TPC) has formed a development subcommittee to define and produce such a benchmark.

Keywords

ETL ELT extract transform load data integration TPC benchmark database data warehouse performance transformations reliability metric 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
  2. 2.
  3. 3.
    Kimball, R., Caserta, J.: The Data Warehouse ETL Toolkit. Wiley, Chichester (2004)Google Scholar
  4. 4.
  5. 5.
  6. 6.
  7. 7.
  8. 8.
  9. 9.
  10. 10.
  11. 11.
  12. 12.
  13. 13.
  14. 14.
  15. 15.
  16. 16.
  17. 17.
    Transaction Processing Performance Council, http://tpc.org/tpce/
  18. 18.
    IBM Corporation, IBM InfoSphere Change Data Capture, http://www-01.ibm.com/software/data/infosphere/change-data-capture/
  19. 19.
    Oracle Corporation, Asynchronous Change Data Capture Cookbook, http://www.oracle.com/technology/products/bi/db/10g/pdf/twp_cdc_cookbook_0206.pdf
  20. 20.
    Microsoft Corporation, Change Data Capture, http://msdn.microsoft.com/en-us/library/bb522489.aspx
  21. 21.
    Kimball, R.: A Dimensional Modeling Manifesto, http://www.dbmsmag.com/9708d15.html
  22. 22.
    Transaction Processing Performance Council, http://www.tpc.org/tpcc/default.asp
  23. 23.
    Transaction Processing Performance Council, http://www.tpc.org/tpch/default.asp
  24. 24.
    Transaction Processing Performance Council, http://www.tpc.org/tpcds/The_Making_of_TPCDS.pdf
  25. 25.
    Transaction Processing Performance Council, http://www.tpc.org/pricing/default.asp
  26. 26.
    Transaction Processing Performance Council, http://www.tpc.org/information/TPC-PR-Webcast-Energy.wmv

Copyright information

© Springer-Verlag Berlin Heidelberg 2009

Authors and Affiliations

  • Len Wyatt
    • 1
  • Brian Caufield
    • 2
  • Daniel Pol
    • 3
  1. 1.Microsoft CorporationRedmondUSA
  2. 2.IBM CorporationSan JoseUSA
  3. 3.Hewlett-Packard CompanyHoustonUSA

Personalised recommendations