FlexBench: A Flexible XML Query Benchmark

  • Maroš Vranec
  • Irena Mlýnková
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5463)


In this paper we propose a new approach to XML benchmarking – a flexible XML query benchmark called FlexBench. The flexibility is given by two aspects. Firstly, FlexBench involves a large set of testing data characteristics so that a user can precisely describe the application. And, secondly, FlexBench is able to adapt the set of testing query templates to the particular set of synthesized testing data. Hence, contrary to the existing works, the testing is not limited by the fixed set of queries and basic data characteristics (usually only size) to a single (and often simple) application. We depict the advantages of the proposed system using a set of preliminary experiments.


Total Execution Time Text Query XPath Query Query Template Heap Space 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Qexo – The GNU Kawa implementation of XQuery. Kawa (2007),
  2. 2.
    eXist-db: Open Source Native XML Database. (2008),
  3. 3.
    Qizx/db. Pixware (2008),
  4. 4.
    Saxon: The XSLT and XQuery Processor. (2008),
  5. 5.
    Afanasiev, L., Marx, M.: An Analysis of the Current XQuery Benchmarks. In: ExpDB 2006: Proc. of the 1st Int. Workshop on Performance and Evaluation of Data Management Systems, Chicago, Illinois, USA, pp. 9–20. ACM, New York (2006)Google Scholar
  6. 6.
    Berglund, A., Boag, S., Chamberlin, D., Fernndez, M.F., Kay, M., Robie, J., Simeon, J.: XML Path Language (XPath) 2.0. W3C (January 2007)Google Scholar
  7. 7.
    Biron, P.V., Malhotra, A.: XML Schema Part 2: Datatypes, 2nd edn. W3C (October 2004)Google Scholar
  8. 8.
    Boag, S., Chamberlin, D., Fernndez, M.F., Florescu, D., Robie, J., Simeon, J.: XQuery 1.0: An XML Query Language. W3C (January 2007)Google Scholar
  9. 9.
    Bohme, T., Rahm, E.: Benchmarking XML Database Systems - First Experiences. In: HPTS 2001: Proc. of 9th Int. Workshop on High Performance Transaction Systems, Pacific Grove, California (2001)Google Scholar
  10. 10.
    Bohme, T., Rahm, E.: XMach-1: A Benchmark for XML Data Management. Database Group Leipzig (2002),
  11. 11.
    Bray, T., Paoli, J., Sperberg-McQueen, C.M., Maler, E., Yergeau, F.: Extensible Markup Language (XML) 1.0, 4th edn. W3C (September 2006)Google Scholar
  12. 12.
    Bressan, S., Li Lee, M., Li, Y.G., Lacroix, Z., Nambiar, U.: The XOO7 benchmark. In: Bressan, S., Chaudhri, A.B., Li Lee, M., Yu, J.X., Lacroix, Z. (eds.) CAiSE 2002 and VLDB 2002. LNCS, vol. 2590, pp. 146–147. Springer, Heidelberg (2003)CrossRefGoogle Scholar
  13. 13.
    Busse, R., Carey, M., Florescu, D., Kersten, M., Manolescu, I., Schmidt, A., Waas, F.: XMark – An XML Benchmark Project. Centrum voor Wiskunde en Informatica (CWI), Amsterdam (2003),
  14. 14.
    Clark, J., DeRose, S.: XML Path Language (XPath) Version 1.0. W3C (November 1999)Google Scholar
  15. 15.
    Dvorakova, J., Zavoral, F.: Using Input Buffers for Streaming XSLT Processing. In: GlobeNet/DB 2009: Proc. of the 1st Int. Conf. on Advances in Databases, Guadeloupe, French Caribbean. IEEE, Los Alamitos (2009)Google Scholar
  16. 16.
    Runapongsa, K., et al.: The Michigan Benchmark. Department of Electrical Engineering and Computer Science, The University of Michigan (2006),
  17. 17.
    Bressan, S., et al.: The XOO7 Benchmark (2002),
  18. 18.
    Franceschet, M.: XPathMark. University of Udine, Italy (2005),
  19. 19.
    Mlynkova, I.: An Analysis of Approaches to XML Schema Inference. In: SITIS 2008: Proc. of the 4th Int. Conf. on Signal-Image Technology and Internet-Based Systems, Bali, Indonesia. IEEE, Los Alamitos (2008)Google Scholar
  20. 20.
    Mlynkova, I., Toman, K., Pokorny, J.: Statistical Analysis of Real XML Data Collections. In: COMAD 2006: Proc. of the 13th Int. Conf. on Management of Data, New Delhi, India, pp. 20–31. Tata McGraw-Hill Publishing Ltd., New York (2006)Google Scholar
  21. 21.
    Nicola, M., Kogan, I., Raghu, R., Gonzalez, A., Liu, M., Schiefer, B., Xie, G.: Transaction Processing over XML (TPoX),
  22. 22.
    Thompson, H.S., Beech, D., Maloney, M., Mendelsohn, N.: XML Schema Part 1: Structures, 2nd edn. W3C (October 2004)Google Scholar
  23. 23.
    Vranec, M., Mlynkova, I.: FlexBench: A Flexible XML Query Benchmark (September 2008),
  24. 24.
    Yao, B.B., Ozsu, M.T.: XBench – A Family of Benchmarks for XML DBMSs. University of Waterloo, School of Computer Science, Database Research Group (2003),

Copyright information

© Springer-Verlag Berlin Heidelberg 2009

Authors and Affiliations

  • Maroš Vranec
    • 1
  • Irena Mlýnková
    • 1
  1. 1.Department of Software EngineeringCharles University in PragueCzech Republic

Personalised recommendations