Encyclopedia of Database Systems

2018 Edition
| Editors: Ling Liu, M. Tamer Özsu


  • Richard T. SnodgrassEmail author
  • Stephen W. Thomas
  • Rui Zhang
Reference work entry
DOI: https://doi.org/10.1007/978-1-4614-8265-9_80779


Benchmark; Benchmark framework; tBench; Temporal benchmark


τ Bench [14] is a benchmark framework consisting of ten individual benchmarks, spanning XML, XQuery, XML Schema, and PSM, along with temporal extensions to each, realized by iteratively changing one individual benchmark into another, by modifying the data format, adding schema constraints, or instantiating a different workload.

Historical Background

A benchmark is a collection of data, workload, and metrics. Individual benchmarks allow applications and algorithms to be compared and evaluated in a standard, consistent setting, giving researchers and practitioners invaluable guidance as to the relative performance of the systems under consideration [8]. A benchmark may include a data model, a data definition language, a schema, data, a data manipulation language, a workload, metrics, context, documentation, and tools.

A benchmark familyis a set of loosely related benchmarks. A benchmark family is often...

This is a preview of subscription content, log in to check access.

Recommended Reading

  1. 1.
    Barbosa D, Mendelzon A, Keenleyside J, Lyons K. ToXgene: a template-based data generator for XML. In: Proceedings of the International Conference on Management of Data; 2002. p. 616.Google Scholar
  2. 2.
    Böhlen MH, Jensen CS, Snodgrass RT. Temporal statement modifiers. ACM Trans Database Syst. 2000;25(4):407–56.zbMATHCrossRefGoogle Scholar
  3. 3.
    Cordy J, Halpern-Hamu C, Promislow E. TXL: a rapid prototyping system for programming language dialects. Comput Lang. 1991;16(1): 97–107.CrossRefGoogle Scholar
  4. 4.
    Currim F, Currim S, Dyreson CE, Snodgrass RT. A tale of two schemas: creating a temporal XML schema from a snapshot schema with τXSchema. In: Proceedings of the 9th International Conference on Extending Database Technology; 2004. p. 348–65CrossRefGoogle Scholar
  5. 5.
    Currim F, Currim S, Dyreson C, Snodgrass RT, Thomas SW, Zhang R. Adding temporal constraints to XML schema. IEEE Trans Knowl Data Eng. 2012;24(8):1361–77.CrossRefGoogle Scholar
  6. 6.
    Date C, Darwen H. A guide to the SQL standard. New York: Addison-Wesley; 1987.Google Scholar
  7. 7.
    Gao D, Snodgrass RT. Temporal slicing in the evaluation of XML queries. In: Proceedings of the 29th International Conference on Very Large Data Bases; 2003. p. 632–43.CrossRefGoogle Scholar
  8. 8.
    Gray J, editor. The benchmark handbook for database and transaction systems. 2nd ed. San Mateo: Morgan Kaufmann; 1993.zbMATHGoogle Scholar
  9. 9.
    INEX. Initiative for the evaluation of XML retrieval. https://inex.mmci.uni-saarland.de/. Viewed 14 July 2011.
  10. 10.
    Melton J. Understanding SQL’s stored procedures: a complete guide to SQL/PSM. San Francisco: Morgan Kaufmann Publishers; 1998.zbMATHGoogle Scholar
  11. 11.
    Shanmugasundaram J, Shekita E, Kiernan J, Krishnamurthy R, Viglas E, Naughton J, Tatarinov I. A general technique for querying XML documents using a relational database system. SIGMOD Rec. 2001;30(3):20–6.CrossRefGoogle Scholar
  12. 12.
    Snodgrass RT, Dyreson C, Currim F, Currim S, Joshi S. Validating quicksand: temporal schema versioning in τXSchema. Data Knowl Eng. 2008;65(2):223–42.CrossRefGoogle Scholar
  13. 13.
    Snodgrass RT, Gao D, Zhang R, Thomas SW. Temporal support for persistent stored modules. In: Proceedings of the 28th International Conference on Data Engineering; 2012.Google Scholar
  14. 14.
    Thomas SW, Snodgrass RT, Zhang R. Benchmark Frameworks and τBench. Softw Pract Exp. 2014;44(9):1047–75.CrossRefGoogle Scholar
  15. 15.
    Yao B, Özsu M, Khandelwal N. XBench benchmark and performance testing of XML DBMSs. In: Proceedings of the 20th International Conference on Data Engineering; 2004. p. 621–32.Google Scholar

Copyright information

© Springer Science+Business Media, LLC, part of Springer Nature 2018

Authors and Affiliations

  • Richard T. Snodgrass
    • 1
    • 4
    Email author
  • Stephen W. Thomas
    • 2
  • Rui Zhang
    • 3
    • 4
    • 5
  1. 1.Department of Computer ScienceUniversity of ArizonaTucsonUSA
  2. 2.Dataware VenturesKingstonCanada
  3. 3.University of MelbourneMelbourneAustralia
  4. 4.Dataware VenturesTucsonUSA
  5. 5.Dataware VenturesRedondo BeachUSA