Abstract

The value of a benchmark metric is directly related to how relevant it is to the consumer.

The inclusion of a price/performance metric and an availability date metric in TPC benchmarks has provided added value to consumers since the first TPC benchmark was introduced in 1989. However, over time the relative value of these metrics has diminished – both because the base price of hardware and software comprises a smaller fraction of the total cost of ownership (TCO) and because TPC pricing requirements have not kept pace with changes in the industry. This paper aims to

  • Highlight the strengths provided by including price/performance and availability metrics in benchmarks.

  • Identify areas where the relative value of these metrics has diminished, over time.

  • Propose enhancements that could return them to provide high value to the consumer.

Many of the ideas in this paper are a result of nearly a decade of discussions with many benchmark experts. It would be difficult to identify an originator for each specific suggestion. However, it is nearly certain that this is the first comprehensive list where this collection of ideas is presented.

Keywords

Price/Performance TCO Total Cost of Ownership Benchmark TPC 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Shanley, K.: History and Overview of the TPC (February 1998), http://www.tpc.org/information/about/history.asp
  2. 2.
    United States Internal Revenue Service, Instructions for Form 4562 (2009), http://www.irs.gov/pub/irs-pdf/i4562.pdf
  3. 3.
    Transaction Processing Performance Council, TPC-Energy Specification (2010), http://www.tpc.org/tpc_energy/default.asp2009
  4. 4.
    Vielra, M., Madiera, H.: From Performance to Dependability Benchmarking: A Mandatory Path. Springer, Heidelberg, ISDN 0302-9743 (Print) 1611-3349 (Online)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2011

Authors and Affiliations

  • Karl Huppler
    • 1
  1. 1.IBM MS XQKRochesterUSA

Personalised recommendations