Skip to main content
Book cover

Encyclopedia of Parallel Computing pp 1886–1893Cite as

SPEC Benchmarks

  • Reference work entry

  • 125 Accesses

Synonyms

SPEC HPC96; SPEC HPC2002; SPEC MPI2007; SPEC OMP2001

Definition

Application-based Benchmarks measure the performance of computer systems by running a set of applications with a well defined configuration and workload.

Discussion

Introduction

The Standard Performance Evaluation Corporation (SPEC [Product and service names mentioned herein may be the trademarks of their respective owners]) is an organization for creating industry-standard benchmarks to measure various aspects of modern computer system performance. SPEC was founded in 1988. In January 1994, the High-Performance Group of the Standard Performance Evaluation Corporation (SPEC HPG) was founded with the mission to establish, maintain, and endorse a suite of benchmarks representative of real-world, high-performance computing applications. Several efforts joined forces to form SPEC HPG and to initiate a new benchmarking venture that is supported broadly. Founding partners included the member organizations of SPEC,...

This is a preview of subscription content, access via your institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • DOI: 10.1007/978-0-387-09766-4_370
  • Chapter length: 8 pages
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
eBook
USD   1,600.00
Price excludes VAT (USA)
  • ISBN: 978-0-387-09766-4
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
Hardcover Book
USD   1,799.99
Price excludes VAT (USA)
Learn about institutional subscriptions

Bibliography

  1. ASCI-Purple home page (2003) http://asc.llnl.gov/computing_resources/purple/archive/benchmarks

  2. ASCI-Sequoia home page. https://asc.llnl.gov/sequoia/benchmarks.

  3. Aslot V, Domeika M, Eigenmann R, Gaertner G, Jones WB, Parady B (2001) SPEComp: a new benchmark suite for measuring parallel computer performance. In: Eigenmann R, Voss MJ (eds) WOMPAT’01: workshop on openmp applications and tools. LNCS, vol 2104. Springer, Heidelberg, pp 1–10

    Google Scholar 

  4. Aslot V, Eigenmann R (2001) Performance characteristics of the SPEC OMP2001 benchmarks. In: 3rd European workshop on OpenMP, EWOMP’01, Barcelona, Spain, September 2001

    Google Scholar 

  5. Bailey D, Harris T, Saphir W, van der Wijngaart R, Woo A, Yarrow M (1995) The NAS parallel benchmarks 2.0. Technical report NAS-95-020, NASA Ames Research Center, Moffett Field, CA. http://www.nas.nasa.gov/Software/NPB

  6. Berry M, Chen D, Koss P, Kuck D, Lo S, Pang Y, Pointer, Rolo R, Sameh A, Clementi E, Chin S, Schneider D, Fox G, Messina P, Walker D, Hsiung C, Schwarzmeier J, Lue K, Orszag S, Seidl F, Johnson O, Goodrum R, Martin J (1989) The perfect club benchmarks: effective performance evaluation of supercomputers. Int J High Perform Comp Appl 3(3):5–40

    Google Scholar 

  7. DEISA benchmark suite home page. http://www.deisa.eu/science/benchmarking

  8. Dongarra J, Luszczek P (2005) Introduction to the hpcchallenge benchmark suite. ICL technical report ICL-UT-05-01, ICL 2005

    Google Scholar 

  9. Eigenmann R, Hassanzadeh S (1996) Benchmarking with real industrial applications: the SPEC high-performance group. IEEE Comp Sci & Eng 3(1):18–23

    Google Scholar 

  10. Eigenmann R, Gaertner G, Jones W (2002) SPEC HPC2002: the next high-performance computer benchmark. In: Lecture notes in computer science, vol 2327. Springer, Heidelberg, pp 7–10

    Google Scholar 

  11. Iwashita H, Yamanaka E, Sueyasu N, van Waveren M, Miura K (2001) The SPEC OMP 2001 benchmark on the Fujitsu PRIMEPOWER system. In: 3rd European workshop on OpenMP, EWOMP’01, Barcelona, Spain, September 2001

    Google Scholar 

  12. Müller MS, Kalyanasundaram K, Gaertner G, Jones W, Eigenmann R, Lieberman R, van Waveren M, Whitney B (2004) SPEC HPG benchmarks for high performance systems. Int J High Perform Comp Netw 1(4):162–170

    Google Scholar 

  13. Müuller MS, van Waveren M, Lieberman R, Whitney B, Saito H, Kumaran K, Baron J, Brantley WC, Parrott C, Elken T, Feng H, Ponder C (2010) SPEC MPI2007 – an application benchmark suite for parallel systems using MPI. Concurrency Computat: Pract Exper 22(2):191–205

    Google Scholar 

  14. Saito H, Gaertner G, Jones W, Eigenmann R, Iwashita H, Lieberman R, van Waveren M, Whitney B (2002) Large system performance of SPEC OMP2001 benchmarks. In: Zima HP, Joe K, Sata M, Seo Y, Shimasaki M (eds) High performance computing, 4th international symposium, ISHPC 2002. Lecture notes in computer science, vol 2327. Springer, Heidelberg, pp 370–379

    Google Scholar 

  15. Szebenyi Z, Wylie BJN, Wolf F (2008) SCALASCA parallel performance analyses of SPEC MPI2007 applications. In: Proceedings of the 1st SPEC international performance evaluation workshop (SIPEW). LNCS, vol 5119. Springer, Heidelberg, pp 99–123

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Center for Information Services and High Performance Computing, ZIH, Technische Universität Dresden, Dresden, Germany

    Matthias Müller Dr., Brian Whitney, Robert Henschel & Kalyan Kumaran Dr.

Authors
  1. Matthias Müller Dr.
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Brian Whitney
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Robert Henschel
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Kalyan Kumaran Dr.
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. University of Illinois at Urbana-Champaign, Urbana, IL, USA

    David Padua

Rights and permissions

Reprints and Permissions

Copyright information

© 2011 Springer Science+Business Media, LLC

About this entry

Cite this entry

Müller, M., Whitney, B., Henschel, R., Kumaran, K. (2011). SPEC Benchmarks. In: Padua, D. (eds) Encyclopedia of Parallel Computing. Springer, Boston, MA. https://doi.org/10.1007/978-0-387-09766-4_370

Download citation