Skip to main content
  • Reference work
  • © 2011

Encyclopedia of Parallel Computing


  • Over 400 entries covering key concepts and terms in the broad field of parallel computing

  • A-Z organization allows easy, intuitive access for professionals and researchers in various aspects of computing

  • Extensive cross-references support efficient, user-friendly searches

  • All entries have been written and peer-reviewed by international leading researchers

  • Broad cover of topic for easy application of topics in related CS areas

  • Includes supplementary material:

Buying options

eBook USD 1,600.00
Price excludes VAT (USA)
  • ISBN: 978-0-387-09766-4
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
Hardcover Book USD 1,799.99
Price excludes VAT (USA)

This is a preview of subscription content, access via your institution.

Table of contents (796 entries)

  1. Front Matter

    Pages i-xxxiv
  2. A

    1. Access Anomaly

      Pages 1-1
    2. Actors

      • Rajesh K. Karmani, Gul Agha
      Pages 1-11
    3. Affinity Scheduling

      • Mark S. Squillante
      Pages 11-16
    4. AKS Network

      • Joel Seiferas
      Pages 16-23
    5. AKS Sorting Network

      Pages 23-23
    6. Algebraic Multigrid

      • Marian Brezina, Jonathan Hu, Ray Tuminaro
      Pages 23-33
    7. Algorithm Engineering

      • Peter Sanders
      Pages 33-38
    8. Algorithmic Skeletons

      Pages 38-38
    9. All Prefix Sums

      Pages 38-38
    10. Allgather

      • Jesper Larsson Träffe, Robert A. van de Geijn
      Pages 39-42
    11. All-to-All

      • Jesper Larsson Träff, Robert A. vande Geijn
      Pages 42-47
    12. All-to-All Broadcast

      Pages 47-47
    13. Altivec

      Pages 47-47
    14. AMD Opteron Processor Barcelona

      • MS Benjamin Sander
      Pages 47-52
    15. Amdahl’s Argument

      Pages 52-52
    16. Amdahl’s Law

      • John L. Gustafson
      Pages 53-60

About this book

Containing over 300 entries in an A-Z format, the Encyclopedia of Parallel Computing provides easy, intuitive access to relevant information for professionals and researchers seeking access to any aspect within the broad field of parallel computing. Topics for this comprehensive reference were selected, written, and peer-reviewed by an international pool of distinguished researchers in the field.  The Encyclopedia is broad in scope, covering machine organization, programming languages, algorithms, and applications.  Within each area, concepts, designs, and specific implementations are presented.  The highly-structured essays in this work comprise synonyms, a definition and discussion of the topic, bibliographies, and links to related literature. Extensive cross-references to other entries within the Encyclopedia support efficient, user-friendly searchers for immediate access to useful information.

 Key concepts presented in the Encyclopedia of Parallel Computing include; laws and metrics; specific numerical and non-numerical algorithms; asynchronous algorithms; libraries of subroutines; benchmark suites;  applications; sequential consistency and cache coherency; machine classes such as clusters, shared-memory multiprocessors, special-purpose machines and dataflow machines; specific machines such as Cray supercomputers, IBM’s cell processor and Intel’s multicore machines; race detection and auto parallelization; parallel programming languages, synchronization primitives, collective operations, message passing libraries, checkpointing, and operating systems. 

 Topics covered: Speedup, Efficiency, Isoefficiency, Redundancy, Amdahls law, Computer Architecture Concepts, Parallel Machine Designs, Benmarks, Parallel Programming concepts & design, Algorithms, Parallel applications.

 This authoritative reference will be published in two formats: print and online.  The online edition features hyperlinks to cross-references and to additional significant research.

 Related Subjects:  supercomputing, high-performance computing, distributed computing


  • (parallel) benchmark suites
  • (parallel) Numeric algorithms
  • (parallel) algorithms
  • (parallel) computer architecture
  • (parallel) performance laws
  • (parallel) program performance metrics
  • (parallel) program tuning
  • (parallel) programming languages
  • PGAS languages
  • applications of parallel computing
  • autoparallelization
  • collective operations
  • compilers for parallelism
  • determinacy
  • exascale computing
  • high-performance computing
  • inter-processor communication networks
  • interconnection networks
  • manycores
  • multicores
  • race detection
  • supercomputing
  • synchronization
  • theory of parallel computing

Editors and Affiliations

  • University of Illinois at Urbana-Champaign, Urbana, USA

    David Padua

About the editor

David Padua is the Donald Biggar Willett Professor of Computer Science at the University of Illinois. His research interests include compiler and languages for parallel computing, race detection, compilation of dynamic languages, and autotuning techniques. He is author or co-author of more than 150 papers in these areas. At Illinois, he has taught courses on compilers and parallel programming and supervised 25 PhD Dissertations.  He has served his university and the computer science community as vice-chair of the College of Engineering Executive Committee, chair of the steering committee for the Symposia on Principles and Practices of Parallel Programming (PPoPP), and editorial board member of the Journal of Parallel programming, the Journal of Parallel and Distributed Computing, the IEEE transactions of Parallel and Distributed Processing, and the ACM Transactions on Programming Languages and Systems. He is a fellow of the IEEE and the ACM.

Bibliographic Information

Buying options

eBook USD 1,600.00
Price excludes VAT (USA)
  • ISBN: 978-0-387-09766-4
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
Hardcover Book USD 1,799.99
Price excludes VAT (USA)