Skip to main content
  • Book
  • © 2021

Principles of High-Performance Processor Design

For High Performance Computing, Deep Neural Networks and Data Science

  • This book gives a new view on how the processors for HPC, AI and Data Science should be designed. Traditional approaches are, even when called "quantitative", evolutionary, in the sense that the starting point is the existing software optimized to existing processors. In this book, first the applications are classified into several categories, so that their requirements can be summarized. Then the concept of the efficiency is introduced as the guiding principle for the processor design

  • The efficiency is simply defined as the fraction of electricity (and also silicon die area) used in the combinatorial logics for arithmetic operations. In many of modern processors, efficiencies in this sense are surprisingly low, implying that there is huge room of improvements. Also, writing application software for these modern processors has become very difficult

  • In this book, examples of designs with very high efficiency are presented, with the overview on how the application software can be developed, based on the author's experience on the development of SIMD parallel processors

Buying options

eBook USD 149.00
Price excludes VAT (USA)
  • ISBN: 978-3-030-76871-3
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
Softcover Book USD 199.99
Price excludes VAT (USA)
Hardcover Book USD 199.99
Price excludes VAT (USA)

This is a preview of subscription content, access via your institution.

Table of contents (7 chapters)

  1. Front Matter

    Pages i-xiv
  2. Introduction

    • Junichiro Makino
    Pages 1-5
  3. Traditional Approaches and Their Limitations

    • Junichiro Makino
    Pages 7-35
  4. The Lower Limit of Energy Consumption

    • Junichiro Makino
    Pages 37-63
  5. Analysis of Past and Present Processors

    • Junichiro Makino
    Pages 65-94
  6. “Near-Optimal” Designs

    • Junichiro Makino
    Pages 95-134
  7. Software

    • Junichiro Makino
    Pages 135-145
  8. Present, Past and Future

    • Junichiro Makino
    Pages 147-155
  9. Back Matter

    Pages 157-160

About this book

This book describes how we can design and make efficient processors for high-performance computing, AI, and data science. Although there are many textbooks on the design of processors we do not have a widely accepted definition of the efficiency of a general-purpose computer architecture. Without a definition of the efficiency, it is difficult to make scientific approach to the processor design. In this book, a clear definition of efficiency is given and thus a scientific approach for processor design is made possible. 

In chapter 2, the history of the development of high-performance processor is overviewed, to discuss what quantity we can use to measure the efficiency of these processors. The proposed quantity is  the ratio between the minimum possible energy consumption and the actual energy consumption for a given application using a given semiconductor technology. In chapter 3, whether or not this quantity can be used in practice is discussed, for many real-world applications. 

In chapter 4, general-purpose processors in the past and present are discussed from this viewpoint. In chapter 5, how we can actually design processors with near-optimal efficiencies is described, and in chapter 6 how we can program such processors.  This book gives a new way to look at the field of the design of high-performance processors.

Keywords

  • Computer Architecture
  • Accelerator
  • Heterogeneous Multicore Processors
  • High-Performance Computing
  • Parallel Computing
  • Machine Learning
  • Deep Neural Networks
  • Energy Efficiency
  • Finite Difference Method
  • Particle-Based Method

Authors and Affiliations

  • Kobe University, Kobe, Japan

    Junichiro Makino

About the author

Junichiro Makino received PhD from the University of Tokyo. After he received PhD, he worked at University of Tokyo, the National Astronomical Observatory of Japan, and Tokyo Institute of Technology. Since Apr 2014, he is a subleader of the exascale computing project and the team leader of the Co-design team, AICS, RIKEN, and since Mar 2016 he works also at Kobe University. His research interests are stellar dynamics, large-scale scientific simulation and high-performance computing.

He has developed a series of special-purpose computers for many-body problems (GRAPE) and SIMD many-core processors (GRAPE-DR, MN-Core).

Bibliographic Information

  • Book Title: Principles of High-Performance Processor Design

  • Book Subtitle: For High Performance Computing, Deep Neural Networks and Data Science

  • Authors: Junichiro Makino

  • DOI: https://doi.org/10.1007/978-3-030-76871-3

  • Publisher: Springer Cham

  • eBook Packages: Computer Science, Computer Science (R0)

  • Copyright Information: Springer Nature Switzerland AG 2021

  • Hardcover ISBN: 978-3-030-76870-6

  • Softcover ISBN: 978-3-030-76873-7

  • eBook ISBN: 978-3-030-76871-3

  • Edition Number: 1

  • Number of Pages: XIV, 160

  • Number of Illustrations: 19 b/w illustrations, 8 illustrations in colour

  • Topics: Processor Architectures, System Performance and Evaluation, Theory of Computation

Buying options

eBook USD 149.00
Price excludes VAT (USA)
  • ISBN: 978-3-030-76871-3
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
Softcover Book USD 199.99
Price excludes VAT (USA)
Hardcover Book USD 199.99
Price excludes VAT (USA)