Algorithmic Differentiation of Pragma-Defined Parallel Regions

Differentiating Computer Programs Containing OpenMP

  • Michael Förster

Table of contents

  1. Front Matter
    Pages I-XI
  2. Michael Förster
    Pages 1-59
  3. Michael Förster
    Pages 61-136
  4. Michael Förster
    Pages 137-186
  5. Michael Förster
    Pages 187-268
  6. Michael Förster
    Pages 269-329
  7. Michael Förster
    Pages 331-335
  8. Back Matter
    Pages 337-405

About this book


Numerical programs often use parallel programming techniques such as OpenMP to compute the program's output values as efficient as possible. In addition, derivative values of these output values with respect to certain input values play a crucial role. To achieve code that computes not only the output values simultaneously but also the derivative values, this work introduces several source-to-source transformation rules. These rules are based on a technique called algorithmic differentiation. The main focus of this work lies on the important reverse mode of algorithmic differentiation. The inherent data-flow reversal of the reverse mode must be handled properly during the transformation. The first part of the work examines the transformations in a very general way since pragma-based parallel regions occur in many different kinds such as OpenMP, OpenACC, and Intel Phi. The second part describes the transformation rules of the most important OpenMP constructs.


  • Introduction with Examples from Numerical Optimization
  • Algorithmic Differentiation by Source Transformation
  • Transformation rules for Parallel Code Regions (e.g. OpenMP 3.1)
  • Static Program Analysis

Target Groups

  • Lecturers and students of computer science
  • Computer scientists, engineers, mathematicians and numerical analysts

The Author

Michael Förster is currently Research Associate of the Institute Software and Tools for Computational Engineering, RWTH Aachen University.


Automatic Differentiation Continuous Optimization Intel Phi Numerical programs OpenACC Static Program Analysis

Authors and affiliations

  • Michael Förster
    • 1
  1. 1.LuFG Informatik 12 - STCERWTH Aachen UniversityAachenGermany

Bibliographic information

  • DOI
  • Copyright Information Springer Fachmedien Wiesbaden 2014
  • Publisher Name Springer Vieweg, Wiesbaden
  • eBook Packages Computer Science
  • Print ISBN 978-3-658-07596-5
  • Online ISBN 978-3-658-07597-2
  • Buy this book on publisher's site