Adaptive Implementation Selection in the SkePU Skeleton Programming Library

  • Usman Dastgeer
  • Lu Li
  • Christoph Kessler
Conference paper

DOI: 10.1007/978-3-642-45293-2_13

Part of the Lecture Notes in Computer Science book series (LNCS, volume 8299)
Cite this paper as:
Dastgeer U., Li L., Kessler C. (2013) Adaptive Implementation Selection in the SkePU Skeleton Programming Library. In: Wu C., Cohen A. (eds) Advanced Parallel Processing Technologies. APPT 2013. Lecture Notes in Computer Science, vol 8299. Springer, Berlin, Heidelberg

Abstract

In earlier work, we have developed the SkePU skeleton programming library for modern multicore systems equipped with one or more programmable GPUs. The library internally provides four types of implementations (implementation variants) for each skeleton: serial C++, OpenMP, CUDA and OpenCL targeting either CPU or GPU execution respectively. Deciding which implementation would run faster for a given skeleton call depends upon the computation, problem size(s), system architecture and data locality.

In this paper, we present our work on automatic selection between these implementation variants by an offline machine learning method which generates a compact decision tree with low training overhead. The proposed selection mechanism is flexible yet high-level allowing a skeleton programmer to control different training choices at a higher abstraction level. We have evaluated our optimization strategy with 9 applications/kernels ported to our skeleton library and achieve on average more than 94% (90%) accuracy with just 0.53% (0.58%) training space exploration on two systems. Moreover, we discuss one application scenario where local optimization considering a single skeleton call can prove sub-optimal, and propose a heuristic for bulk implementation selection considering more than one skeleton call to address such application scenarios.

Keywords

Skeleton programming GPU programming implementation selection adaptive offline learning automated performance tuning 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Copyright information

© Springer-Verlag Berlin Heidelberg 2013

Authors and Affiliations

  • Usman Dastgeer
    • 1
  • Lu Li
    • 1
  • Christoph Kessler
    • 1
  1. 1.IDALinköping UniversityLinköpingSweden

Personalised recommendations