Advertisement

HetroOMP: OpenMP for Hybrid Load Balancing Across Heterogeneous Processors

  • Vivek KumarEmail author
  • Abhiprayah Tiwari
  • Gaurav Mitra
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11718)

Abstract

The OpenMP accelerator model enables an efficient method of offloading computation from host CPU cores to accelerator devices. However, it leaves it up to the programmer to try and utilize CPU cores while offloading computation to an accelerator. In this paper, we propose HetroOMP, an extension of the OpenMP accelerator model that supports a new clause hetro which enables computation to execute simultaneously across both host and accelerator devices using standard tasking and work-sharing pragmas.

To illustrate our proposal for a hybrid execution model, we implemented a proof-of-concept work-stealing HetroOMP runtime for the heterogeneous TI Keystone-II MPSoC. This MPSoC has host ARM CPU cores alongside accelerator Digital Signal Processor (DSP) cores. We present the design and implementation of the HetroOMP runtime and use several well-known benchmarks to demonstrate that HetroOMP achieves a geometric mean speedup of 3.6\(\times \) compared to merely using the OpenMP accelerator model.

Keywords

OpenMP accelerator model Heterogeneous architectures Hybrid work-stealing 

Notes

Acknowledgments

We are grateful to the anonymous reviewers for their suggestions on improving the presentation of the paper, and to Eric Stotzer from Texas Instruments for shipping a brand new TI Keystone-II MPSoC to IIIT Delhi.

References

  1. 1.
    Clang LibTooling, April 2019. https://clang.llvm.org/docs/LibTooling.html
  2. 2.
    OpenMP API, version 4.5, March 2018. http://www.openmp.org/wp-content/uploads/openmp-4.5.pdf
  3. 3.
    Acar, U.A., Chargueraud, A., Rainey, M.: Scheduling parallel programs by work stealing with private deques. In: PPoPP, pp. 219–228 (2013).  https://doi.org/10.1145/2442516.2442538
  4. 4.
    Aguilar, M.A., Leupers, R., Ascheid, G., Murillo, L.G.: Automatic parallelization and accelerator offloading for embedded applications on heterogeneous MPSoCs. In: DAC, pp. 49:1–49:6 (2016).  https://doi.org/10.1145/2897937.2897991
  5. 5.
    Barik, R., Farooqui, N., Lewis, B.T., Hu, C., Shpeisman, T.: A black-box approach to energy-aware scheduling on integrated CPU-GPU systems. In: CGO, pp. 70–81 (2016).  https://doi.org/10.1145/2854038.2854052
  6. 6.
    Blumofe, R.D., Leiserson, C.E.: Scheduling multithreaded computations by work stealing. J. ACM 46 (1999).  https://doi.org/10.1145/324133.324234MathSciNetCrossRefGoogle Scholar
  7. 7.
    Chapman, B., Huang, L., Biscondi, E., Stotzer, E., Shrivastava, A., Gatherer, A.: Implementing OpenMP on a high performance embedded multicore MPSoC. In: IPDPS, pp. 1–8 (2009).  https://doi.org/10.1109/IPDPS.2009.5161107
  8. 8.
    Charles, P., Grothoff, C., Saraswat, V., et al.: X10: an object-oriented approach to non-uniform cluster computing. In: OOPSLA, pp. 519–538 (2005).  https://doi.org/10.1145/1094811.1094852
  9. 9.
    Che, S., Boyer, M., Meng, J., Tarjan, D., Sheaffer, J.W., Lee, S.H., Skadron, K.: Rodinia: a benchmark suite for heterogeneous computing. In: IISWC, pp. 44–54 (2009).  https://doi.org/10.1109/IISWC.2009.5306797
  10. 10.
    Duran, A., Ayguadé, E., Badia, R.M., Labarta, J., Martinell, L., Martorell, X., Planas, J.: OmpSs: a proposal for programming heterogeneous multi-core architectures. Parallel Process. Lett. 21(02), 173–193 (2011).  https://doi.org/10.1142/S0129626411000151MathSciNetCrossRefGoogle Scholar
  11. 11.
    Frigo, M., Leiserson, C.E., Randall, K.H.: The implementation of the Cilk-5 multithreaded language. In: PLDI, pp. 212–223 (1998)Google Scholar
  12. 12.
    Grossman, M., Shirako, J., Sarkar, V.: OpenMP as a high-level specification language for parallelism. In: IWOMP, pp. 141–155 (2016).  https://doi.org/10.1007/978-3-319-45550-1_11CrossRefGoogle Scholar
  13. 13.
    Kumar, V., Sbîrlea, A., Jayaraj, A., Budimlić, Z., Majeti, D., Sarkar, V.: Heterogeneous work-stealing across CPU and DSP cores. In: HPEC, pp. 1–6 (2015).  https://doi.org/10.1109/HPEC.2015.7322452
  14. 14.
    Kumar, V., Zheng, Y., Cavé, V., Budimlić, Z., Sarkar, V.: HabaneroUPC++: a compiler-free PGAS library. In: PGAS 2014 (2014).  https://doi.org/10.1145/2676870.2676879
  15. 15.
    Linderman, M.D., Collins, J.D., Wang, H., Meng, T.H.: Merge: a programming model for heterogeneous multi-core systems. In: Proceedings of the 13th International Conference on Architectural Support for Programming Languages and Operating Systems, pp. 287–296. ASPLOS (2008).  https://doi.org/10.1145/1346281.1346318
  16. 16.
    Luk, C.K., Hong, S., Kim, H.: Qilin: exploiting parallelism on heterogeneous multiprocessors with adaptive mapping. In: MICRO, pp. 45–55 (2009).  https://doi.org/10.1145/1669112.1669121
  17. 17.
    Mitra, G., Bohmann, J., Lintault, I., Rendell, A.P.: Development and application of a hybrid programming environment on an ARM/DSP system for high performance computing. In: IPDPS, pp. 286–295 (2018).  https://doi.org/10.1109/IPDPS.2018.00038
  18. 18.
    Mitra, G., Stotzer, E., Jayaraj, A., Rendell, A.P.: Implementation and optimization of the OpenMP accelerator model for the TI Keystone II architecture. In: Using and Improving OpenMP for Devices, Tasks, and More, pp. 202–214 (2014).  https://doi.org/10.1007/978-3-319-11454-5_15CrossRefGoogle Scholar
  19. 19.
    Munshi, A.: The OpenCL specification. In: IEEE Hot Chips, pp. 1–314 (2009)Google Scholar
  20. 20.
    Compute Unified Device Architecture Programming Guide, April 2019Google Scholar
  21. 21.
    ORNL: Summit supercomputer. https://www.olcf.ornl.gov/summit/. Accessed April 2019
  22. 22.
    Planas, J., Badia, R.M., Ayguadé, E., Labarta, J.: Hierarchical task-based programming with StarSs. IJHPCA 23(3), 284–299 (2009).  https://doi.org/10.1177/1094342009106195CrossRefGoogle Scholar
  23. 23.
    Sbîrlea, A., Zou, Y., Budimlíc, Z., Cong, J., Sarkar, V.: Mapping a data-flow programming model onto heterogeneous platforms. LCTES 47, 61–70 (2012).  https://doi.org/10.1145/2248418.2248428CrossRefGoogle Scholar
  24. 24.
    Texas Instruments: C66AK2H multicore DSP+ARM Keystone II System-On-Chip. Texas Instruments Literature: SPRS866Google Scholar
  25. 25.
  26. 26.
    Wienke, S., Springer, P., Terboven, C., an Mey, D.: OpenACC first experiences with real-world applications, pp. 859–870. EuroPar (2012).  https://doi.org/10.1007/978-3-642-32820-6_85CrossRefGoogle Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  1. 1.IIIT-DelhiNew DelhiIndia
  2. 2.Texas InstrumentsHoustonUSA

Personalised recommendations