Skip to main content
SpringerLink
Log in

Experiments Using a Software-Distributed Shared Memory, MPI and 0MQ over Heterogeneous Computing Resources

  • Conference paper
  • First Online:
Euro-Par 2020: Parallel Processing Workshops (Euro-Par 2020)

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 12480))

Included in the following conference series:

  • 792 Accesses

Abstract

Distributed heterogeneous computing systems escalate the problem of choosing the appropriate programming model. Programming models such as message passing are efficient but require low-level management of communications. Higher level of programming such as shared memory are convenient for the application design but they usually have performance issues. With the recent development of distributed heterogeneous systems and new protocols to access remote memories, there is an opportunity for distributed shared memory systems to offer a satisfying level of abstraction while not giving up on performance. In this paper a video processing application is written using MPI, 0MQ and an in-house software-distributed shared memory (S-DSM) backend and deployed over a set of heterogeneous computing boards. Results show that 0MQ implementation is the most efficient but at the price of writing the application with the targeted platform in mind. The S-DSM implementation runs up to 2 times faster than the pure OpenMPI implementation and competes with 0MQ when the data granularity is small.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Amza, C., et al.: TreadMarks: shared memory computing on networks of workstations. IEEE Comput. 29(2), 18–28 (1996)

    Article  Google Scholar 

  2. Bader, D., Jaja, J.: Simple: a methodology for programming high-performance algorithms on clusters of symmetric multiprocessors (SMPS). J. Parallel Distrib. Comput. 58, 92–108 (1999). https://doi.org/10.1006/jpdc.1999.1541

    Article  Google Scholar 

  3. Cudennec, L.: Software-distributed shared memory over heterogeneous micro-server architecture. In: Heras, D.B., Bougé, L. (eds.) Euro-Par 2017. LNCS, vol. 10659, pp. 366–377. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-75178-8_30

    Chapter  Google Scholar 

  4. Cudennec, L.: Merging the publish-subscribe pattern with the shared memory paradigm. In: Mencagli, G., et al. (eds.) Euro-Par 2018. LNCS, vol. 11339, pp. 469–480. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-10549-5_37

    Chapter  Google Scholar 

  5. Dragojevic, A., Narayanan, D., Hodson, O., Castro, M.: FaRM: fast remote memory. In: Proceedings of the 11th USENIX Conference on Networked Systems Design and Implementation, pp. 401–414 (2014). https://doi.org/10.5555/2616448.2616486

  6. Gelado, I., Stone, J.E., Cabezas, J., Patel, S., Navarro, N., Hwu, W.M.W.: An asymmetric distributed shared memory model for heterogeneous parallel systems. In: Proceedings of the Fifteenth Edition of ASPLOS on Architectural Support for Programming Languages and Operating Systems, ASPLOS XV, ACM, New York, NY, USA, pp. 347–358 (2010)

    Google Scholar 

  7. Ghane, M., Chandrasekaran, S., Cheung, M.S.: Towards a portable hierarchical view of distributed shared memory systems: challenges and solutions. In: Proceedings of the 11th International Workshop on Programming Models and Applications for Multicores and Manycores. PMAM 2020 (2020)

    Google Scholar 

  8. Jegou, Y.: Implementation of page management in MOME, a user-level DSM. In: CCGrid 2003, 3rd IEEE/ACM International Symposium on Cluster Computing and the Grid, pp. 479–486 (2003). https://doi.org/10.1109/CCGRID.2003.1199404

  9. Kaxiras, S., Klaftenegger, D., Norgren, M., Ros, A., Sagonas, K.: Turning centralized coherence and distributed critical-section execution on their head: a new approach for scalable distributed shared memory. In: Proceedings of the 24th International Symposium on High-Performance Parallel and Distributed Computing, pp. 3–14 (2015)

    Google Scholar 

  10. Keleher, P.: CVM: The coherent virtual machine TR93-215 (1995)

    Google Scholar 

  11. Kise, K., Katagiri, T., Honda, H., Yuba, T.: Evaluation of the acknowledgment reduction in a software-DSM system. In: Proceedings of the 6th International Conference on parallel Processing and Applied Mathematics, pp. 17–25 (2005)

    Google Scholar 

  12. Li, K.: IVY: a shared virtual memory system for parallel computing. In: Proceedings 1988 International Conference on Parallel Processing, pp. 94–101. University Park, PA, USA, August 1988

    Google Scholar 

  13. Mitchell, C., Geng, Y., Li, J.: Using one-sided RDMA reads to build a fast, CPU-efficient key-value store. In: Proceedings of the 2013 USENIX Conference on Annual Technical Conference, pp. 103–114 (2013). https://doi.org/10.5555/2535461.2535475

  14. Nelson, J., et al.: Latency-tolerant software distributed shared memory. In: 2015 USENIX Annual Technical Conference (USENIX ATC 2015), pp. 291–305. USENIX Association, Santa Clara, CA (2015)

    Google Scholar 

  15. Oleksiak, A., et al.: M2DC - modular microserver datacentre with heterogeneous hardware. In: Microprocessors and Microsystems, vol. 52, pp. 117–130 (2017). https://doi.org/10.1016/j.micpro.2017.05.019

  16. Ross, J.A., Richie, D.A.: Implementing openshmem for the adapteva epiphany risc array processor. In: Procedia Computer Science, International Conference on Computational Science, ICCS 2016, San Diego, California, USA, vol. 80, pp. 2353–2356, 6–8 June 2016

    Google Scholar 

  17. Scales, D.J., Gharachorloo, K.: Towards transparent and efficient software distributed shared memory. ACM SIGOPS Oper. Syst. Rev. 31(5), 157–169 (1997). https://doi.org/10.1145/269005.266673

  18. Dimakopoulos, V.V., Hadjidoukas, P.E.: HOMPI: a hybrid programming framework for expressing and deploying task-based parallelism, pp. 14–26 (2011)

    Google Scholar 

  19. Werstein, P., Pethick, M., Huang, Z.: A performance comparison of DSM, PVM and MPI, pp. 476–482 (2003). https://doi.org/10.1109/PDCAT.2003.1236348

Download references

Acknowledgments

This work has received funding from the European Union’s Horizon 2020 research and innovation action under grant agreement No 688201.

Author information

Authors and Affiliations

  1. CEA, LIST, PC 172, 91191, Gif-sur-Yvette, France

    Loïc Cudennec & Kods Trabelsi

  2. Department of Artificial Intelligence, DGA MI, BP 7, 35998, Rennes Armées, France

    Loïc Cudennec

Authors
  1. Loïc Cudennec
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Kods Trabelsi
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Loïc Cudennec .

Editor information

Editors and Affiliations

  1. AGH University of Science and Technology, Krakow, Poland

    Bartosz Balis

  2. CiTIUS, Santiago de Compostela, Spain

    Dora B. Heras

  3. ICAR-CNR, Naples, Italy

    Laura Antonelli

  4. University of Stirling, Stirling, UK

    Andrea Bracciali

  5. Friedrich-Alexander-Universität, Erlangen, Germany

    Thomas Gruber

  6. Konkuk University, Seoul, Korea (Republic of)

    Jin Hyun-Wook

  7. Otto von Guericke University Magdeburg, Magdeburg, Germany

    Michael Kuhn

  8. Tennessee Tech University, Cookeville, TN, USA

    Stephen L. Scott

  9. Koç University, Istanbul, Turkey

    Didem Unat

  10. Czestochowa University of Technology, Czestochowa, Poland

    Roman Wyrzykowski

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Cudennec, L., Trabelsi, K. (2021). Experiments Using a Software-Distributed Shared Memory, MPI and 0MQ over Heterogeneous Computing Resources. In: Balis, B., et al. Euro-Par 2020: Parallel Processing Workshops. Euro-Par 2020. Lecture Notes in Computer Science(), vol 12480. Springer, Cham. https://doi.org/10.1007/978-3-030-71593-9_19

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-71593-9_19

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-71592-2

  • Online ISBN: 978-3-030-71593-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation