Skip to main content

Challenges and Decisions in WOBCompute Design, a P2P Computing System Architecture

  • Conference paper
  • First Online:
Evaluation of Novel Approaches to Software Engineering (ENASE 2020)

Abstract

In the field of large-scale computing, Cloud Computing Services gained popularity due to their low cost and availability. Alternatives exist in the form of distributed computing systems, most of which combine existing, cheap, commodity hardware into clusters of computing and storage resources. Most of these implementations are Client-Server model-based. Decentralized solutions employ a form of Peer-to-Peer (P2P) design, however, without major benefits besides the decentralized task coordination, and due to increased design complexity compared to the Client-Server models, these implementations haven’t gained widespread popularity. In this paper, the architecture of WOBCompute is presented, which is P2P based, and features decentralized task coordination, the possibility of workload transfer via checkpoints, and task tracking and location queries with the possibility of messaging between parallel branches of a distributed application. Architecture design considerations and choices are also presented. The overlay of the P2P system is a super-peer driven clusters organized into an extended star topology. Using backup super-peers, and distributing the cluster members between them, the size and stability of the clusters are improved; query and lookup messages are limited to only the super-peers and the topology employed reduces the longest message path. The complexity of the system mandates the use of a middleware, which hides these and provides a simplified interface for a distributed application to take advantage of the computing resources, being a combination of in-house computing devices, personal or volunteer donated resources, as well as Cloud-based VMs.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Akers, S.B., Harel, D., Krishnamurthy, B.: The star graph: an attractive alternative to the n-cube. In: Proceedings of International Conference on Parallel Processing, pp. 393–400 (1987)

    Google Scholar 

  2. Anderson, DP.: Boinc: A system for public-resource computing and storage. In: Proceedings of the 5th IEEE/ACM International Workshop, Pittsburgh, PA, USA, pp. 4–10 (2004). https://doi.org/10.1109/GRID.2004.14

  3. Andrade, N., Cirne, W., Brasileiro, F., Roisenberg, P.: OurGrid: an approach to easily assemble grids with equitable resource sharing. In: Feitelson, D., Rudolph, L., Schwiegelshohn, U. (eds.) JSSPP 2003. LNCS, vol. 2862, pp. 61–86. Springer, Heidelberg (2003). https://doi.org/10.1007/10968987_4

    Chapter  Google Scholar 

  4. Castellà, D., Solsona, F., Giné, F.: DisCoP: a P2P framework for managing and searching computing markets. J. Grid Comput. 13(1), 115–137 (2014). https://doi.org/10.1007/s10723-014-9318-3

    Article  Google Scholar 

  5. Chandra, J., Mitra, B., Ganguly, N.: Effect of constraints on superpeer topologies. In: 2013 Proceedings IEEE INFOCOM, pp. 60–64. IEEE, Turin (2013). https://doi.org/10.1109/INFCOM.2013.6566735

  6. Chmaj, G., Walkowiak, K.: A P2P computing system for overlay networks. Future Gener. Comput. Syst. 29(1), 242–249 (2013). https://doi.org/10.1016/j.future.2010.11.009

    Article  Google Scholar 

  7. CORPORATE The MPI Forum: MPI: a message passing interface. In: Proceedings of the 1993 ACM/IEEE Conference on Supercomputing (Supercomputing 1993), pp. 878–883. Association for Computing Machinery, New York (1993). https://doi.org/10.1145/169627.16985

  8. De, S., Barik, M.S., Banerjee, I.: Goal based threat modeling for peer-to-peer cloud. Proc. Comput. Sci. 89, 64–72 (2016). https://doi.org/10.1016/j.procs.2016.06.010

    Article  Google Scholar 

  9. Filep, L.: Model for improved load balancing in volunteer computing platforms. In: Themistocleous, M., Rupino da Cunha, P. (eds.) EMCIS 2018. LNBIP, vol. 341, pp. 131–143. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-11395-7_13

    Chapter  Google Scholar 

  10. Filep, L.: WOBCompute: architecture and design considerations of a P2P computing system. In: Proceedings of the 15th International Conference on Evaluation of Novel Approaches to Software Engineering - Volume 1: ENASE, pp. 39–49. SciTePress (2020). https://doi.org/10.5220/0009343100390049

  11. Gomathi, S., Manimegalai, D.: Hierarchically distributed peer-to-peer architecture for computational grid. In: 2013 International Conference on Green High Performance Computing (ICGHPC), pp. 1–4. IEEE, Nagercoil (2013). https://doi.org/10.1109/ICGHPC.2013.6533906

  12. Gupta, R., Sekhri, V., Somani, A.: CompuP2P: an architecture for internet computing using peer-to-peer networks. IEEE Trans. Parallel Distrib. Syst. 17(11), 1306–1320 (2006). https://doi.org/10.1109/TPDS.2006.149

    Article  Google Scholar 

  13. Jesi, G.P., Montresor, A., Babaoglu, O.: Proximity-aware superpeer overlay topologies. In: Keller, A., Martin-Flatin, J.-P. (eds.) SelfMan 2006. LNCS, vol. 3996, pp. 43–57. Springer, Heidelberg (2006). https://doi.org/10.1007/11767886_4

    Chapter  Google Scholar 

  14. Lavoie, E., Hendren, L.: Personal volunteer computing. In: Proceedings of the 16th ACM International Conference on Computing Frontiers (CF 2019), New York, NY, USA, pp. 240–246 (2019). https://doi.org/10.1145/3310273.3322819

  15. Mitra, B., Ghose, S., Ganguly, N., Peruani, F.: Stability analysis of peer-to-peer networks against churn. Pramana 71(2), 263–273 (2008). https://doi.org/10.1007/s12043-008-0159-0

    Article  Google Scholar 

  16. Pérez-Miguel, C., Miguel-Alonso, J., Mendiburu, A.: High throughput computing over peer-to-peer networks. Future Gener. Comput. Syst. 29(1), 352–360 (2013). https://doi.org/10.1016/j.future.2011.08.011

    Article  Google Scholar 

  17. Poenaru, A., Istrate, R., Pop, F.: AFT: adaptive and fault tolerant peer-to-peer overlay - a user-centric solution for data sharing. Future Gener. Comput. Syst. 80, 583–595 (2016). https://doi.org/10.1016/j.future.2016.05.022

    Article  Google Scholar 

  18. Qi, X., Qiang, M., Liu, L.: A balanced strategy to improve data invulnerability in structured P2P system. Peer-to-Peer Netw. Appl. 13(1), 368–387 (2019). https://doi.org/10.1007/s12083-019-00773-9

    Article  Google Scholar 

  19. Ratnasamy, S., Francis, P., Handley, M., Karp, R., Shenker, S.: A scalable content-addressable network. SIGCOMM Comput. Commun. Rev. 31(4), 161–172 (2001). https://doi.org/10.1145/964723.383072

    Article  MATH  Google Scholar 

  20. Sacha, J.: Exploiting heterogeneity in peer-to-peer systems using gradient topologies, Doctor of Philosophy (Computer Science) (2009)

    Google Scholar 

  21. Stoica, I., Morris, R., Karger, D., Kaashoek, M.F., Balakrishnan, H.: Chord - a scalable peer-to-peer lookup service for internet applications. SIGCOMM Comput. Commun. Rev. 31(4), 149–160 (2001). https://doi.org/10.1145/964723.383071

    Article  Google Scholar 

  22. Tiburcio, P.G.S., Spohn, M.A.: Ad hoc grid: an adaptive and self-organizing peer-to-peer computing grid. In: 2010 10th IEEE International Conference on Computer and Information Technology, pp. 225–232. IEEE, Bradford (2010). https://doi.org/10.1109/CIT.2010.504

  23. Vimal, S., Srivatsa, S.K.: A file sharing system in peer-to-peer network by a nearness-sensible method. Int. J. Reason.-Based Intell. Syst. (IJRIS) 11(4) (2019). https://doi.org/10.1504/IJRIS.2019.103510

  24. Yang, B., Garcia-Molina, H.: Designing a super-peer network. In: Proceedings 19th International Conference on Data Engineering, pp. 49–60. IEEE, Bangalore (2003). https://doi.org/10.1109/icde.2003.1260781

  25. Ye, F., Zuo, F., Zhang, S.: Routing algorithm based on Gnutella model. In: Cai, Z., Li, Z., Kang, Z., Liu, Y. (eds.) ISICA 2009. CCIS, vol. 51, pp. 9–15. Springer, Heidelberg (2009). https://doi.org/10.1007/978-3-642-04962-0_2

    Chapter  Google Scholar 

  26. Zhao, H., Huang, L., Stribling, R., Rhea, S.C., Joseph, A.D., Kubiatowicz, J.D.: Tapestry - a resilient global-scale overlay for service deployment. IEEE J. Sel. Areas Commun. 22, 41–53 (2004). https://doi.org/10.1109/JSAC.2003.818784

    Article  Google Scholar 

  27. zlib Library. http://zlib.net/index.html. Accessed 25 Aug 2020

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Levente Filep .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Filep, L. (2021). Challenges and Decisions in WOBCompute Design, a P2P Computing System Architecture. In: Ali, R., Kaindl, H., Maciaszek, L.A. (eds) Evaluation of Novel Approaches to Software Engineering. ENASE 2020. Communications in Computer and Information Science, vol 1375. Springer, Cham. https://doi.org/10.1007/978-3-030-70006-5_6

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-70006-5_6

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-70005-8

  • Online ISBN: 978-3-030-70006-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics