Abstract
In the field of large-scale computing, Cloud Computing Services gained popularity due to their low cost and availability. Alternatives exist in the form of distributed computing systems, most of which combine existing, cheap, commodity hardware into clusters of computing and storage resources. Most of these implementations are Client-Server model-based. Decentralized solutions employ a form of Peer-to-Peer (P2P) design, however, without major benefits besides the decentralized task coordination, and due to increased design complexity compared to the Client-Server models, these implementations haven’t gained widespread popularity. In this paper, the architecture of WOBCompute is presented, which is P2P based, and features decentralized task coordination, the possibility of workload transfer via checkpoints, and task tracking and location queries with the possibility of messaging between parallel branches of a distributed application. Architecture design considerations and choices are also presented. The overlay of the P2P system is a super-peer driven clusters organized into an extended star topology. Using backup super-peers, and distributing the cluster members between them, the size and stability of the clusters are improved; query and lookup messages are limited to only the super-peers and the topology employed reduces the longest message path. The complexity of the system mandates the use of a middleware, which hides these and provides a simplified interface for a distributed application to take advantage of the computing resources, being a combination of in-house computing devices, personal or volunteer donated resources, as well as Cloud-based VMs.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Akers, S.B., Harel, D., Krishnamurthy, B.: The star graph: an attractive alternative to the n-cube. In: Proceedings of International Conference on Parallel Processing, pp. 393–400 (1987)
Anderson, DP.: Boinc: A system for public-resource computing and storage. In: Proceedings of the 5th IEEE/ACM International Workshop, Pittsburgh, PA, USA, pp. 4–10 (2004). https://doi.org/10.1109/GRID.2004.14
Andrade, N., Cirne, W., Brasileiro, F., Roisenberg, P.: OurGrid: an approach to easily assemble grids with equitable resource sharing. In: Feitelson, D., Rudolph, L., Schwiegelshohn, U. (eds.) JSSPP 2003. LNCS, vol. 2862, pp. 61–86. Springer, Heidelberg (2003). https://doi.org/10.1007/10968987_4
Castellà, D., Solsona, F., Giné, F.: DisCoP: a P2P framework for managing and searching computing markets. J. Grid Comput. 13(1), 115–137 (2014). https://doi.org/10.1007/s10723-014-9318-3
Chandra, J., Mitra, B., Ganguly, N.: Effect of constraints on superpeer topologies. In: 2013 Proceedings IEEE INFOCOM, pp. 60–64. IEEE, Turin (2013). https://doi.org/10.1109/INFCOM.2013.6566735
Chmaj, G., Walkowiak, K.: A P2P computing system for overlay networks. Future Gener. Comput. Syst. 29(1), 242–249 (2013). https://doi.org/10.1016/j.future.2010.11.009
CORPORATE The MPI Forum: MPI: a message passing interface. In: Proceedings of the 1993 ACM/IEEE Conference on Supercomputing (Supercomputing 1993), pp. 878–883. Association for Computing Machinery, New York (1993). https://doi.org/10.1145/169627.16985
De, S., Barik, M.S., Banerjee, I.: Goal based threat modeling for peer-to-peer cloud. Proc. Comput. Sci. 89, 64–72 (2016). https://doi.org/10.1016/j.procs.2016.06.010
Filep, L.: Model for improved load balancing in volunteer computing platforms. In: Themistocleous, M., Rupino da Cunha, P. (eds.) EMCIS 2018. LNBIP, vol. 341, pp. 131–143. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-11395-7_13
Filep, L.: WOBCompute: architecture and design considerations of a P2P computing system. In: Proceedings of the 15th International Conference on Evaluation of Novel Approaches to Software Engineering - Volume 1: ENASE, pp. 39–49. SciTePress (2020). https://doi.org/10.5220/0009343100390049
Gomathi, S., Manimegalai, D.: Hierarchically distributed peer-to-peer architecture for computational grid. In: 2013 International Conference on Green High Performance Computing (ICGHPC), pp. 1–4. IEEE, Nagercoil (2013). https://doi.org/10.1109/ICGHPC.2013.6533906
Gupta, R., Sekhri, V., Somani, A.: CompuP2P: an architecture for internet computing using peer-to-peer networks. IEEE Trans. Parallel Distrib. Syst. 17(11), 1306–1320 (2006). https://doi.org/10.1109/TPDS.2006.149
Jesi, G.P., Montresor, A., Babaoglu, O.: Proximity-aware superpeer overlay topologies. In: Keller, A., Martin-Flatin, J.-P. (eds.) SelfMan 2006. LNCS, vol. 3996, pp. 43–57. Springer, Heidelberg (2006). https://doi.org/10.1007/11767886_4
Lavoie, E., Hendren, L.: Personal volunteer computing. In: Proceedings of the 16th ACM International Conference on Computing Frontiers (CF 2019), New York, NY, USA, pp. 240–246 (2019). https://doi.org/10.1145/3310273.3322819
Mitra, B., Ghose, S., Ganguly, N., Peruani, F.: Stability analysis of peer-to-peer networks against churn. Pramana 71(2), 263–273 (2008). https://doi.org/10.1007/s12043-008-0159-0
Pérez-Miguel, C., Miguel-Alonso, J., Mendiburu, A.: High throughput computing over peer-to-peer networks. Future Gener. Comput. Syst. 29(1), 352–360 (2013). https://doi.org/10.1016/j.future.2011.08.011
Poenaru, A., Istrate, R., Pop, F.: AFT: adaptive and fault tolerant peer-to-peer overlay - a user-centric solution for data sharing. Future Gener. Comput. Syst. 80, 583–595 (2016). https://doi.org/10.1016/j.future.2016.05.022
Qi, X., Qiang, M., Liu, L.: A balanced strategy to improve data invulnerability in structured P2P system. Peer-to-Peer Netw. Appl. 13(1), 368–387 (2019). https://doi.org/10.1007/s12083-019-00773-9
Ratnasamy, S., Francis, P., Handley, M., Karp, R., Shenker, S.: A scalable content-addressable network. SIGCOMM Comput. Commun. Rev. 31(4), 161–172 (2001). https://doi.org/10.1145/964723.383072
Sacha, J.: Exploiting heterogeneity in peer-to-peer systems using gradient topologies, Doctor of Philosophy (Computer Science) (2009)
Stoica, I., Morris, R., Karger, D., Kaashoek, M.F., Balakrishnan, H.: Chord - a scalable peer-to-peer lookup service for internet applications. SIGCOMM Comput. Commun. Rev. 31(4), 149–160 (2001). https://doi.org/10.1145/964723.383071
Tiburcio, P.G.S., Spohn, M.A.: Ad hoc grid: an adaptive and self-organizing peer-to-peer computing grid. In: 2010 10th IEEE International Conference on Computer and Information Technology, pp. 225–232. IEEE, Bradford (2010). https://doi.org/10.1109/CIT.2010.504
Vimal, S., Srivatsa, S.K.: A file sharing system in peer-to-peer network by a nearness-sensible method. Int. J. Reason.-Based Intell. Syst. (IJRIS) 11(4) (2019). https://doi.org/10.1504/IJRIS.2019.103510
Yang, B., Garcia-Molina, H.: Designing a super-peer network. In: Proceedings 19th International Conference on Data Engineering, pp. 49–60. IEEE, Bangalore (2003). https://doi.org/10.1109/icde.2003.1260781
Ye, F., Zuo, F., Zhang, S.: Routing algorithm based on Gnutella model. In: Cai, Z., Li, Z., Kang, Z., Liu, Y. (eds.) ISICA 2009. CCIS, vol. 51, pp. 9–15. Springer, Heidelberg (2009). https://doi.org/10.1007/978-3-642-04962-0_2
Zhao, H., Huang, L., Stribling, R., Rhea, S.C., Joseph, A.D., Kubiatowicz, J.D.: Tapestry - a resilient global-scale overlay for service deployment. IEEE J. Sel. Areas Commun. 22, 41–53 (2004). https://doi.org/10.1109/JSAC.2003.818784
zlib Library. http://zlib.net/index.html. Accessed 25 Aug 2020
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Filep, L. (2021). Challenges and Decisions in WOBCompute Design, a P2P Computing System Architecture. In: Ali, R., Kaindl, H., Maciaszek, L.A. (eds) Evaluation of Novel Approaches to Software Engineering. ENASE 2020. Communications in Computer and Information Science, vol 1375. Springer, Cham. https://doi.org/10.1007/978-3-030-70006-5_6
Download citation
DOI: https://doi.org/10.1007/978-3-030-70006-5_6
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-70005-8
Online ISBN: 978-3-030-70006-5
eBook Packages: Computer ScienceComputer Science (R0)