Skip to main content
SpringerLink
Log in

ExaFlooding RD: A Mathematical Model to Support Unstructured Resource Discovery in Distributed Exascale Computing Environments

  • Published:
Journal of Grid Computing Aims and scope Submit manuscript

Abstract

The unstructured resource discovery has capabilities that can be used as a mechanism for creating a responsive structure and scalability in Distributed Exascale Systems for managing dynamic and interactive events. This paper introduces the ExaFlooding RD framework that can manage and control dynamic and interactive events affecting the functionality of the resource discovery in addition to activities related to unstructured resource discovery. For this purpose, while analyzing the functionality function of the unstructured resource discovery and defining the concept of request in the mentioned element, the concept of request in Distributed Exascale Systems has been redefined. Defining the functionality function of the unstructured resource discovery and redefining the concept of request as the pivotal element of the unstructured resource discovery makes it possible to define the elements of the ExaFlooding RD framework and the functionality of this framework. By using the concept of reviewing the status of executing system activities, the requesting process, and dynamic and interactive events, this framework manages resource discovery activities. Our examination indicates that this framework can manage 60% of D&I events without any dependency on the computing system performing resource discovery activities.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Khaneghah, E.M., Sharifi, M.: AMRC: an algebraic model for reconfiguration of high performance cluster computing systems at runtime. J. Supercomput. 67(1), 1–30 (2014)

    Article  Google Scholar 

  2. Adibi, E., Khaneghah, E.M.: Challenges of resource discovery to support distributed exascale computing environment. Azerbaijan Journal of High Performance Computing. 1(2), 168–178 (2018)

    Article  Google Scholar 

  3. Bidhendi, Z.E., Fakhri, P., Khaneghah, E.M.: Challenges of using unstructured P2P systems to support distributed Exascale computing. Azerbaijan Journal of High Performance Computing. 2(1), 3–6 (2019)

    Article  Google Scholar 

  4. Khaneghah, E. M., et al.: "Challenges of Load Balancing to Support Distributed Exascale Computing Environment." Proceedings of the International Conference on Parallel and Distributed Processing Techniques and Applications (PDPTA). The Steering Committee of The World Congress in Computer Science, Computer Engineering and Applied Computing (WorldComp), (2018)

  5. Burness, A.-L., et al.: Scalability evaluation of a distributed agent system. Distrib. Syst. Eng. 6.4, 129 (1999)

    Article  Google Scholar 

  6. Jogalekar, P., Woodside, M.: Evaluating the scalability of distributed systems. IEEE Trans. Parallel Distrib. Syst. 11(6), 589–603 (2000)

    Article  Google Scholar 

  7. Liu, X., Wang, S., Ji, H.: Double-layer P2P networks supporting semantic search and keeping scalability. Int. J. Commun. Syst. 27(12), 3956–3970 (2014)

    Article  Google Scholar 

  8. Senthuran, A., Hettiarachchi, S.: A review of dynamic scalability and dynamic scheduling in cloud-native distributed stream processing systems. ICDSMLA. 2020, 1539–1553 (2019)

    Google Scholar 

  9. Kafhali, E., Said, et al.: Dynamic scalability model for containerized cloud services. Arab. J. Sci. Eng. 45(12), 10693–10708 (2020)

    Article  Google Scholar 

  10. Silberschatz, A., Galvin, P.B., Gagne, G.: Operating System Concepts Essentials. Wiley, Hoboken (2014)

    Google Scholar 

  11. Mousavi Khaneghah, E., Mirtaheri, S.L., Sharifi, M., Minaei Bidgoli, B.: Modeling and analysis of access transparency and scalability in p2p distributed systems. Int. J. Commun. Syst. 27(10), 2190–2214 (2014)

    Article  Google Scholar 

  12. Khaneghah, E.M., et al.: The influence of exascale on resource discovery and defining an indicator. Azerbaijan Journal of High Performance Computing. 1(1), 3–19 (2018)

    Article  Google Scholar 

  13. Navimipour, N.J., et al.: Resource discovery mechanisms in grid systems: a survey. J. Netw. Comput. Appl. 41, 389–410 (2014)

    Article  Google Scholar 

  14. Bo, Jin. "Flooding-Based Resource Locating in Peer-to-Peer Networks." Electronics and Signal Processing. Springer, Berlin, Heidelberg, 2011. 671–678

  15. Thampi, S. M.: "Survey of search and replication schemes in unstructured p2p networks." arXiv preprint arXiv:1008.1629 (2010)

  16. Khatibi, E., Sharifi, M.: Resource discovery mechanisms in pure unstructured peer-to-peer systems: a comprehensive survey. Peer-to-Peer Networking and Applications, 1–18 (2020)

  17. Khatibi, E., et al.: "Dynamic multilevel feedback-based searching strategy in unstructured peer-to-peer systems." 2012 IEEE International Conference on Green Computing and Communications. IEEE, (2012)

  18. Saeedvand, S., Aghdasi, H.S., Khanli, L.M.: Novel distributed dynamic backbone-based flooding in unstructured networks. Peer-to-Peer Networking and Applications. 13(3), 872–889 (2020)

    Article  Google Scholar 

  19. Bashmal, L., Almulifi, A., Kurdi, H.: Hybrid resource discovery algorithms for unstructured peer-to-peer networks. Procedia Computer Science. 109, 289–296 (2017)

    Article  Google Scholar 

  20. Trunfio, P., Talia, D., Papadakis, H., Fragopoulou, P., Mordacchini, M., Pennanen, M., Popov, K., Vlassov, V., Haridi, S.: Peer-to-peer resource discovery in grids: models and systems. Futur. Gener. Comput. Syst. 23(7), 864–878 (2007)

    Article  Google Scholar 

  21. Adibi, E., Khaneghah, E. M.: "ExaRD: introducing a framework for empowerment of resource discovery to support distributed exascale computing systems with high consistency." Cluster Computing. 23(4), 3349-3369 (2020)

  22. Sharifi, M., Mirtaheri, S.L., Khaneghah, E.M.: A dynamic framework for integrated management of all types of resources in P2P systems. J. Supercomput. 52(2), 149–170 (2010)

    Article  Google Scholar 

  23. Schmid, S., Wattenhofer, R.: Structuring Unstructured Peer-to-Peer Networks. International Conference on High-Performance Computing, Springer, Berlin, Heidelberg (2007)

    Book  Google Scholar 

  24. Ferretti, S.: "A general framework to analyze the fault-tolerance of unstructured P2P systems." 2010 Fourth UKSim European Symposium on Computer Modeling and Simulation. IEEE, (2010)

  25. Oliveira, R., Bernardo, L., Pinto, P.: "Flooding techniques for resource discovery on high mobility MANETs." Workshop on Wireless Ad-hoc Networks. (2005)

  26. Adibi, E., Khaneghah, E.M.: A mathematical model to describe resource discovery failure in distributed exascale computing systems. Peer-to-Peer Networking and Applications. 14(3), 1021–1043 (2021)

    Article  Google Scholar 

  27. Basukoski, A., et al.: Design and Implementation of a Hybrid P2P-Based Grid Resource Discovery System, pp. 119–128. Making Grids Work. Springer, Boston, MA (2008)

    Google Scholar 

  28. Alowayyed, S., Groen, D., Coveney, P.V., Hoekstra, A.G.: Multiscale computing in the exascale era. J. Computational Sci. 22, 15–25 (2017)

    Article  Google Scholar 

  29. Xiang, Q., Tony Wang, X., Jensen Zhang, J., Newman, H., Richard Yang, Y., Jace Liu, Y.: Unicorn: unified resource orchestration for multi-domain, geo-distributed data analytics. Futur. Gener. Comput. Syst. 93, 188–197 (2019)

    Article  Google Scholar 

  30. Zarrin, J., Aguiar, R. L., Barraca, J. P.. "Decentralized Resource Discovery and Management for Future Manycore Systems." arXiv preprint arXiv:1710.03649 (2017)

  31. Khaneghah, E. M.: "PMamut: Runtime flexible resource management framework in scalable distributed system based on nature of request, demand and supply and federalism." U.S. Patent No. 9,613,312. 4 Apr. (2017)

  32. Mirtaheri, S.L., et al.: Four-dimensional model for describing the status of peers in peer-to-peer distributed systems. Turk. J. Electr. Eng. Comput. Sci. 21(6), 1646–1664 (2013)

    Google Scholar 

  33. Dueck, D.: Affinity Propagation: Clustering Data by Passing Messages. University of Toronto, Toronto (2009)

    Google Scholar 

  34. Gu, R., Becchi, M: "A comparative study of parallel programming frameworks for distributed GPU applications." Proceedings of the 16th ACM International Conference on Computing Frontiers. (2019)

  35. Xu, W., Liu, P., Cheng, L., Zhou, Y., Xia, Q., Gong, Y., Liu, Y.: Multi-step wind speed prediction by combining a WRF simulation and an error correction strategy. Renew. Energy. 163, 772–782 (2021)

    Article  Google Scholar 

  36. Allen, G., Angulo, D., Foster, I., Lanfermann, G., Liu, C., Radke, T., Seidel, E., Shalf, J.: The Cactus worm: experiments with dynamic resource discovery and allocation in a grid environment. The Int J High Performance Computing Appl. 15(4), 345–358 (2001)

    Article  Google Scholar 

Download references

“Data sharing does not apply to this article as no datasets were generated or analyzed during the current study.”

Author information

Authors and Affiliations

  1. Department of Computer Engineering, Faculty of Engineering, Shahed University, Tehran, Iran

    Zohreh Esmaeili Bidhendi & Ehsan Mousavi Khaneghah

Authors
  1. Zohreh Esmaeili Bidhendi
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ehsan Mousavi Khaneghah
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Ehsan Mousavi Khaneghah.

Ethics declarations

Conflict of Interest

The authors have no conflicts of interest to declare that are relevant to the content of this article.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Bidhendi, Z.E., Khaneghah, E.M. ExaFlooding RD: A Mathematical Model to Support Unstructured Resource Discovery in Distributed Exascale Computing Environments. J Grid Computing 20, 19 (2022). https://doi.org/10.1007/s10723-022-09608-z

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s10723-022-09608-z

Keywords

Search

Navigation