Abstract
The edge-to-cloud continuum involves heterogeneous computing resources, including low-power physical devices, Virtual Machines (VMs) in cloud management platforms and serverless computing services based on the FaaS (Functions as a Service) model. This requires novel strategies to describe and efficiently deploy complex applications that execute across the computing continuum. To this end, this paper introduces the developments in the Infrastructure Manager (IM), an open-source TOSCA-based orchestrator to provision and configure virtualized computing resources from a wide range of cloud platforms. By supplementing TOSCA with additional types, the IM can also provision from FaaS platforms across the computing continuum by leveraging public cloud services such as AWS Lambda and on-premises serverless platforms, such as OSCAR. This allows event-driven data-processing applications across multiple computing platforms and architectures. The evolution of the Infrastructure Manager is described to accommodate the definition in TOSCA of complex applications that span across the computing continuum and their automated provisioning and configuration using Infrastructure as Code (IaC) approaches. Its effectiveness is assessed through a real use case involving a machine-learning classifier application for assisting in the early diagnosis of Rheumatic Heart Disease (RHD). The results show that the new developments enable the IM to efficiently deploy complete application architectures described in TOSCA across the computing continuum, from VMs to FaaS services.
Similar content being viewed by others
References
Ren, J., Yu, G., He, Y., Li, G.Y.: Collaborative cloud and edge computing for latency minimization. IEEE Trans. Veh. Technol. 68(5), 5031–5044 (2019)
Jansen, M., Al-Dulaimy, A., Papadopoulos, A.V., Trivedi, A., Iosup, A.: The SPEC-RG reference architecture for the compute continuum. arXiv:2207.04159 (2022). https://doi.org/10.48550/ARXIV.2207.04159
Deng, S., Zhao, H., Fang, W., Yin, J., Dustdar, S., Zomaya, A.Y.: Edge intelligence: The confluence of edge computing and artificial intelligence. IEEE Internet Things J. 7(8), 7457–7469 (2020)
Schleier-Smith, J., Sreekanti, V., Khandelwal, A., Carreira, J., Yadwadkar, N.J., Popa, R.A., Gonzalez, J.E., Stoica, I., Patterson, D.A.: What serverless computing is and should become: The next phase of cloud computing. Commun. ACM 64(5), 76–84 (2021)
Momcheva, I.: Working with the hubble space telescope public data on amazon eb services. Astron Data Anal Softw Syst XXVII 523, 671 (2019)
Muhammad, W., Esposito, F., Maimaitijiang, M., Sagan, V., Bonaiuti, E.: Polly: A tool for rapid data integration and analysis in support of agricultural research and education. Internet Things 9, 100141 (2020). https://doi.org/10.1016/j.iot.2019.100141
Cinaglia, P., Vázquez-Poletti, J.L., Cannataro, M.: Serverless computing for rnaseq data analysis. In: 2022 IEEE International Conference on Bioinformatics and Biomedicine (BIBM), pp. 2175–2181 (2022). IEEE
Risco, S., Moltó, G., Blanquer, I.: Serverless workflows for containerised applications in the cloud continuum. J. Grid Comput. 19(3) (2021). https://doi.org/10.1007/s10723-021-09570-2
Pérez, A., Risco, S., Naranjo, D.M., Caballer, M., Moltó, G.: On-premises serverless computing for event-driven data processing applications. In: 2019 IEEE 12th International Conference on Cloud Computing (CLOUD), pp. 414–421 (2019). https://doi.org/10.1109/CLOUD.2019.00073
Pérez, A., Moltó, G., Caballer, M., Calatrava, A.: Serverless computing for container-based architectures. Futur Gener Comput Syst 83, 50–59 (2018). https://doi.org/10.1016/j.future.2018.01.022
Caballer, M., Blanquer, I., Moltó, G., Alfonso, C.: Dynamic management of virtual infrastructures. J. Grid Comput. 13(1), 53–70 (2015). https://doi.org/10.1007/s10723-014-9296-5
Palma, D., Rutkowski, M., Spatzier, T.: Tosca simple profile in yaml version 1.0. OASIS Comm. Spec. 1, 20 (2016)
Foundation, E.S., Academies, A.E.: The European Code of Conduct for Research Integrity. European Science Foundation, Berlin, Germany (2011)
Santana-Perez, I., Silva, R.F., Rynge, M., Deelman, E., Pérez-Hernández, M.S., Corcho, O.: Reproducibility of execution environments in computational science using semantics and clouds. Futur Gener Comput Syst 67, 354–367 (2017)
Ullah, A., Dagdeviren, H., Ariyattu, R.C., DesLauriers, J., Kiss, T., Bowden, J.: Micado-edge: Towards an application-level orchestrator for the cloud-to-edge computing continuum. J. Grid Comput. 19(4), 1–28 (2021)
Tusa, F., Clayman, S.: End-to-end slices to orchestrate resources and services in the cloud-to-edge continuum. Futur Gener Comput Syst 141, 473–488 (2023). https://doi.org/10.1016/j.future.2022.11.026
Spătaru, A., Iuhasz, G., Panica, S.: Tufa: A tosca extension for the specification of accelerator-aware applications in the cloud continuum. In: 2022 IEEE 46th Annual Computers, Software, and Applications Conference (COMPSAC), pp. 1178–1183 (2022). IEEE
Anser, Y., Gaber, C., Wary, J.-P., García, S.N.M., Bouzefrane, S.: Trails: Extending tosca nfv profiles for liability management in the cloud-to-iot continuum. In: 2022 IEEE 8th International Conference on Network Softwarization (NetSoft), pp. 321–329 (2022). IEEE
Grossi,V., Trasarti, R., Dazzi, P.: Data science workflows for the cloud/edge computing continuum. In: Proceedings of the 1st Workshop on Flexible Resource and Application Management on the Edge, pp. 41–44 (2020)
Wurster, M., Breitenbücher, U., Képes, K., Leymann, F., Yussupov,V.: Modeling and automated deployment of serverless applications using tosca. In: 2018 IEEE 11th Conference on Service-oriented Computing and Applications (SOCA), pp. 73–80 (2018). IEEE
Yussupov, V., Soldani, J., Breitenbücher, U., Leymann, F.: Standards-based modeling and deployment of serverless function orchestrations using bpmn and tosca. Softw. Pract. Exper. 52(6), 1454–1495 (2022)
Dehury, C.K., Jakovits, P., Srirama, S.N., Giotis, G., Garg, G.: Toscadata: Modeling data pipeline applications in tosca. J. Syst. Softw. 186, 111164 (2022)
Caballer, M., Antonacci, M., Šustr, Z., Perniola, M., Moltó, G.: Deployment of elastic virtual hybrid clusters across cloud sites. J. Grid Comput. 19, 4 (2021). https://doi.org/10.1007/s10723-021-09543-5
Caballer, M., Chatziangelou, M., Calatrava, A., Moltó, G., Pérez, A.: IM integration in the EGI VMOps Dashboard. In: EGI Conference 2017 and INDIGO Summit 2017 (2017). https://indico.egi.eu/event/3249/contributions/7473/
Salomoni, D., Campos, I., Gaido, L., Lucas, J.M., Solagna, P., Gomes, J., Matyska, L., Fuhrman, P., Hardt, M., Donvito, G., et al.: Indigo-datacloud: A platform to facilitate seamless access to e-infrastructures. J. Grid Comput. 16, 381–408 (2018)
Lahiff, A., Witt, S., Caballer, M., La Rocca, G., Pamela, S., Coster, D.: Running htc and hpc applications opportunistically across private, academic and public clouds. In: EPJ Web of Conferences, vol. 245, pp. 07032 (2020). EDP Sciences
Caballer, M., Antonacci, M., Šustr, Z., Perniola, M., Moltó, G.: Deployment of elastic virtual hybrid clusters across cloud sites. J. Grid Comput. 19(1), 4 (2021)
Caballer, M., de Alfonso, C., Alvarruiz, F., Moltó, G.: Ec3: Elastic cloud computing cluster. J. Comput. Syst. Sci. 79(8), 1341–1351 (2013). https://doi.org/10.1016/j.jcss.2013.06.005
Alvarruiz, F., Alfonso, C., Caballer, M., Hern’ndez, V.: An energy manager for high performance computer clusters. In: 2012 IEEE 10th International Symposium on Parallel and Distributed Processing with Applications, pp. 231–238 (2012). https://doi.org/10.1109/ISPA.2012.38
OpenFog Consortium Architecture Working Group, A., et al.: Openfog reference architecture for fog computing. OPFRA001 20817, 162 (2017)
Blanquer, I., Brasileiro, F., Brito, A., Calatrava, A., Carvalho, A., Fetzer, C., Figueiredo, F., Guimarães, R.P., Marinho, L., Meira, W., Silva, A., Alberich-Bayarri, Camacho-Ramos, E., Jimenez-Pastor, A., Ribeiro, A.L.L., Nascimento, B.R., Silva, F.: Federated and secure cloud services for building medical image classifiers on an intercontinental infrastructure. Futur. Gener. Comput. Syst. 110, 119–134 (2020). https://doi.org/10.1016/j.future.2020.04.012
Lopes, E.L., Beaton, A.Z., Nascimento, B.R., Tompsett, A., Dos Santos, J.P., Perlman, L., Diamantino, A.C., Oliveira, K.K., Oliveira, C.M., Nunes, Md.C.P., et al.: Telehealth solutions to enable global collaboration in rheumatic heart disease screening. J. Telemed. Teleca. 24, 101–109 (2018)
Nascimento, B.R., Beaton, A.Z., Nunes, M.C.P., Diamantino, A.C., Carmo, G.A., Oliveira, K.K., Oliveira, C.M., Meira, Z.M.A., Castilho, S.R.T., Lopes, E.L., et al.: Echocardiographic prevalence of rheumatic heart disease in brazilian schoolchildren: Data from the provar study. Int. J. Cardiol. 219, 439–445 (2016)
Acknowledgements
Grant PID2020-113126RB-I00 funded by MCIN/AEI/10.13039/501100011033. Also, Project PDC2021-120844-I00 funded by MCIN/AEI/10.13039/501100011033 and by the European Union NextGenerationEU/PRTR. This work was partially supported by the project AI-SPRINT “AI in Secure Privacy-Preserving Computing Continuum” which has received funding from the European Union’s Horizon 2020 Research and Innovation Programme under Grant 101016577 and by the AI4EOSC “Artificial Intelligence for the European Open Science Cloud” that has received funding from the European Union’s Horizon Europe Research and Innovation Programme under Grant 101058593. Finally, Amanda wants to thank the support received by the Universitat Politècnica de València for the project “Extensión de modelos de computaciń en cloud en entornos confiables y altamente distribuidos”, from the PAID-10-20 postdoctoral program.
Author information
Authors and Affiliations
Contributions
Miguel Caballer, Amanda Calatrava and Germán Moltó wrote the main manuscript text. Miguel Caballer prepared all the figures. Ignacio Blanquer and Germán Moltó reviewed the manuscript.
Corresponding author
Ethics declarations
Competing interests
The authors declare that they have no competing interests as defined by Springer, or other interests that might be perceived to influence the results and/or discussion reported in this paper.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Caballer, M., Moltó, G., Calatrava, A. et al. Infrastructure Manager: A TOSCA-Based Orchestrator for the Computing Continuum. J Grid Computing 21, 51 (2023). https://doi.org/10.1007/s10723-023-09686-7
Received:
Accepted:
Published:
DOI: https://doi.org/10.1007/s10723-023-09686-7