Skip to main content

A methodology for validating cloud models using metamorphic testing

annals of telecommunications - annales des télécommunications volume 70, pages 127–135 (2015)Cite this article

Abstract

Cloud computing is a paradigm that provides access to a flexible, elastic and on-demand computing infrastructure, allowing users to dynamically request virtual resources. However, researchers typically cannot experiment with critical parts of cloud systems such as the underlying cloud architecture, resource-provisioning policies and the configuration of resource virtualisation. This problem can be partially addressed through using simulations of cloud systems. Unfortunately, the problem of testing cloud systems is still challenging due to the many parameters that such systems typically have and the difficulty in determining whether an observed behaviour is correct. In order to alleviate these issues, we propose a methodology to semi-automatically test and validate cloud models by integrating simulation techniques and metamorphic testing.

This is a preview of subscription content, access via your institution.

Access options

Buy single article

Instant access to the full article PDF.

USD 39.95

Price includes VAT (USA)
Tax calculation will be finalised during checkout.

Fig. 1
Fig. 2
Fig. 3
Fig. 4

References

  1. Bertolino A, Grieskamp W, Hierons RM, Le Traon Y, Legeard B, Muccini H, Paradkar A, Rosenblum D, Tretmans J (2010) Model-based testing for the cloud. In: Practical Software Testing : Tool Automation and Human Factors, no. 10111 in Dagstuhl Seminar Proceedings. Schloss Dagstuhl - Leibniz-Zentrum fuer Informatik, Germany, pp 1–11

    Google Scholar 

  2. Buyya R, Beloglazov A, Abawajy J (2010) Energy-efficient management of data center resources for cloud computing: a vision, architectural elements, and open challenges. In: 16th Int. Conf. on Parallel and Distributed Processing Techniques and Applications, PDPTA’10. CSREA Press, pp 1–12

  3. Buyya R, Ranjan R, Calheiros RN (2009) Modeling and simulation of scalable cloud computing environments and the CloudSim toolkit: challenges and opportunities. In: 7th High Performance Computing and Simulation Conference, HPCS’09. IEEE Computer Society, pp 1–11

  4. Calheiros RN, Buyya R, De Rose CAF (2010) Building an automated and self-configurable emulation test bed for grid applications. Softw: Pract Experience 40(5):405–429

    Google Scholar 

  5. Casanova H, Legrand A, Quinson M (2008) SimGrid: a generic framework for large-scale distributed experiments. In: 10th Int. Conf. on Computer Modeling and Simulation, UKSIM’ 08

  6. Castañé G, Núnez~ A, Llopis P, Carretero J (2013) E-mc2: a formal framework for energy modelling in cloud computing. Simul Model Pract Theor 39:56–75

    Article  Google Scholar 

  7. Chen TY, Sun C, Wang G, Mu B, Liu H, Wang ZS (2012) A metamorphic relation-based approach to testing web services without oracles. Int J Web Serv. Res. 9(1):51–73

    Article  Google Scholar 

  8. Garber L (2011) News briefs. IEEE Computer 44(6):18–20

    Article  Google Scholar 

  9. Hierons RM, Merayo MG, Núñez M (2010) Mutation testing. In: Laplante P A (ed) Encyclopedia of Software Engineering. Taylor & Francis

  10. Kim KH, Beloglazov A, Buyya R (2009) Power-aware provisioning of cloud resources for real-time services. In: Proceedings of the 7th International Workshop on Middleware for Grids, Clouds and e-Science. Urbana Champaign, Illinois, USA , pp 1–6

    Google Scholar 

  11. Kliazovich D, Bouvry P, Audzevich Y, Khan S (2012) Greencloud: a packet-level simulator of energy-aware cloud computing data centers. J Supercomput 62(3):1263–1283

    Article  Google Scholar 

  12. Myers G (2004) The Art of Software Testing, 2nd edn. Wiley

  13. Núñez A, Fernández J, Filgueira R, García F, Carretero J (2012) SIMCAN: a flexible, scalable and expandable simulation platform for modelling and simulating distributed architectures and applications. Simul Model Pract Theory 20(1):12–32

    Article  Google Scholar 

  14. Núñez A, Vázquez-Poletti JL, Caminero AC, Castañé GG, Carretero J, Llorente IM (2012) iCanCloud: a flexible and scalable cloud infrastructure simulator. J Grid Comput 10(1):185– 209

    Article  Google Scholar 

  15. Ried S, Kisker H, Matzke P, Bartels A, Lisserman M (2011) Sizing the cloud—a BT futures report. Understanding and quantifying the future of cloud computing. Forrester Research Report

  16. Sulistio A, Cibej U, Venugopal S, Robic B, Buyya R (2008) A toolkit for modelling and simulating Data Grids: an extension to GridSim. Concurr Comput: Pract Experience 20(13):1591– 1609

    Article  Google Scholar 

  17. The Network Simulator, NS-2: Web page at. Date of last access: 8th August, 2013. http://www.isi.edu/nsnam/ns/

  18. Weyuker EJ (1982) On testing non-testable programs. Comput J 25(4):465–470

    Article  Google Scholar 

Download references

Acknowledgements

This research was partially supported by the Spanish MEC projects TESIS (TIN2009-14312-C02-01) and ESTuDIo (TIN2012-36812-C02-01).

Author information

Authors and Affiliations

  1. Computer Science Faculty, University Complutense de Madrid, Madrid, Spain

    Alberto Núñez

  2. School of Information Systems, Computing and Mathematics, Brunel University, Brunel, UK

    Robert M. Hierons

Authors
  1. Alberto Núñez
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Robert M. Hierons
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Alberto Núñez.

Rights and permissions

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Núñez, A., Hierons, R.M. A methodology for validating cloud models using metamorphic testing. Ann. Telecommun. 70, 127–135 (2015). https://doi.org/10.1007/s12243-014-0442-7

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12243-014-0442-7

Keywords

  • Metamorphic testing
  • Cloud computing
  • Simulation and modelling