A methodology for validating cloud models using metamorphic testing

  • Alberto Núñez
  • Robert M. Hierons


Cloud computing is a paradigm that provides access to a flexible, elastic and on-demand computing infrastructure, allowing users to dynamically request virtual resources. However, researchers typically cannot experiment with critical parts of cloud systems such as the underlying cloud architecture, resource-provisioning policies and the configuration of resource virtualisation. This problem can be partially addressed through using simulations of cloud systems. Unfortunately, the problem of testing cloud systems is still challenging due to the many parameters that such systems typically have and the difficulty in determining whether an observed behaviour is correct. In order to alleviate these issues, we propose a methodology to semi-automatically test and validate cloud models by integrating simulation techniques and metamorphic testing.


Metamorphic testing Cloud computing Simulation and modelling 



This research was partially supported by the Spanish MEC projects TESIS (TIN2009-14312-C02-01) and ESTuDIo (TIN2012-36812-C02-01).


  1. 1.
    Bertolino A, Grieskamp W, Hierons RM, Le Traon Y, Legeard B, Muccini H, Paradkar A, Rosenblum D, Tretmans J (2010) Model-based testing for the cloud. In: Practical Software Testing : Tool Automation and Human Factors, no. 10111 in Dagstuhl Seminar Proceedings. Schloss Dagstuhl - Leibniz-Zentrum fuer Informatik, Germany, pp 1–11Google Scholar
  2. 2.
    Buyya R, Beloglazov A, Abawajy J (2010) Energy-efficient management of data center resources for cloud computing: a vision, architectural elements, and open challenges. In: 16th Int. Conf. on Parallel and Distributed Processing Techniques and Applications, PDPTA’10. CSREA Press, pp 1–12Google Scholar
  3. 3.
    Buyya R, Ranjan R, Calheiros RN (2009) Modeling and simulation of scalable cloud computing environments and the CloudSim toolkit: challenges and opportunities. In: 7th High Performance Computing and Simulation Conference, HPCS’09. IEEE Computer Society, pp 1–11Google Scholar
  4. 4.
    Calheiros RN, Buyya R, De Rose CAF (2010) Building an automated and self-configurable emulation test bed for grid applications. Softw: Pract Experience 40(5):405–429Google Scholar
  5. 5.
    Casanova H, Legrand A, Quinson M (2008) SimGrid: a generic framework for large-scale distributed experiments. In: 10th Int. Conf. on Computer Modeling and Simulation, UKSIM’ 08Google Scholar
  6. 6.
    Castañé G, Núnez~ A, Llopis P, Carretero J (2013) E-mc2: a formal framework for energy modelling in cloud computing. Simul Model Pract Theor 39:56–75CrossRefGoogle Scholar
  7. 7.
    Chen TY, Sun C, Wang G, Mu B, Liu H, Wang ZS (2012) A metamorphic relation-based approach to testing web services without oracles. Int J Web Serv. Res. 9(1):51–73CrossRefGoogle Scholar
  8. 8.
    Garber L (2011) News briefs. IEEE Computer 44(6):18–20CrossRefGoogle Scholar
  9. 9.
    Hierons RM, Merayo MG, Núñez M (2010) Mutation testing. In: Laplante P A (ed) Encyclopedia of Software Engineering. Taylor & FrancisGoogle Scholar
  10. 10.
    Kim KH, Beloglazov A, Buyya R (2009) Power-aware provisioning of cloud resources for real-time services. In: Proceedings of the 7th International Workshop on Middleware for Grids, Clouds and e-Science. Urbana Champaign, Illinois, USA , pp 1–6Google Scholar
  11. 11.
    Kliazovich D, Bouvry P, Audzevich Y, Khan S (2012) Greencloud: a packet-level simulator of energy-aware cloud computing data centers. J Supercomput 62(3):1263–1283CrossRefGoogle Scholar
  12. 12.
    Myers G (2004) The Art of Software Testing, 2nd edn. WileyGoogle Scholar
  13. 13.
    Núñez A, Fernández J, Filgueira R, García F, Carretero J (2012) SIMCAN: a flexible, scalable and expandable simulation platform for modelling and simulating distributed architectures and applications. Simul Model Pract Theory 20(1):12–32CrossRefGoogle Scholar
  14. 14.
    Núñez A, Vázquez-Poletti JL, Caminero AC, Castañé GG, Carretero J, Llorente IM (2012) iCanCloud: a flexible and scalable cloud infrastructure simulator. J Grid Comput 10(1):185– 209CrossRefGoogle Scholar
  15. 15.
    Ried S, Kisker H, Matzke P, Bartels A, Lisserman M (2011) Sizing the cloud—a BT futures report. Understanding and quantifying the future of cloud computing. Forrester Research ReportGoogle Scholar
  16. 16.
    Sulistio A, Cibej U, Venugopal S, Robic B, Buyya R (2008) A toolkit for modelling and simulating Data Grids: an extension to GridSim. Concurr Comput: Pract Experience 20(13):1591– 1609CrossRefGoogle Scholar
  17. 17.
    The Network Simulator, NS-2: Web page at. Date of last access: 8th August, 2013.
  18. 18.
    Weyuker EJ (1982) On testing non-testable programs. Comput J 25(4):465–470CrossRefGoogle Scholar

Copyright information

© Institut Mines-Télécom and Springer-Verlag France 2014

Authors and Affiliations

  1. 1.Computer Science FacultyUniversity Complutense de MadridMadridSpain
  2. 2.School of Information Systems, Computing and MathematicsBrunel UniversityBrunelUK

Personalised recommendations