Abstract
Model transformation is a core mechanism for model-driven engineering (MDE). Writing complex model transformations is error-prone, and efficient testing techniques are required as for any complex program development. Testing a model transformation is typically performed by checking the results of the transformation applied to a set of input models. While it is fairly easy to provide some input models, it is difficult to qualify the relevance of these models for testing. In this paper, we propose a set of rules and a framework to assess the quality of given input models for testing a given transformation. Furthermore, the framework identifies missing model elements in input models and assists the user in improving these models.
Similar content being viewed by others
References
France, R., Rumpe, B.: Model-driven development of complex software: a research roadmap. In: Briand, L., Wolf, A. (eds.) Future of Software Engineering 2007, IEEE - CS Press (2007)
Baudry, B., Dinh-Trong, T., Mottu, J.-M., Simmonds, D., France, R., Ghosh, S., Fleurey, F., Le Traon, Y.: Challenges for model transformation testing. In: Proceedings of IMDT Workshop in Conjunction with ECMDA’06. Bilbao, Spain (2006)
Beizer B. (1995). Black-Box Testing. Wiley, New York
OMG: MOF 2.0 Q/V/T OMG Revised submission. Available from: http://www.omg.org/cgi-bin/doc?ad/05-03-02 (2005)
Muller, P.-A., Fleurey, F., Jézéquel, J.-M.: Weaving executability into object-oriented meta-languages. In: Proceedings of MoDELS’05, pp. 264–278. Montego Bay, Jamaica (2005)
Duddy, K., Gerberm, A., Lawley, M., Raymond, K., Steel, J.: Model transformation: a declarative, reusable patterns approach. In: Proceedings of EDOC’03 (Entreprise Distributed Object Computing Conference), pp. 174–185. Brisbane, Australia (2003)
de Lara, J., Vangheluwe, H.: AToM3: A tool for multi-formalism and meta-modelling. In: Proceedings of FASE ’02 (International Conference on Fundamental Approaches to Software Engineering), pp. 174–188 (2002)
Ostrand T.J. and Balcer M.J. (1988). The category-partition method for specifying and generating functional tests. Commun. ACM 31(6): 676–686
OMG: Meta-Object Facilities. Available from: http://www.omg.org/mof/ (2007)
OMG: MOF 2.0 Core Final Adopted Specification. Available from: http://www.omg.org/cgi-bin/doc?ptc/03-10-04 (2004)
Budinsky, F., Steinberg, D., Merks, E., Ellersick, R., Grose, T.: Eclipse Modeling Framework. Addison Wesley, Reading (2003)
Andrews A., France R., Ghosh S. and Craig G. (2003). Test adequacy criteria for UML design models. Softw. Test. Verif. Reliab. 13(2): 95–127
Adrio W.R., Branstad M.A. and Cherniavsky J.C. (1982). Validation, verification, and testing of computer software. ACM Comput. Surv. 14(2): 159–192
Offutt A.J. and Pan J. (1997). Automatically detecting equivalent mutants and infeasible paths. Softw. Test. Verif. Reliab. 7(3): 165–192
MMCC:. Metamodel coverage checker. Available from: http://www.irisa.fr/triskell/Softwares/protos/MMCC/ (2007)
Kermeta: The KerMeta Project Home Page. Available from: http://www.kermeta.org (2005)
Bézivin, J., Rumpe, B., Schürr, A., Tratt, L.: MTIP workshop. Available from: http://sosym.dcs.kcl.ac.uk/events/mtip05/long_cfp.pdf (2005)
Steel, J., Lawley, M.: Model-based test driven development of the Tefkat Model-Transformation Engine. In: Proceedings of ISSRE’04 (Int. Symposium on Software Reliability Engineering). Saint-Malo, France (2004)
Küster J.M. (2006). Definition and validation of model transformations. Softw. Syst. Model. 5(3): 233–259
Küster, J.M., Abd-El-Razik, M.: Validation of model transformations—first experiences using a White Box Approach. In: Proceedings of MoDeVa’06 (Model Design and Validation Workshop associated to MoDELS’06). Genova, Italy (2006)
Darabos, A., Pataricza, A., Varro, D.: Towards testing the implementation of graph transformations. In: Proceedings of GT-VMT Workshop Associated to ETAPS’06, pp. 69–80. Vienna, Austria (2006)
Baldan, P., König, B., Stürmer, I.: Generating test cases for code generators by unfolding graph transformation systems. In: Proceedings of ICGT, pp. 194–209 (2004)
Heckel, R., Mariani, L.: Automatic conformance testing of web services. In: Proceedings of FASE 2005, pp. 34–48 (2005)
Mottu, J.-M., Baudry, B., Le Traon, Y.: Reusable MDA components: a testing-for-trust approach. In: Proceedings of MoDELS’06. Genova, Italy, October (2006)
DeMillo R., Lipton R. and Sayward F. (1978). Hints on test data selection: help for The Practicing Programmer. IEEE Comput. 11(4): 34–41
Mottu, J.-M., Baudry, B., Le Traon, Y.: Mutation analysis testing for model transformations. In: Proceedings of ECMDA’06 (European Conference on Model Driven Architecture). Bilbao, Spain (2006)
Giese, H., Glesner, S., Leitner, J., Schäfer, W., Wagner, R.: Towards verified model transformations. In: Proceedings of MoDeVa Workshop Associated to MoDELS’06, pp. 78–93 (2006)
Boujarwah A.S. and Saleh K. (1997). Compiler test case generation methods: a survey and assessment. Inform. Softw. Technol. 39(9): 617–625
Baudry B., Fleurey F., Jézéquel J.-M. and Le Traon Y. (2005). From genetic to bacteriological algorithms for mutation-based testing. Softw. Test. Verif. Reliab. 15(1): 73–96
Dinh-Trong, T., Kawane, N., Ghosh, S., France, R., Andrews, A.: A tool-supported approach to testing UML Design Models. In: Proceedings of ICECCS’05. Shanghai, China (2005)
OMG: UML 2.0 Object Constraint Language (OCL) Final adopted specification. Available from: http://www.omg.org/cgi-bin/doc?ptc/2003-10-14 (2003)
Gogolla M., Bohling J. and Richters M. (2005). Validating UML and OCL Models in USE by automatic snapshot generation. Softw. Syst. Model. 4(4): 386–398
Rutherford, M.J., Wolf, A.L.: A case for test-code generation in model-driven systems. In: Proceedings of the Second International Conference on Generative Programming and Component Engineering, pp. 377–396. Erfurt, Germany (2003)
Heckel, R., Lohmann, M.: Towards model-driven testing. Electronic Notes in Theoretical Computer Science, vol. 82(6) (2003)
AGEDIS: Automated Generation and Execution of Test Suites for DIstributed Component-based Software. Available from: http://www.agedis.de/index.shtml (2000)
Utting, M., Legeard, B.: Practical model-based testing. Morgan Kaufmann, San Francisco (2007)
Brottier, E., Fleurey, F., Steel, J., Baudry, B., Le Traon, Y.: Metamodel-based test generation for model transformations: an algorithm and a tool. In: Proceedings of ISSRE’06 (Int. Symposium on Software Reliability Engineering). Raleigh (2006)
Sen, S., Baudry, B.: Mutation-based model synthesis in model driven engineering. In: Proceedings of Mutation’06 Workshop Associated to ISSRE’06. Raleigh (2006)
Author information
Authors and Affiliations
Corresponding author
Additional information
Communicated by Prof. Jon Whittle.
Rights and permissions
About this article
Cite this article
Fleurey, F., Baudry, B., Muller, PA. et al. Qualifying input test data for model transformations. Softw Syst Model 8, 185–203 (2009). https://doi.org/10.1007/s10270-007-0074-8
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10270-007-0074-8