Skip to main content
SpringerLink
Log in
Book cover

International Workshop on Structured Object-Oriented Formal Language and Method

SOFL+MSVL 2019: Structured Object-Oriented Formal Language and Method pp 299–314Cite as

Metamorphic Testing in Fault Localization of Model Transformations

  • Conference paper
  • First Online:

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 12028))

Abstract

Model transformations are cornerstone elements of Model Driven Engineering (MDE), and their quality directly affects the successful application of MDE in practice. However, due to the characteristics of model transformation programs, the debugging of model transformations faces the oracle problem. In this paper, we propose an approach of debugging model transformations by using the technique of metamorphic testing (MT). Our approach leverages MT to alleviate the oracle problem, and integrates MT with spectrum-based fault localization technique to locating faulty rules of model transformations. We conduct experiments to evaluate our approach by using open-source model transformation programs, and compare the effectiveness of our approach with that of a fault localization technique using constraint-based oracles. Both of the experimental analysis and the comparison study show that our approach is of promising effectiveness, suggesting that MT can be a good support for debugging model transformations.

This work was supported in part by the National Natural Science Foundation of China (NSFC) under grant numbers 61210004, 61170015, 61802349 and Zhejiang Provincial Natural Science Foundation of China under Grant numbers LY17F020033, LY20F020021 and by the Fundamental Research Funds of Zhejiang Sci-Tech University under Grant numbers 17032184-Y, 2019Q041, 2019Q039.

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Atl transformations. https://www.eclipse.org/atl/atlTransformations/

  2. Rahim, L.A., Whittle, J.: A survey of approaches for verifying model transformations. Softw. Syst. Model. 14(2), 1003–1028 (2015)

    Article  Google Scholar 

  3. Abreu, R., Zoeteweij, P., Golsteijn, R., van Gemund, A.J.C.: A practical evaluation of spectrum-based fault localization. J. Syst. Softw. 82(11), 1780–1792 (2009)

    Article  Google Scholar 

  4. Le, T.D.B., Lo, D., Le Goues, C., Grunske, L.: A learning-to-rank based fault localization approach using likely invariants. In: Proceedings of the 25th International Symposium on Software Testing and Analysis, ISSTA 2016, pp. 177–188. ACM (2016)

    Google Scholar 

  5. Baudry, B., Ghosh, S., Fleurey, F., France, R., Le Traon, Y., Mottu, J.M.: Barriers to systematic model transformation testing. Commun. ACM 53(6), 139–143 (2010)

    Article  Google Scholar 

  6. Burgueño, L., Troya, J., Wimmer, M., Vallecillo, A.: Static fault localization in model transformations. IEEE Trans. Softw. Eng. 41(5), 490–506 (2015)

    Article  Google Scholar 

  7. Chen, T.Y., Cheung, S.C., Yiu, S.M.: Metamorphic testing: a new approach for generating next test cases. Technical report HKUST-CS98-01, Department of Computer Science, Hong Kong University of Science and Technology (1998)

    Google Scholar 

  8. Chen, T.Y., et al.: Metamorphic testing: a review of challenges and opportunities. ACM Comput. Surv. 51(1), 4:1–4:27 (2018)

    Article  Google Scholar 

  9. Field, A.: Discovering Statistics Using IBM SPSS Statistics, 4th edn. Sage Publications, Thousand Oaks (2003)

    Google Scholar 

  10. He, X., Chen, X., Cai, S., Zhang, Y., Huang, G.: Testing bidirectional model transformation using metamorphic testing. Inform. Softw. Techol. 104, 109–129 (2018)

    Article  Google Scholar 

  11. Hibberd, M., Lawley, M., Raymond, K.: Forensic debugging of model transformations. In: Engels, G., Opdyke, B., Schmidt, D.C., Weil, F. (eds.) MODELS 2007. LNCS, vol. 4735, pp. 589–604. Springer, Heidelberg (2007). https://doi.org/10.1007/978-3-540-75209-7_40

    Chapter  Google Scholar 

  12. Jiang, M., Chen, T.Y., Kuo, F.C., Ding, Z.: Testing central processing unit scheduling algorithms using metamorphic testing. In: Proceedings of the 4th IEEE International Conference on Software Engineering and Service Science, pp. 530–536 (2014)

    Google Scholar 

  13. Jones, J.A., Harrold, M.J., Stasko, J.: Visualization of test information to assist fault localization. In: Proceedings of the 24th International Conference on Software Engineering, ICSE 2002, pp. 467–477 (2002)

    Google Scholar 

  14. Le, T.D.B., Oentaryo, R.J., Lo, D.: Information retrieval and spectrum based bug localization: better together. In: Proceedings of the 2015 10th Joint Meeting on Foundations of Software Engineering, ESEC/FSE 2015, pp. 579–590 (2015)

    Google Scholar 

  15. Lucia, D.L., Lingxiao Jiang, F.T., Budi, A.: Extended comprehensive study of association measures for fault localization. J. Softw.: Evol. Process 26(2), 172–219 (2014)

    Google Scholar 

  16. Lúcio, L., et al.: Model transformation intents and their properties. Softw. Syst. Model. 15(3), 647–684 (2016)

    Article  Google Scholar 

  17. Troya, J., Bergmayr, A., Burgueño, L., Wimmer, M.: Towards systematic mutations for and with ATL model transformations. In: 2015 IEEE Eighth International Conference on Software Testing, Verification and Validation Workshops (ICSTW), pp. 1–10 (2015)

    Google Scholar 

  18. Troya, J., Segura, S., Parejo, J.A., Ruiz-Cortés, A.: Spectrum-based fault localization in model transformations. ACM Trans. Softw. Eng. Methodol. 27(3), 1–50 (2018)

    Article  Google Scholar 

  19. Troya, J., Segura, S., Ruiz-Corts, A.: Automated inference of likely metamorphic relations for model transformations. J. Syst. Softw. 136(C), 188–208 (2018)

    Article  Google Scholar 

  20. Vargha, A., Delaney, H.D.: A critique and improvement of the cl common language effect size statistics of mcgraw and wong. J. Educ. Behav. Stat. 25(2), 101–132 (2000)

    Google Scholar 

  21. Xie, X., Chen, T.Y., Kuo, F.C., Xu, B.: A theoretical analysis of the risk evaluation formulas for spectrum-based fault localization. ACM Trans. Softw. Eng. Methodol. 22(4), 31:1–31:40 (2013)

    Article  Google Scholar 

  22. Xie, X., Wong, W.E., Chen, T.Y., Xu, B.: Metamorphic slice: an application in spectrum-based fault localization. Inf. Softw. Technol. 55(5), 866–879 (2013)

    Article  Google Scholar 

  23. Zhang, M., Li, X., Zhang, L., Khurshid, S.: Boosting spectrum-based fault localization using PageRank. In: Proceedings of the 26th ACM SIGSOFT International Symposium on Software Testing and Analysis, ISSTA 2017, pp. 261–272. ACM (2017)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. School of Information Science, Zhejiang Sci-Tech University, Hangzhou, 310018, China

    Keke Du, Mingyue Jiang, Zuohua Ding, Hongyun Huang & Ting Shu

Authors
  1. Keke Du
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Mingyue Jiang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Zuohua Ding
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Hongyun Huang
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Ting Shu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Mingyue Jiang .

Editor information

Editors and Affiliations

  1. School of Computer Engineering and Science, Shanghai University, Shanghai, China

    Huaikou Miao

  2. Institute of Computing Theory and Technology, Xidian University, Xi'an, China

    Cong Tian

  3. Hosei University, Tokyo, Japan

    Shaoying Liu

  4. Xidian University, Xi'an, Shaanxi, China

    Zhenhua Duan

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Du, K., Jiang, M., Ding, Z., Huang, H., Shu, T. (2020). Metamorphic Testing in Fault Localization of Model Transformations. In: Miao, H., Tian, C., Liu, S., Duan, Z. (eds) Structured Object-Oriented Formal Language and Method. SOFL+MSVL 2019. Lecture Notes in Computer Science(), vol 12028. Springer, Cham. https://doi.org/10.1007/978-3-030-41418-4_20

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-41418-4_20

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-41417-7

  • Online ISBN: 978-3-030-41418-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation