Abstract
It has long been known that there are software applications for which it is difficult to detect subtle errors, faults, defects, or anomalies because there is no reliable “test oracle” to indicate what the correct output should be for arbitrary input. The absence of a test oracle clearly presents a challenge in testing the software applications of scientific computing from the domain of nuclear power plant. Metamorphic testing has been shown to be a simple yet effective technique in addressing the quality assurance of these “non-testable programs.” In this paper, we introduce Metamorphic testing method to address the oracle problem as mentioned above. We identify a metamorphic relation for a real-world scientific computing programs which do not have test oracles, and demonstrate the effectiveness of metamorphic testing in identifying the error.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
E. J. Weyuker. On testing non-testable programs. Computer Journal, 25(4):465–470, November 1982.
T. Y. Chen, T. H. Tse, and Z. Q. Zhou. Fault-based testing without the need of oracles. Information and Software Technology, 44(15):923–931, 2002.
Z. Q. Zhou, D. H. Huang, T. H. Tse, Z. Yang, H. Huang, and T. Y. Chen. Metamorphic testing and its applications. In Proc. of the 8th International Symposium on Future Software Technology (ISFST 2004), 2004.
T. Y. Chen, T. H. Tse, and Z. Q. Zhou. Semi-proving: an integrated method based on global symbolic evaluation and metamorphic testing. In Proc. of the International Symposium on Software Testing and Analysis (ISSTA), pages 191–195, 2002.
W. K. Chan, S. C. Cheung, and K. R. P. H. Leung. A metamorphic testing approach for online testing of service-oriented software applications. International Journal of Web Services Research, 4(1):60–80, April–June 2007.
P. Hu, Z. Zhang, W. K. Chan, and T. H. Tse. An empirical comparison between direct and indirect test result checking approaches. In Proc. of the 3rd International Workshop on Software Quality Assurance, pages 6–13, 2006.
T. Y. Chen, J. W. K. Ho, H. Liu, and X. Xie. An innovative approach for testing bioinformatics programs using metamorphic testing. BMC Bioinformatics, 10(24), 2009.
T. Y. Chen, F.-C. Kuo, H. Liu, and S. Wang. Conformance testing of network simulators based on metamorphic testing technique. Lecture Notes in Computer Science, 5522, 2009.
X. Xie, J. Ho, C. Murphy, G. Kaiser, B. Xu, and T. Y. Chen. Application of metamorphic testing to supervised classifiers. In Proc. of the 9th International Conference on Quality Software (QSIC), 2009.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer Science+Business Media Singapore
About this paper
Cite this paper
Yan, S., Yang, X., Li, M., Liu, H., Liu, Z. (2017). Research of Testing for Scientific Computing Software in the Area of Nuclear Power Based on Metamorphic Testing. In: Jiang, H. (eds) Proceedings of The 20th Pacific Basin Nuclear Conference. PBNC 2016. Springer, Singapore. https://doi.org/10.1007/978-981-10-2311-8_46
Download citation
DOI: https://doi.org/10.1007/978-981-10-2311-8_46
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-10-2310-1
Online ISBN: 978-981-10-2311-8
eBook Packages: EnergyEnergy (R0)