Abstract
Network simulators, which implement network protocols under some simulated conditions, have been widely used to analyze the feasibility of network protocols. Conformance testing of the simulator against the protocol is a very important task in the community of telecommunications. However, many current conformance testing methods face a problem of finding a systematic mechanism to verify the test outputs. This paper proposes to use an innovative testing approach, metamorphic testing (MT), to alleviate such a problem. We select one ad-hoc on-demand distance vector (AODV) simulator for study and test its conformance against the AODV protocol by the MT technique. Through our experiments, we illustrate the applicability of MT in the protocol conformance testing, confirm the reliability of the selected AODV simulator, and demonstrate the cost-effectiveness of MT using the mutation analysis technique.
Download conference paper PDF
References
Andrews, J.H., Briand, L.C., Labiche, Y.: Is mutation an appropriate tool for testing experiments? In: Proc. of ICSE 2005, pp. 402–411 (2005)
Blumer, T.P., Sidhu, D., Chung, A.: Experience with formal methods in protocol development. ACM Comput. Commun. Rev. 21(2), 81–101 (1991)
Chen, T.Y., Ho, J.W.H., Liu, H., Xie, X.: An innovative approach for testing bioinformatics programs using metamorphic testing. BMC Bioinform. 10, 24 (2009)
Chen, T.Y., Tse, T.H., Zhou, Z.Q.: Fault-based testing without the need of oracles. Inform. Softw. Tech. 45(1), 1–9 (2003)
Concer, N.: Ad-hoc network simulator (2005), http://www.omnetpp.org/filemgmt/singlefile.php?lid=87
ISO. Information technology - open systems interconnection - conformance testing methodology and framework. ISO/IEC 9646
Lai, R.: A survey of communication protocol testing. Journ. Syst. Softw. 62(1), 21–46 (2002)
Machado, P.D.L., Andrade, W.L.: The oracle problem for testing against quantified properties. In: Proc. of QSIC 2007, pp. 415–418 (2007)
Murphy, C., Kaiser, G., Hu, L., Wu, L.: Properties of machine learning applications for use in metamorphic testing. In: Proc. of SEKE 2008, pp. 867–872 (2008)
Myers, G.J.: The Art of Software Testing. John Wiley and Sons, Chichester (2004)
OMNeT Community. OMNeT++ system, http://www.omnetpp.org
Onoma, A.K., Tsai, W.-T., Poonawala, M.H., Suganuma, H.: Regression testing in an industrial environment. Commun. ACM 41(5), 81–86 (1998)
Paradkar, A.M.: Towards model-based generation of self-priming and self-checking conformance tests for interactive systems. In: Matsui, M., Zuccherato, R.J. (eds.) SAC 2003. LNCS, vol. 3006, pp. 1110–1117. Springer, Heidelberg (2004)
Perkins, C., Belding-Royer, E., Das, S.: Ad hoc on-demand distance vector routing. RFC3561 (2008)
Rothermel, G., Untch, R.H., Chu, C., Harrold, M.J.: Prioritizing test cases for regression testing. IEEE Trans. Softw. Eng. 27(10), 929–948 (2001)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 IFIP International Federation for Information Processing
About this paper
Cite this paper
Chen, T.Y., Kuo, FC., Liu, H., Wang, S. (2009). Conformance Testing of Network Simulators Based on Metamorphic Testing Technique. In: Lee, D., Lopes, A., Poetzsch-Heffter, A. (eds) Formal Techniques for Distributed Systems. FMOODS FORTE 2009 2009. Lecture Notes in Computer Science, vol 5522. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-02138-1_19
Download citation
DOI: https://doi.org/10.1007/978-3-642-02138-1_19
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-02137-4
Online ISBN: 978-3-642-02138-1
eBook Packages: Computer ScienceComputer Science (R0)