Conformance Testing of Network Simulators Based on Metamorphic Testing Technique

  • Tsong Yueh Chen
  • Fei-Ching Kuo
  • Huai Liu
  • Shengqiong Wang
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5522)


Network simulators, which implement network protocols under some simulated conditions, have been widely used to analyze the feasibility of network protocols. Conformance testing of the simulator against the protocol is a very important task in the community of telecommunications. However, many current conformance testing methods face a problem of finding a systematic mechanism to verify the test outputs. This paper proposes to use an innovative testing approach, metamorphic testing (MT), to alleviate such a problem. We select one ad-hoc on-demand distance vector (AODV) simulator for study and test its conformance against the AODV protocol by the MT technique. Through our experiments, we illustrate the applicability of MT in the protocol conformance testing, confirm the reliability of the selected AODV simulator, and demonstrate the cost-effectiveness of MT using the mutation analysis technique.


  1. 1.
    Andrews, J.H., Briand, L.C., Labiche, Y.: Is mutation an appropriate tool for testing experiments? In: Proc. of ICSE 2005, pp. 402–411 (2005)Google Scholar
  2. 2.
    Blumer, T.P., Sidhu, D., Chung, A.: Experience with formal methods in protocol development. ACM Comput. Commun. Rev. 21(2), 81–101 (1991)CrossRefGoogle Scholar
  3. 3.
    Chen, T.Y., Ho, J.W.H., Liu, H., Xie, X.: An innovative approach for testing bioinformatics programs using metamorphic testing. BMC Bioinform. 10, 24 (2009)CrossRefGoogle Scholar
  4. 4.
    Chen, T.Y., Tse, T.H., Zhou, Z.Q.: Fault-based testing without the need of oracles. Inform. Softw. Tech. 45(1), 1–9 (2003)CrossRefGoogle Scholar
  5. 5.
    Concer, N.: Ad-hoc network simulator (2005),
  6. 6.
    ISO. Information technology - open systems interconnection - conformance testing methodology and framework. ISO/IEC 9646Google Scholar
  7. 7.
    Lai, R.: A survey of communication protocol testing. Journ. Syst. Softw. 62(1), 21–46 (2002)CrossRefGoogle Scholar
  8. 8.
    Machado, P.D.L., Andrade, W.L.: The oracle problem for testing against quantified properties. In: Proc. of QSIC 2007, pp. 415–418 (2007)Google Scholar
  9. 9.
    Murphy, C., Kaiser, G., Hu, L., Wu, L.: Properties of machine learning applications for use in metamorphic testing. In: Proc. of SEKE 2008, pp. 867–872 (2008)Google Scholar
  10. 10.
    Myers, G.J.: The Art of Software Testing. John Wiley and Sons, Chichester (2004)zbMATHGoogle Scholar
  11. 11.
    OMNeT Community. OMNeT++ system,
  12. 12.
    Onoma, A.K., Tsai, W.-T., Poonawala, M.H., Suganuma, H.: Regression testing in an industrial environment. Commun. ACM 41(5), 81–86 (1998)CrossRefGoogle Scholar
  13. 13.
    Paradkar, A.M.: Towards model-based generation of self-priming and self-checking conformance tests for interactive systems. In: Matsui, M., Zuccherato, R.J. (eds.) SAC 2003. LNCS, vol. 3006, pp. 1110–1117. Springer, Heidelberg (2004)Google Scholar
  14. 14.
    Perkins, C., Belding-Royer, E., Das, S.: Ad hoc on-demand distance vector routing. RFC3561 (2008)Google Scholar
  15. 15.
    Rothermel, G., Untch, R.H., Chu, C., Harrold, M.J.: Prioritizing test cases for regression testing. IEEE Trans. Softw. Eng. 27(10), 929–948 (2001)CrossRefGoogle Scholar

Copyright information

© IFIP International Federation for Information Processing 2009

Authors and Affiliations

  • Tsong Yueh Chen
    • 1
  • Fei-Ching Kuo
    • 1
  • Huai Liu
    • 1
  • Shengqiong Wang
    • 1
  1. 1.Centre for Software Analysis and TestingSwinburne University of TechnologyAustralia

Personalised recommendations