Using TimedTTCN-3 in Interoperability Testing for Real-Time Communication Systems

  • Zhiliang Wang
  • Jianping Wu
  • Xia Yin
  • Xingang Shi
  • Beihang Tian
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3964)

Abstract

Interoperability testing is an important technique to ensure the quality of implementations of network communication software, and real-time protocol interoperability testing is an important issue in this area. TimedTTCN-3 is a real-time extension of test specification language TTCN-3. In this paper, test notations for real-time interoperability testing are studied. Test behavior trees are constructed from specifications of system under test and then transformed to TimedTTCN-3 test cases. We also investigate real-time TTCN and analyze the insufficiency of its capabilities in specifying time constraints. Possible extensions for real-time TTCN are given to specify real-time interoperability test cases. From the comparisons between the two real-time test notations, it can be concluded that TimedTTCN-3 is more powerful and flexible than real-time TTCN and can be suitable for real-time interoperability testing.

References

  1. Alur, R., Dill, D.: A theory of timed automata. Theoretical Computer Science 126(2), 183–235 (1994)MathSciNetCrossRefMATHGoogle Scholar
  2. Briones, L.B., Brinksma, E.: A Test Generation Framework for quiescent Real-Time Systems. In: Grabowski, J., Nielsen, B. (eds.) FATES 2004. LNCS, vol. 3395, pp. 64–78. Springer, Heidelberg (2005)CrossRefGoogle Scholar
  3. Bornot, S., Sifakis, J., Tripakis, S.: Modeling Urgency in Timed Systems. In: de Roever, W.-P., Langmaack, H., Pnueli, A. (eds.) COMPOS 1997. LNCS, vol. 1536, p. 103. Springer, Heidelberg (1998)CrossRefGoogle Scholar
  4. Dai, Z., Grabowski, J., Neukirchen, H.: Timed TTCN-3 – A Real-Time Extension for TTCN-3. In: Testcom 2002, pp. 407–424 (2002)Google Scholar
  5. Dai, Z., Grabowski, J., Neukirchen, H.: Timed TTCN-3 Based Graphical Real-Time Test Specification. In: TestCom 2003, pp. 110–127 (2003)Google Scholar
  6. En-Nouaary, A., Dssouli, R., Khendek, F.: Timed Wp-method: testing real-time systems. IEEE Transactions on Software Engineering 28(11), 1023–1038 (2002)CrossRefGoogle Scholar
  7. El-Fakih, K., Trenkaev, V., Spitsyna, N., Yevtushenko, N.: FSM Based Inter-operability Testing Methods for Multi Stimuli Model. In: TestCom 2004, pp. 60–75 (2004)Google Scholar
  8. Grabowski, J., Hogrefe, D., Réthy, G., Schieferdecker, I., et al.: An introduction to the testing and test control notation (TTCN-3). Computer Networks 42(3), 375–403 (2003)CrossRefMATHGoogle Scholar
  9. Hao, R.: Research on Protocol Conformance and Interoperability Testing based on Formal Methods (In Chinese). PhD thesis, Tsinghua University, P. R. China (1997)Google Scholar
  10. Hao, R., Lee, D., Sinha, R.K., Griffeth, N.: Integrated System Interoperability Testing With Applications to VoIP. IEEE/ACM Transactions on Networking 12(5), 823–836 (2004)CrossRefGoogle Scholar
  11. Higashino, T., Nakata, A., Taniguchi, K., Cavalli, A.R.: Generating test cases for a timed I/O automaton model. In: IFIP TC6 12th International Workshop on Testing Communicating Systems, pp. 197–214 (1999)Google Scholar
  12. Krémer, P., Dibuz, S.: Framework and Model for Automated Interoperability Test and Its Application to ROHC. In: Hogrefe, D., Wiles, A. (eds.) TestCom 2003. LNCS, vol. 2644, pp. 243–257. Springer, Heidelberg (2003)CrossRefGoogle Scholar
  13. Khoumsi, A., Jéron, T., Marchand, H.: Test cases generation for nondeterministic real-time systems. In: Petrenko, A., Ulrich, A. (eds.) FATES 2003. LNCS, vol. 2931, pp. 131–146. Springer, Heidelberg (2004)CrossRefGoogle Scholar
  14. Kang, S., Shin, J., Kim, M.: Interoperability Test Suite Derivation for Communication Protocols. Computer Networks 32(3), 347–364 (2000)CrossRefGoogle Scholar
  15. Krichen, M., Tripakis, S.: Black-Box Conformance Testing for Real-Time Systems. In: Graf, S., Mounier, L. (eds.) SPIN 2004. LNCS, vol. 2989, pp. 109–126. Springer, Heidelberg (2004)CrossRefGoogle Scholar
  16. Larsen, K., Mikucionis, M., Nielsen, B.: Online Testing of Real-time Systems Using Uppaal. In: Grabowski, J., Nielsen, B. (eds.) FATES 2004. LNCS, vol. 3395, pp. 79–94. Springer, Heidelberg (2005)CrossRefGoogle Scholar
  17. Neukirchen, H., Dai, Z., Grabowski, J.: Communication Patterns for Expressing Real-Time Requirements Using MSC and Their Application to Testing. In: TestCom 2004, pp. 144–159 (2004)Google Scholar
  18. Rafiq, O., Castanet, R.: From conformance testing to interoperability testing. In: The 3rd Int. Workshop on Protocol Test Systems (1990)Google Scholar
  19. Seol, S., Kim, M., Chanson, S.T., Kang, S.: Interoperability Test Generation and Minimization for Communication Protocols Based on the Multiple Stimuli Principle. IEEE Journal on Selected Areas in Communications (JSAC) 22(10), 2062–2074 (2004)CrossRefGoogle Scholar
  20. Seol, S., Kim, M., Kang, S., Ryu, J.: Fully Automated Interoperability Test Suite Derivation for Communication Protocols. Computer Networks 43(6), 735–759 (2003)CrossRefMATHGoogle Scholar
  21. Springintveld, J., Vaandrager, F., D’Argenio, P.R.: Testing Timed Automata. Theoretical Computer Science 254(1-2), 225–257 (2001)MathSciNetCrossRefMATHGoogle Scholar
  22. Trenkaev, V., Kim, M., Seol, S.: Interoperability Testing Based on a Fault Model for a System of Communicating FSMs. In: Hogrefe, D., Wiles, A. (eds.) TestCom 2003. LNCS, vol. 2644, pp. 226–242. Springer, Heidelberg (2003)CrossRefGoogle Scholar
  23. ITU-T Recommendation X.292 (1998): OSI Conformance Testing Methodology and Framework for Protocol Recommendations for ITU-T Applications-—The Tree and Tabular Combined Notation (TTCN). ITU-T, Geneva (Switzerland)Google Scholar
  24. ETSI European Standard (ES) 201 873-1 V2.2.1 (2002-08): The Testing and Test Control Notation version 3; Part 1: TTCN-3 Core Language. European Telecommunications Standards Institute (ETSI), Sophia-Antipolis (France) (2002)Google Scholar
  25. Viho, C., Barbin, S., Tanguy, L.: Towards a formal framework for interoperability testing. In: FORTE 2001, pp. 51–68 (2001)Google Scholar
  26. Walter, T., Grabowski, J.: A framework for the specification of test cases for real-time distributed systems. Information & Software Technology 41(11-12), 781–798 (1999)CrossRefGoogle Scholar
  27. Wang, Z., Wu, J., Yin, X.: Towards Interoperability Test Genera-tion of Time Dependent Protocols: a Case Study. IEEE Globecom 2, 589–594 (2004)Google Scholar
  28. Wang, Z., Wu, J., Yin, X.: A Formal Framework to Interoperability Testing for Real-time Systems (submitted)Google Scholar

Copyright information

© IFIP International Federation for Information Processing 2006

Authors and Affiliations

  • Zhiliang Wang
    • 1
  • Jianping Wu
    • 1
  • Xia Yin
    • 1
  • Xingang Shi
    • 2
  • Beihang Tian
    • 1
  1. 1.Department of Computer Science and TechnologyTsinghua UniversityBeijingP.R. China
  2. 2.Network Research CenterTsinghua UniversityBeijingP.R. China

Personalised recommendations