Skip to main content

Testing Real-Time Systems Using TINA

  • Conference paper

Part of the Lecture Notes in Computer Science book series (LNCCN,volume 5826)

Abstract

The paper presents a technique for model-based black-box conformance testing of real-time systems using the Time Petri Net Analyzer TINA. Such test suites are derived from a prioritized time Petri net composed of two concurrent sub-nets specifying respectively the expected behaviour of the system under test and its environment.We describe how the toolbox TINA has been extended to support automatic generation of time-optimal test suites. The result is optimal in the sense that the set of test cases in the test suite have the shortest possible accumulated time to be executed. Input/output conformance serves as the notion of implementation correctness, essentially timed trace inclusion taking environment assumptions into account. Test cases selection is based either on using manually formulated test purposes or automatically from various coverage criteria specifying structural criteria of the model to be fulfilled by the test suite. We discuss how test purposes and coverage criterion are specified in the linear temporal logic SE-LTL, derive test sequences, and assign verdicts.

Keywords

  • Real-time system
  • Prioritized Time Petri Nets
  • conformance testing
  • time optimal test cases

References

  1. Adjir, N., De Saqui-Sanne, P., Rahmouni, M.K.: Génération des séquences de test temporisés à partir des réseaux de Petri temporels à chronomètres. In: NOTERE 2007, Maroc.

    Google Scholar 

  2. Alur, R., Dill, D.: A theory of timed automata. Theoretical Computer Science 126(2), 183–235 (1994)

    MathSciNet  CrossRef  MATH  Google Scholar 

  3. Bérard, B., Cassez, F., Haddad, S., Roux, O.H., et Lime, D.: Comparison of the Expressiveness of Timed Automata and Time Petri Nets. In: Pettersson, P., Yi, W. (eds.) FORMATS 2005. LNCS, vol. 3829, pp. 211–225. Springer, Heidelberg (2005)

    CrossRef  Google Scholar 

  4. Bérard, B., Cassez, F., Haddad, S., Lime, D., Roux, O.H.: When are timed automata weakly timed bisimilar to time Petri nets? In: Sarukkai, S., Sen, S. (eds.) FSTTCS 2005. LNCS, vol. 3821, pp. 273–284. Springer, Heidelberg (2005)

    CrossRef  Google Scholar 

  5. Berthomieu, B., Diaz, M.: Modelling and verification of time dependent systems using time Petri nets. IEEE transactions on software Engineering 17(3) (1991)

    Google Scholar 

  6. Berthomieu, B., Ribet, P.O., Vernadat, F.: The tool TINA – Construction of Abstract State Spaces for Petri Nets and Time Petri Nets. Inter. JPR 42(14) (July 2004)

    Google Scholar 

  7. Berthomieu, B., Peres, F., Vernadat, F.: Bridging the gap between Timed Automata and Bounded Time Petri Nets. In: Asarin, E., Bouyer, P. (eds.) FORMATS 2006. LNCS, vol. 4202, pp. 82–97. Springer, Heidelberg (2006)

    CrossRef  Google Scholar 

  8. Berthomieu, B., Peres, F., Vernadat, F.: Model Checking Bounded Prioritized Time Petri Nets. In: Namjoshi, K.S., Yoneda, T., Higashino, T., Okamura, Y. (eds.) ATVA 2007. LNCS, vol. 4762, pp. 523–532. Springer, Heidelberg (2007)

    CrossRef  Google Scholar 

  9. Berthomieu, B., Ribet, P.-O., Vernadat, F.: The tool TINA –construction of abstract state spaces for Petri nets and time Petri nets. IJPR 42(14), 2741–2756 (2004)

    CrossRef  MATH  Google Scholar 

  10. Berthomieu, B., et Vernadat, F.: State Space Abstractions for Time Petri Nets. In: Handbook of Real-Time and Embedded Systems. CRC Press, Boca Raton (2007)

    Google Scholar 

  11. Bouyer, P., Dufourd, C., Fleury, E., Petit, A.: Updatable timed automata. TCS 321(2–3), 291–345 (2004)

    MathSciNet  CrossRef  MATH  Google Scholar 

  12. Bouyer, P.: Forward Analysis of Updatable Timed Automata. FMSD 24(3), 281–320 (2004)

    MathSciNet  MATH  Google Scholar 

  13. Bouyer, P., Chevalier, F.: On conciseness of extensions of timed automata. JALC (2005)

    Google Scholar 

  14. Bouyer, P., Serge, H., Reynie, P.A.: Extended Timed Automata and Time Petri Nets. In: ACSD 2006, Turku, Finland, pp. 91–100. IEEE Computer Society Press, Los Alamitos (2006)

    Google Scholar 

  15. Braberman, V., Felder, M., Marre, M.: Testing timing behaviour of real-time software. In: Intern. Software Quality Week (1997)

    Google Scholar 

  16. Brinksma, E., Tretmans, J.: Testing transition systems: An annotated bibliography. In: Cassez, F., Jard, C., Rozoy, B., Dermot, M. (eds.) MOVEP 2000. LNCS, vol. 2067, p. 187. Springer, Heidelberg (2001)

    CrossRef  Google Scholar 

  17. Cardell-Oliver, R.: Conformance test experiments for distributed real-time systems. In: ISSTA 2002. ACM Press, New York (2002)

    Google Scholar 

  18. Cassez, F., Roux, O.H.: Structural translation from time Petri nets to timed automata. In: JSS 2006 (2006)

    Google Scholar 

  19. Chaki, S., Clarke, E.M., Ouaknine, J., Sharygina, N., Sinha, N.: State/Event-based Software Model Checking. In: Boiten, E.A., Derrick, J., Smith, G.P. (eds.) IFM 2004. LNCS, vol. 2999, pp. 128–147. Springer, Heidelberg (2004)

    CrossRef  Google Scholar 

  20. Choffrut, C., Goldwurm, M.: Timed automata with periodic clock constraints. JALC 5(4), 371–404 (2000)

    MathSciNet  MATH  Google Scholar 

  21. Cleaveland, R., Hennessy, M.: Testing Equivalence as a Bisimulation Equivalence. Formal Aspects of Computing 5, 1–20 (1993)

    CrossRef  MATH  Google Scholar 

  22. David, A., Hakansson, J., Larsen, K.G.: Model checking timed automata with priorities using DBM subtraction. In: Asarin, E., Bouyer, P. (eds.) FORMATS 2006. LNCS, vol. 4202, pp. 128–142. Springer, Heidelberg (2006)

    CrossRef  Google Scholar 

  23. Demichelis, F., Zielonka, W.: Controlled timed automata. In: Sangiorgi, D., de Simone, R. (eds.) CONCUR 1998. LNCS, vol. 1466, pp. 455–469. Springer, Heidelberg (1998)

    CrossRef  Google Scholar 

  24. de Vries, R., Tretmans, J.: On-the-fly conformance testing using SPIN. STTT 2(4), 382–393 (2000)

    CrossRef  MATH  Google Scholar 

  25. Diekert, V., Gastin, P., Petit, A.: Removing epsilon-Transitions in Timed Automata. In: Reischuk, R., Morvan, M. (eds.) STACS 1997. LNCS, vol. 1200, pp. 583–594. Springer, Heidelberg (1997)

    CrossRef  Google Scholar 

  26. En-Nouaary, A., Dssouli, R., Khendek, F., Elqortobi, A.: Timed test cases generation based on state characterization technique. In: RTSS 1998. IEEE, Los Alamitos (1998)

    Google Scholar 

  27. Fersman, E., Pettersson, P., Yi, W.: Timed automata with asynchronous processes: Schedulability and decidability. In: Katoen, J.-P., Stevens, P. (eds.) TACAS 2002. LNCS, vol. 2280, pp. 67–82. Springer, Heidelberg (2002)

    CrossRef  Google Scholar 

  28. Fernandez, J.C., Jard, C., Jéron, T., Viho, G.: Using on-the-fly verification techniques for the generation of test suites. In: Alur, R., Henzinger, T.A. (eds.) CAV 1996. LNCS, vol. 1102. Springer, Heidelberg (1996)

    Google Scholar 

  29. Khansa, W.: Réseaux de Petri P-temporels: contribution à l’étude des systèmes à événements discrets. université de Savoie, Annecy (1997)

    Google Scholar 

  30. Henzinger, T.A.: The theory of hybrid automata. In: Proc. LICS 1996, pp. 278–292. IEEE CSP, Los Alamitos (1996)

    Google Scholar 

  31. Hessel, A., Larsen, K.G., Nielsen, B., Pettersson, P., Skou, A.: Time-optimal real-time test case generation using UPPAAL. In: Petrenko, A., Ulrich, A. (eds.) FATES 2003. LNCS, vol. 2931, pp. 114–130. Springer, Heidelberg (2004)

    CrossRef  Google Scholar 

  32. Higashino, T., Nakata, A., Taniguchi, K., Cavalli, A.: Generating test cases for a timed I/O automaton model. In: IFIP Int’l Work, Test Comm. System. Kluwer, Dordrecht (1999)

    Google Scholar 

  33. Jéron, T., Morel, P.: Test generation derived from model-checking. In: Halbwachs, N., Peled, D.A. (eds.) CAV 1999. LNCS, vol. 1633, pp. 108–121. Springer, Heidelberg (1999)

    CrossRef  Google Scholar 

  34. Jéron, T., Rusu, V., Zinovieva, E.: STG: A symbolic test generation tool. In: Katoen, J.-P., Stevens, P. (eds.) TACAS 2002. LNCS, vol. 2280, p. 470. Springer, Heidelberg (2002)

    CrossRef  Google Scholar 

  35. Khoumsi, A., Jéron, T., Marchand, H.: Test cases generation for nondeterministic real-time systems. In: Petrenko, A., Ulrich, A. (eds.) FATES 2003. LNCS, vol. 2931, pp. 131–146. Springer, Heidelberg (2004)

    CrossRef  Google Scholar 

  36. Krichen, M., Tripakis, S.: An Expressive and Implementable Formal Framework for Testing Real Time Systems. In: Khendek, F., Dssouli, R. (eds.) TestCom 2005. LNCS, vol. 3502, pp. 209–225. Springer, Heidelberg (2005)

    Google Scholar 

  37. Lime, D., Roux, O.: State class timed automaton of a time Petri net. In: PNPM 2003, Urbana, USA, pp. 124–133. IEEE computer society, Los Alamitos (2003)

    Google Scholar 

  38. Lin, J.C., Ho, I.: Generating Real-Time Software Test Cases by Time Petri Nets. IJCA (EI journal) 22(3), 151–158 (2000)

    Google Scholar 

  39. Merlin, P.M., Farber, J.: Recoverability of communication protocols: Implications of a theoretical study. IEEE Trans. Com. 24(9), 1036–1043 (1976)

    MathSciNet  CrossRef  MATH  Google Scholar 

  40. Mikucionis, M., Larsen, K.G., Nielsen, B.: T-UPPAAL: Online Model-based Testing of Real-time Systems. In: 19th IEEE Internat. Conf. ASE, Linz, Austria, pp. 396–397 (2004)

    Google Scholar 

  41. Nielsen, B., Skou, A.: Automated test generation from timed automata. In: Margaria, T., Yi, W. (eds.) TACAS 2001. LNCS, vol. 2031, p. 343. Springer, Heidelberg (2001)

    CrossRef  Google Scholar 

  42. Peleska, J.: Formal methods for test automation hard real time testing of controllers for the airbus aircraft family. In: IDPT 2002 (2002)

    Google Scholar 

  43. Ramchadani, C.: Analysis of asynchronous concurrent systems by timed Petri nets, Cambridge, Mass, MIT, dept Electrical Engineering, Phd thesis (1992)

    Google Scholar 

  44. Lin, S.-W., Hsiung, P.-A., Huang, C.-H., Chen, Y.-R.: Model checking prioritized timed automata. In: Peled, D.A., Tsay, Y.-K. (eds.) ATVA 2005. LNCS, vol. 3707, pp. 370–384. Springer, Heidelberg (2005)

    CrossRef  Google Scholar 

  45. Springintveld, J., Vaandrager, F., D’Argenio, P.: Testing timed automata. TCS 254 (2001)

    Google Scholar 

  46. Tretmans, J.: Testing concurrent systems: A formal approach. In: Baeten, J.C.M., Mauw, S. (eds.) CONCUR 1999. LNCS, vol. 1664, pp. 46–65. Springer, Heidelberg (1999)

    CrossRef  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and Permissions

Copyright information

© 2009 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Adjir, N., De Saqui-Sannes, P., Rahmouni, K.M. (2009). Testing Real-Time Systems Using TINA. In: Núñez, M., Baker, P., Merayo, M.G. (eds) Testing of Software and Communication Systems. FATES TestCom 2009 2009. Lecture Notes in Computer Science, vol 5826. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-05031-2_1

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-05031-2_1

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-05030-5

  • Online ISBN: 978-3-642-05031-2

  • eBook Packages: Computer ScienceComputer Science (R0)