Advertisement

Programming and Computer Software

, Volume 40, Issue 5, pp 296–304 | Cite as

Evolution of the UniTESK test development technology

  • V. V. KulyaminEmail author
  • A. K. Petrenko
Article

Abstract

The basic principles of UniTESK technology designed for constructing tests on the basis of formal models are presented. Experience in using UniTESK in large test development projects for software and hardware systems, including telecommunication protocols, basic and standard interfaces of operating systems, and microprocessor units, is summarized. The paper provides an overview of possible directions for the development of the technology with a view to providing higher scalability of test suites.

Keywords

Test Suite Finite Automaton Mobile IPv6 Model Base Testing Test Oracle 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Bourdonov, I., Kossatchev, A., Kuliamin, V., and Petrenko, A., UniTesK test suite architecture, Proceedings of FME’2002, Kopenhagen, Denmark, in Lecture Notes Comput. Sci., Springer, 2002, vol. 2391, pp. 77–88.CrossRefGoogle Scholar
  2. 2.
    Kulyamin, V.V., Petrenko, A.K., Kossatchev, A.S., and Burdonov, I.B., A UniTesK approach to the analysis of texts, Programmirovanie, 2003, vol. 29, no. 6, pp. 25–43.Google Scholar
  3. 3.
    ISO/IEC TR 19759 Software Engineering — Guide to the Software Engineering Body of Knowledge (SWEBOK), Geneva: ISO, 2005.Google Scholar
  4. 4.
    Baresi, L., and Young, M., Test Oracles, Tech. Report CIS-TR-01-02, 2001. http://www.cs.uoregon.edu/michal/pubs/oracles.html Google Scholar
  5. 5.
    Kulyamin V.V., Organization of complex test sets, Tr. Inst. Sist. Program., Ross. Akad. Nauk, 2009, vol. 17, pp. 9–24.Google Scholar
  6. 6.
    Meyer, B., Applying design by contract, IEEE Computer, 1992, vol. 25, no. 10, pp. 40–51.CrossRefGoogle Scholar
  7. 7.
    Bourdonov, I., Kossatchev, A., Petrenko, and Galter, D., KVEST: Automated generation of test suites from formal specifications, Proc. FM’99, Toulouse, France, in Lecture Notes Comput. Sci., Springer, 1999, vol. 1708, pp. 608–621.CrossRefGoogle Scholar
  8. 8.
    Bourdonov, I.B., Demakov, A.V., Jarov, A.A., Kossatchev, A.S., Kuliamin, V.V., Petrenko, A.K., and Zelenov, S.V., Java specification extension for automated test development, Proc. PSI’2001, Novosibirsk, Russia, in Lecture Notes Comput. Sci., Springer, 2001, vol. 2244, pp. 301–307.MathSciNetCrossRefGoogle Scholar
  9. 9.
    Klyuchnikov, G.V., Kossatchev, A.S., Pakulin, N.V., Petrenko, A.K., and Shnitman, V.Z., Using formal methods for testing an implementation of IPv6, Tr. Inst. Syst. Program., Ross. Akad. Nauk, 2003, vol. 4, pp. 121–140.Google Scholar
  10. 10.
    Kulyamin V.V., Component architecture of environment for model-based testing, Programmirovanie, 2010, vol. 36, no. 5, pp. 54–75.Google Scholar
  11. 11.
    Kuliamin V.V., Petrenko, A.K., Pakulin, N.V., Kossatchev, A.S., and Bourdonov, I.B., Integration of functional and timed testing of real-time and concurrent systems, Proc. PSI’2003, Novosibirsk, Russia, in Lecture Notes Comput. Sci., Springer, 2003, vol. 2890, pp. 450–461.CrossRefGoogle Scholar
  12. 12.
    Kuliamin, V., Petrenko, A., and Pakoulin, N., Practical approach to specification and conformance testing of distributed network applications, Proc. ISAS’2005, Berlin, Germany, in Lecture Notes Comput. Sci., Springer, 2005, vol. 3694, pp. 68–83.CrossRefGoogle Scholar
  13. 13.
    Khoroshilov, A.V., Specification and testing components with asynchronous interface, Cand. Sci. (Phys.-Math.) Dissertation, Moscow, 2006.Google Scholar
  14. 14.
    Bourdonov, I.B., Kossatchev, A.S., and Kuliamin, V.V., Application of finite automata to program testing, Programmirovanie, 2000, vol. 26, no. 2, pp. 61–73.MathSciNetGoogle Scholar
  15. 15.
    Bourdonov, I.B., Kossatchev, A.S., and Kuliamin, V.V., Irredundant algorithms for traversing directed graphs: Deterministic case, Programmirovanie, 2003, vol. 29, no. 5, pp. 59–69.Google Scholar
  16. 16.
    Zhu, H., Hall, P.A.V., and May, J.H.R, Software unit test coverage and adequacy, ACM Comput. Surv., 1997, vol. 29, no. 4, pp. 366–427.CrossRefGoogle Scholar
  17. 17.
    Grinevich, A., Khoroshilov, A., Kuliamin, V., Markovtsev, D., Petrenko, A., and Rubanov, V., Formal methods in industrial software standards enforcement, Proc. PSI’2006, Novosibirsk, Russia, in Lecture Notes Comput. Sci., Springer, 2006, vol. 4378, pp. 459–469.Google Scholar
  18. 18.
    Project OLVER, http://linuxtesting.org
  19. 19.
    Maksimov, A., Requirements-based conformance testing of ARINC 653 real-time operating systems, Proc. Data Systems in Aerospace (DASIA) 2010, ESA SP-682, 2010, ISBN 978-92-9221-246-9.Google Scholar
  20. 20.
    Klyuchnikov, G.V., Kossatchev, A.S., Pakulin, N.V., Petrenko, A.K., and Shnitman, V.Z., Application of formal methods for testing Mobile IPv6, Sbornik tezisov vtoroi mezhdunarodnoi konferentsii “Internet novogo pokoleniya” (Collection of Abstratcs of the 2-nd Int. Conf. “Internet of new generation”), Yaroslavl, 2003, pp. 20–25.Google Scholar
  21. 21.
    Ivannikov, V.P., Kamkin, A.S., Kossatchev, A.S., Kulyamin, V.V., and Petrenko, A.K., Application of contract specifications for representing requirements and functional testing of hardware models, Programmirovanie, 2007, vol. 33, no. 5, pp. 47–61.Google Scholar
  22. 22.
    Grieskamp, W., Microsoft’s protocol documentation program: A success story for model-based testing. Testing — practice and research techniques, in Lecture Notes Comput. Sci., Springer, 2010, vol. 6303, p. 7.CrossRefGoogle Scholar
  23. 23.
    Godefroid, P., Klarlund, N., and Sen, K., DART: Directed automated random testing, ACM SIGPLAN Notices — Proceedings of PLDI-2005, 2005, vol. 40, no. 6, pp. 213–223.Google Scholar
  24. 24.
    Sen, K., Marinov, D., and Agha, G., CUTE: A concolic unit testing engine for C, Proc. ESES/FSE, 2005, pp. 263–272.Google Scholar
  25. 25.
    Cadar, C., Ganesh, V., Pawloski, P., Dill, D., and Engler, D., EXE: Automatically generating inputs of death, Proc. 13-th Int. Conf. on Computer and Communications Security CCS, 2006, pp. 322–335.Google Scholar
  26. 26.
    Pacheco, C., Lahiri, S.K., Ernst, M.D., and Ball, T., Feedback-directed random test generation, Proc. Int. Conf. on Software Engineering, 2007, pp. 75–84.Google Scholar
  27. 27.
    Bourdonov, I.B., Groshev, S.G., Demakov, A.V., Kamkin, A.S., Kossatchev, A.S., and Sortov, A.A., Parallel testing of large model of automata, Vestn. NNGU, 2011, no. 3, pp. 187–193.Google Scholar
  28. 28.
    Bourdonov, I. and Kossatchev, A., Traversing an unknown graph by a group of automata, Trudy mezhdunarodnoi superkomp’yuternoi konferentsii “Nauchnyi servis v seti Internet: vse grani parallelizma” (Proc. Int. Supercomput. Conf. “Scientific service in Internet: All faces of parallelism”), 2013, pp. 228–232.Google Scholar
  29. 29.
    Flanagan, C. and Godefroid, P., Dynamic partial-order reduction for model checking software, ACM SIGPLAN Notices-Proceedings of POPL 2005, 2005, vol. 40, no. 1, pp. 110–121.Google Scholar
  30. 30.
    Yang, Y., Chen, X., Gopalakrishnan, G., and Kirby, R., Efficient stateful dynamic partial order reduction, Proc. SPIN 2008, in Lecture Notes Comput. Sci., Springer, 2008, vol. 5156, pp. 288–305.Google Scholar
  31. 31.
    Ivannikov, V.P., Petrenko, A.K., Kulyamin, V.V., and Maksimov A.V., Experience in using UniTESK as the mirror of the development of testing model-based technologies, Tr. Inst. Syst. Program., Ross. Akad. Nauk, 2013, vol. 23, pp. 207–218.Google Scholar
  32. 32.
    Bourdonov, I.B. and Kossatchev, A.S., Development of conformance theory: Semantics, Formal models, and algorithms, Tr. Inst. Syst. Program., Ross. Akad. Nauk,, 2014.Google Scholar
  33. 33.
    Gerlits, E.A., Kulyamin, V.V., Maksimov, A.V., Petrenko, A.K., Khoroshilov, A.V., and Tsyvarev, A.V., Testing operating systems, Tr. Inst. Syst. Program., Ross. Akad. Nauk, 2014.Google Scholar
  34. 34.
    Pakulin, N.V. and Shnitman, V.Z., Automation of conformance testing for telecommunication protocols, Tr. Inst. Syst. Program., Ross. Akad. Nauk, 2014.Google Scholar
  35. 35.
    Kamkin, A.S., Kotsynyak, A.M., Smolov, S.A., Tatarnikov, A.D., and Chupilko, M.M., Means for the functional verification of microprocessors, Tr. Inst. Syst. Program., Ross. Akad. Nauk, 2014.Google Scholar
  36. 36.
    Zelenov, S.V., Petrenko, A.K., Pakulin, N.V., Ugnenko, A.A., and Khoroshilov, A.V., Hardware design tools for systems of integrated modular avionics, Tr. Inst. Syst. Program., Ross. Akad. Nauk, 2014.Google Scholar
  37. 37.
    Pakulin, N.V. and Khoroshilov, A.V., Development of formal models and conformance testing for systems with asynchronous interfaces and telecommunication protocols, Programmirovanie, 2007, vol. 33, no. 6, pp. 26–55.Google Scholar
  38. 38.
    The Linux Foundation consortium. LSB certification test suite, http://ispras.linuxbase.org/index.php/LSB_Certification_System
  39. 39.
    Chupilko, M.M., Developing test systems of multi-modules hardware designs, Program. Comput. Software, 2012, vol. 38, no. 1, pp. 34–42.CrossRefGoogle Scholar
  40. 40.
    Zelenov, S.V. and Zelenova, S.A., Model-based testing of optimizing compilers, Proc. 19th IFIP TC6/WG6.1 Int. Conf. on Testing of Software and Communicating Systems — 7th International Workshop on Formal 2007), in Lecture Notes Comput. Sci., Berlin: Springer, 2007, vol. 4581, pp. 365–377.Google Scholar
  41. 41.
    Zelenov, S.V., Silakov, D.V., Petrenko, A.K., Conrad, M., and Fey I., Automatic test generation for model-based code generators, IEEE ISoLA 2006 Second Intern. Symposium on Leveraging Applications of Formal Methods, Verification and Validation, Paphos, Cyprus, 2006, pp. 68–75.Google Scholar
  42. 42.
    Kamkin, A.S., Method for automated imitative testing microprocessors with pipelined architecture on the basis of formal specifications, Cand. Sci. (Phys.-Math.) Dissertation, Moscow, 2009.Google Scholar
  43. 43.
    Kornykhin, E.V., Method for automated generation of test programs for the verification of MMU, Cand. Sci. (Phys.-Math.) Dissertation, Moscow, 2010.Google Scholar
  44. 44.
    Kamkin, A.S. and Tatarnikov, A., MicroTESK: An ADL-based reconfigurable test program generator for microprocessors, in Proc. 6th Spring/Summer Young Researchers’ Colloquium on Software Engineering (SYR-CoSE 2012), May 30–31, 2012, Perm, Russia, 2012.Google Scholar

Copyright information

© Pleiades Publishing, Ltd. 2014

Authors and Affiliations

  1. 1.Institute for Systems ProgrammingRussian Academy of SciencesMoscowRussia

Personalised recommendations