The worst-case execution time tool challenge 2006

Regular Contribution

Abstract

The first international worst-case execution time (WCET) Tool Challenge in 2006 used benchmark programs to evaluate academic and commercial WCET tools. It aimed to study the state-of-the-art in WCET analysis. The WCET Tool Challenge comprised two parallel evaluation approaches: an internal evaluation by the respective tool developers and an external test by a neutral person of an independent institute. The latter was conducted by the author of this paper. Focusing on the external test, we describe the rules, benchmarks, participants and discuss the obtained results.

Keywords

Timing analysis Worst-case execution time WCET Hard real time Embedded systems 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
  2. 2.
    Altium Tasking Compiler. http://www.altium.com/TASKING/
  3. 3.
  4. 4.
  5. 5.
  6. 6.
  7. 7.
  8. 8.
  9. 9.
  10. 10.
  11. 11.
    Gaisler BCC Compiler. http://gaisler.com/doc/bcc.pdf
  12. 12.
    GNU C Compiler. http://gcc.gnu.org/
  13. 13.
  14. 14.
  15. 15.
  16. 16.
  17. 17.
  18. 18.
  19. 19.
  20. 20.
    Matlab/Simulink. http://www.mathworks.com
  21. 21.
  22. 22.
  23. 23.
  24. 24.
  25. 25.
  26. 26.
  27. 27.
  28. 28.
  29. 29.
  30. 30.
  31. 31.
  32. 32.
    WCET Tool Challenge 2006. Internet, 2006. http://www.idt.mdh.se/personal/jgn/challenge/.
  33. 33.
    Berkelaar, M.: lp solve: A mixed integer linear program solver. Tech. rep., Eindhoven University of Technology (1997)Google Scholar
  34. 34.
    Engblom, J.: Processor Pipelines and Static Worst-Case Execution Time Analysis. PhD Thesis, Uppsala UniversityGoogle Scholar
  35. 35.
    Ferdinand, C.: Cache Behavior Prediction for Real-Time Systems. PhD Thesis, Universität des Saarlandes (1997) http://rw4.cs.uni-sb.de/~ferdi/publications.html
  36. 36.
    Gustafsson, J.: The WCET Tool Challenge 2006. In: Steffen Tiziana Margaris, B., Philippeu, A. (eds.) Second International Symposium on Leveraging Applications of Formal Methods (ISOLA’06), pp. 233–240, November 2007Google Scholar
  37. 37.
    Harel D.: Statecharts: A visual formalism for complex systems. Sci. Comput. Program. 8(3), 231–274 (1987)MATHCrossRefMathSciNetGoogle Scholar
  38. 38.
    Seoul National University Real-Time Research Group. SNU-RT. http://realtime.snu.ac.kr/realtime/
  39. 39.
    University of Maryland. The Omega project. http://www.cs.umd.edu/projects/omega/
  40. 40.
    Tan, L.: The Worst-Case Execution Time Tool Challenge 2006: The External Test. In: Steffen Tiziana Margaris, B., Philippeu, A., (eds.) Second International Symposium on Leveraging Applications of Formal Methods (ISOLA’06), pp. 241–248, November 2007Google Scholar
  41. 41.
    Wenzel, I., Kirner, R., Rieder, B., Puschner, P.P.: Measurement-Based Worst-Case Execution Time Analysis. In: SEUS, pp. 7–10. IEEE Computer Society, New York (2005)Google Scholar
  42. 42.
    Wenzel, I., Rieder, B., Kirner, R., Puschner, P.: Automatic timing model generation by cfg partitioning and model checking. In: DATE ’05: Proceedings of the conference on Design, Automation and Test in Europe, pp. 606–611, Washington, DC, USA. IEEE Computer Society, New York (2005)Google Scholar
  43. 43.
    Wilhelm R., Engblom J., Ermedahl A., Holsti N., Thesing S., Whalley D., Bernat G., Ferdinand C., Heckmann R., Mitra T., Mueller F., Puaut I., Puschner P., Staschulat J., Stenström P.: The worst-case execution-time problem—overview of methods and survey of tools. Trans. Embedded Comput. Syst. 7(3), 1–53 (2008)CrossRefGoogle Scholar
  44. 44.
    Wilhelm, R., Engblom, J., Thesing, S., Whalley, D.B.: Industrial Requirements for WCET Tools—Answers to the ARTIST Questionnaire. In: Gustafsson, J. (ed.) WCET, volume MDH-MRTC-116/2003-1-SE, pp. 39–43. Department of Computer Science and Engineering, Mälardalen University, Västerås, Sweden (2003)Google Scholar

Copyright information

© Springer-Verlag 2009

Authors and Affiliations

  1. 1.ICB/Computer Science, Dependability of Computing SystemsUniversity of Duisburg-EssenDuisburgGermany

Personalised recommendations