The worst-case execution time tool challenge 2006 | International Journal on Software Tools for Technology Transfer Skip to main content

Advertisement

Springer Nature Link
Log in

The worst-case execution time tool challenge 2006

  • Regular Contribution
  • Published:
International Journal on Software Tools for Technology Transfer Aims and scope Submit manuscript

Abstract

The first international worst-case execution time (WCET) Tool Challenge in 2006 used benchmark programs to evaluate academic and commercial WCET tools. It aimed to study the state-of-the-art in WCET analysis. The WCET Tool Challenge comprised two parallel evaluation approaches: an internal evaluation by the respective tool developers and an external test by a neutral person of an independent institute. The latter was conducted by the author of this paper. Focusing on the external test, we describe the rules, benchmarks, participants and discuss the obtained results.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
¥17,985 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price includes VAT (Japan)

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. aiT. http://www.absint.de/ait/

  2. Altium Tasking Compiler. http://www.altium.com/TASKING/

  3. ARM9. http://www.arm.com/products/CPUs/families/ARM9Family.html

  4. ASCET. http://www.etas.com/de/products/ascet_software_products.php

  5. Bound-T. http://www.tidorum.fi/bound-t/

  6. C-Lab. http://www.c-lab.de/

  7. Chronos. http://www.comp.nus.edu.sg/~rpembed/chronos/

  8. Cosmic. http://www.cosmicsoftware.com/

  9. CPLEX. http://www.ilog.com/products/cplex/

  10. Freescale MPC565. http://www.freescale.com/webapp/sps/site/prod_summary.jsp?code=MPC565

  11. Gaisler BCC Compiler. http://gaisler.com/doc/bcc.pdf

  12. GNU C Compiler. http://gcc.gnu.org/

  13. Graphviz. http://www.graphviz.org/

  14. H8/300. http://eu.renesas.com/fmwk.jsp?cnt=h8300_series_landing.jsp&fp=/products/mpumcu/h8_family/h8300_series/

  15. HCS12. http://www.freescale.com/webapp/sps/site/overview.jsp?nodeId=02Wcbf8WD69BXm

  16. IAR. http://www.iar.com/

  17. Infineon. http://www.infineon.com/cms/en/product/channel.html?channel=ff80808112ab681d0112ab6b2f42075b

  18. ISO9241. http://en.wikipedia.org/wiki/ISO_9241

  19. Mälardalen Benchmarks http://www.mrtc.mdh.se/projects/wcet/sweet.html

  20. Matlab/Simulink. http://www.mathworks.com

  21. MIPS. http://www.mips.com/

  22. PapaBench. http://www.irit.fr/recherches/ARCHI/MARCH/rubri-que.php3?id_rubrique=97/

  23. Paparazzi Project. http://paparazzi.enac.fr/wiki/index.php/Main_Page

  24. SCADE. http://www.esterel-technologies.com/products/scade-suite/

  25. SimpleScalar. http://www.simplescalar.com/

  26. SPARCV7/V8. http://www.sparc.org/specificationsDownload.html

  27. SPEC95. http://www.spec.org/cpu95/

  28. SWEET. http://www.mrtc.mdh.se/projects/wcet/sweet.html

  29. TMS470. http://focus.ti.com/mcu/docs/mcuprodoverview.tsp?sectionId=95&tabId=203familyId=454

  30. WCET Discussion Group. http://tech.groups.yahoo.com/group/wcet/

  31. WindRiver Compiler. http://www.windriver.com/products/development_suite/wind_river_compiler/.

  32. WCET Tool Challenge 2006. Internet, 2006. http://www.idt.mdh.se/personal/jgn/challenge/.

  33. Berkelaar, M.: lp solve: A mixed integer linear program solver. Tech. rep., Eindhoven University of Technology (1997)

  34. Engblom, J.: Processor Pipelines and Static Worst-Case Execution Time Analysis. PhD Thesis, Uppsala University

  35. Ferdinand, C.: Cache Behavior Prediction for Real-Time Systems. PhD Thesis, Universität des Saarlandes (1997) http://rw4.cs.uni-sb.de/~ferdi/publications.html

  36. Gustafsson, J.: The WCET Tool Challenge 2006. In: Steffen Tiziana Margaris, B., Philippeu, A. (eds.) Second International Symposium on Leveraging Applications of Formal Methods (ISOLA’06), pp. 233–240, November 2007

  37. Harel D.: Statecharts: A visual formalism for complex systems. Sci. Comput. Program. 8(3), 231–274 (1987)

    Article  MATH  MathSciNet  Google Scholar 

  38. Seoul National University Real-Time Research Group. SNU-RT. http://realtime.snu.ac.kr/realtime/

  39. University of Maryland. The Omega project. http://www.cs.umd.edu/projects/omega/

  40. Tan, L.: The Worst-Case Execution Time Tool Challenge 2006: The External Test. In: Steffen Tiziana Margaris, B., Philippeu, A., (eds.) Second International Symposium on Leveraging Applications of Formal Methods (ISOLA’06), pp. 241–248, November 2007

  41. Wenzel, I., Kirner, R., Rieder, B., Puschner, P.P.: Measurement-Based Worst-Case Execution Time Analysis. In: SEUS, pp. 7–10. IEEE Computer Society, New York (2005)

  42. Wenzel, I., Rieder, B., Kirner, R., Puschner, P.: Automatic timing model generation by cfg partitioning and model checking. In: DATE ’05: Proceedings of the conference on Design, Automation and Test in Europe, pp. 606–611, Washington, DC, USA. IEEE Computer Society, New York (2005)

  43. Wilhelm R., Engblom J., Ermedahl A., Holsti N., Thesing S., Whalley D., Bernat G., Ferdinand C., Heckmann R., Mitra T., Mueller F., Puaut I., Puschner P., Staschulat J., Stenström P.: The worst-case execution-time problem—overview of methods and survey of tools. Trans. Embedded Comput. Syst. 7(3), 1–53 (2008)

    Article  Google Scholar 

  44. Wilhelm, R., Engblom, J., Thesing, S., Whalley, D.B.: Industrial Requirements for WCET Tools—Answers to the ARTIST Questionnaire. In: Gustafsson, J. (ed.) WCET, volume MDH-MRTC-116/2003-1-SE, pp. 39–43. Department of Computer Science and Engineering, Mälardalen University, Västerås, Sweden (2003)

Download references

Author information

Authors and Affiliations

  1. ICB/Computer Science, Dependability of Computing Systems, University of Duisburg-Essen, Duisburg, Germany

    Lili Tan

Authors
  1. Lili Tan
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Lili Tan.

Additional information

This work was supported by the ARTIST2 European Network of Excellence.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Tan, L. The worst-case execution time tool challenge 2006. Int J Softw Tools Technol Transfer 11, 133–152 (2009). https://doi.org/10.1007/s10009-008-0095-9

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10009-008-0095-9

Keywords

Search

Navigation