Abstract
Production code generation with Model-Based Design has successfully replaced manual coding across various industries and application domains. Furthermore, code generated from executable graphical models is increasingly being deployed in high-integrity embedded applications.
To validate the model-to-code translation process, generated software components and its precursory stages (i.e. models) should be subjected to an appropriate combination of quality assurance measures. For high-integrity applications, compliance with safety standards such as IEC 61508 needs to be demonstrated as well.
On principle, translation validation of generated code could be carried out in the same manner as for manually written code. However, this would not leverage the advantages of Model-Based Design and w.r.t. process efficiency this would leave something to be desired. Therefore, engineering methods and tools for effective and efficient translation validation of generated code are highly desirable. As a step towards this goal, a workflow for verification and validation of models and generated code will be proposed and as far as possible mapped onto the objectives of IEC 61508-3. A cornerstone of this workflow is testing for numerical equivalence between models and generated code.
Similar content being viewed by others
References
Aldrich W (2001) Coverage analysis for model-based design tools. In: TCS 2001
Arthur D Little (2007) Kosten-/Nutzenanalyse der modellbasierten Softwareentwicklung im Automobil
Baresel A, Conrad M, Sadeghipour S, Wegener J (2003) The interplay between model coverage and code coverage. In: 11th Eur int conf on software testing, analysis and review (EuroSTAR ’03), Amsterdam, Netherlands
Burnard A (2004) Verifying and validating automatically generated code. In: Int automotive conference (IAC ’04), Stuttgart, Germany, pp 71–78
Conrad M (2004) Modell-basierter Test eingebetteter Software im Automobil: Auswahl und Beschreibung von Testszenarien. PhD Thesis, Deutscher Universitätsverlag, Wiesbaden, Germany
Conrad M (2007) Using Simulink and Real-Time Workshop Embedded Coder for safety-critical automotive applications. In: Proc workshop modellbasierte Entwicklung eingebetteter Systeme III (MBEES’07), Schloß Dagstuhl, Germany, pp 41–50
Conrad M (2008) Model-based design for IIEC 61508: towards translation validation of generated code. In: Proc workshop automotive software engineering: Forschung, Lehre, Industrielle Praxis, co-located with software engineering 2008, Munich, February 2008
Conrad M, Dörr H (2006) Model-based development of in-vehicle software. In: Proc conf on design, automation and test in Europe (DATE ’06), Munich, Germany, pp 89–90
Conrad M, Fey I, Grochtmann M, Klein T (2005) Modellbasierte Entwicklung eingebetteter Fahrzeugsoftware bei DaimlerChrysler. Inf Forsch Entwickl 20(1–2):3–10
Conrad M, Sadeghipour S, Wiesbrock H (2006) Automatic evaluation of ECU software tests. SAE 2005 Transactions, Journal of Passenger Cars—Mechanical Systems, SAE Paper 2005-01-1659, SAE International, March 2006
Edwards PD (1999) The use of automatic code generation tools in the development of safety-related embedded systems. In: Proc vehicle electronic systems, ERA Report 99-0484
Erkkinen T, Conrad M (2007) Safety-critical software development using automatic production code generation. In: Proc SAE World congress 2007, Detroit, USA. www.mathworks.com/company/pressroom/articles/article18304.html
Fey I, Müller J, Conrad M (2008) Model-based design for safety-related applications. SAE Tech Paper 2008-21-0033, Convergence 2008, Detroit, MI, USA
IEC 61508-3:1998 (1998) Int standard functional safety of electrical/electronic/programmable electronic safety-related systems—part 3: software requirements, 1st edn
IT Power Consultants: MEval product page. www.itpower.de/28-1-MEval.html
Jablonski T, Schumann H, Busse C, Haussmann H, Hallmann U, Dreyer D, Schöttler F (2008) Die neue elektromechanische Lenkung APA-BS. ATZelektronik 3(01):30–35
MISRA-C:2004 (2004) Guidelines for the use of the C language in critical systems. MIRA
Mosterman PJ (2006) Automatic code generation: facilitating new teaching opportunities in engineering education. In: 36th annual ASEE/IEEE frontiers in education conf, San Diego, USA, pp 1–6
Pnueli A, Siegel M, Singerman E (1998) Translation validation. In: Proc 4th int conf on tools and algorithms for the construction and analysis of systems (TACAS’98), Lisbon, Portugal, pp 151–166
Pofahl E, Sauer T, Busa O (2007) AVS—a test suite for automatically generated code. In: MathWorks automotive conference (MAC ’07), Dearborn, USA
Potter B (2004) Use of The MathWorks Tool Suite to develop DO-178b certified code. In: ERAU/FAA software tools forum, Daytona Beach, USA
Schneider S, Slotosch O (2007) A validation suite for model-based development tools. In: 10th int conf on quality engineering in software technology (CONQUEST 2007), Potsdam, Germany
Schneider S, Lovric T, Mai PS (2009) The validation suite approach to saftey qualification of tools. SAE World Congress 2009, Detroit, MI, USA. SAE Tech Paper 2009-01-0746
Smith DJ, Simpson KGL (2001) Functional safety—a straightforward guide to applying IEC 61508 and related standards. Butterworth-Heinemann, London
Stürmer I (2006) Systematic testing of code generation tools—a test suite-oriented approach for safeguarding automatic code generation. TU Berlin, Germany
Stürmer I, Conrad M (2003) Test suite design for code generation tools. In: 18th IEEE int conf on automated software engineering (ASE ’03), Montreal, Canada
Stürmer I, Conrad M (2005) Ein Testverfahren für optimierende Codegeneratoren. Inf Forsch Entwickl 19(4):213–223
Stürmer I, Weinberg D, Conrad M (2005) Overview of existing safeguarding techniques for automatically generated code. In: 2th int ICSE workshop on software engineering for automotive systems (SEAS ’05), St Louis, USA
Stürmer I, Conrad M, Dörr H, Pepper P (2007) Systematic testing of model-based code generators. IEEE Trans Softw Eng 622–634
The MathWorks, Inc (2005) Alstom generates production code for safety-critical power converter control systems. June 2005. www.mathworks.com/products/rtwembedded/userstories.html?file=10591
The MathWorks, Inc (2008) The MathWorks Real-Time Workshop Embedded Coder certified by TÜV SÜD automotive GmbH. Press release, August 2008
The MathWorks, Inc (2009) Model-Based Design web page. www.mathworks.com/applications/controldesign/description
The Mathworks, Inc (2009) Application-specific verification and validation of models and generated code. V1.3
The MathWorks, Inc: Embedded MATLABTM page. www.mathworks.com/products/featured/embeddedmatlab
The MathWorks, Inc: IEC Certification Kit product page. www.mathworks.com/products/iec-61508
The MathWorks, Inc: Real-Time Workshop® Embedded CoderTM product page. www.mathworks.com/products/rtwembedded
The MathWorks, Inc: Stateflow® product page. www.mathworks.com/products/stateflow
The MathWorks, Inc: Simulink® product page. www.mathworks.com/products/simulink
The MathWorks, Inc: Simulink® Fixed Point™ product page. www.mathworks.com/products/simfixed
The MathWorks, Inc: Simulink® Verification and Validation™ product page. www.mathworks.com/products/simverification
The MathWorks, Inc: Simulink® Design Verifier™ product page. www.mathworks.com/products/sldesignverifier
Toeppe S, Ranville S, Bostic D, Wang Y (1999) Practical validation of model based code generation for automotive applications. In: 18th AIAA/IEEE/SAE digital avionics system conference
TÜV Rheinland (2005) Validation of the MathWorks code generator Real-Time Workshop® Embedded Coder with the Autocode Validation Suite (AVS) v3.0. Report No. 968/EL 211.02/05
TÜV Rheinland (2008) Validation of the MathWorks Real-Time Workshop® Embedded CoderTM product with the Automotive Code Validation Suite (AVS) v4.0. Report No. 968/EL 525.00/08
Zelenov SV, Petrenko AK, Conrad M, Fey I (2006) Automatic test generation for model-based code generators. In: 2th int symposium on leveraging applications of formal methods, verification and validation (ISoLA ’06), Paphos, Cyprus
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Conrad, M. Testing-based translation validation of generated code in the context of IEC 61508. Form Methods Syst Des 35, 389–401 (2009). https://doi.org/10.1007/s10703-009-0082-0
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10703-009-0082-0