Verification of Safety Critical Embedded Systems
36 people from industry and academia attended this ICES-Prevas seminar at KTH on 7 March 2012.
A quick summary of each speaker's talk is given below, along with a copy of their presentation. Click here to see the Programme & Speakers Abstracts
"Model-based Testing (MBT) without Models", Karl Meinke (KTH)
The first speaker was Karl Meinke, who just finished teaching the Software Reliability course, which is mandatory for the embedded systems master program initiated by ICES. Meinke suggests that this course covers only about 30% of the test subject, due to lack of time.
One overall problem in testing is that while testing grows linearly, system-under-test grows exponentially with size. Meinke explained the concept of learning-based testing, where a system model is “reverse engineered” during testing. [ Presentation]
"Abnormal Testing of ECU’s", Roger Johansson (Prevas)
Johansson talked about testing of ECU:s, in automotive industry. Fault injection is one method that is used today. Johansson asked the question “How to test systems for a complete vehicle with 2000 signals?”, which was discussed in the workshop. [ Presentation]
"Qualification of Test Tools for Safety Critical Systems with Fault Injection and a Monitor", Viacheslav Izosimov (EIS by Semcon)
Qualification of tools for ISO26262. ISO26262 demands tools to be qualified, but the requirements on qualification of software tools, and in particular, test systems are weak and needs to be adopted. Existing approaches shift tool qualification to the product developer and are not practical for test systems.
One of the problems when certifying test tools is that the test tool needs to be adapted to the system-under-test, which makes the certification invalid. The test system is itself safety critical. One solution would be to develop a monitor “police-of-the-police”, which is much simpler, and could be validated. This concept is combined with fault injection. Internal tool support for automating qualification process is necessary to reduce qualification effort and ensure completeness of the tool qualification. [ Presentation]
"Efficient Test Design for Industry", Sigrid Eldh (Ericsson & Karlstad University, KAU)
Eldh talked about the state-of-practice in testing, it is generally not emphasized in universities. In industry, agile methods are popular nowadays, where testing is not an explicit phase. Hardware needs to be designed for test, and this is true for software as well, but not done in practice. Main confusions: Execution of a system vs Test of a System. In industry 90% do not “know” test design techniques and cannot apply them, although they claim that they can. Only 2% know what Statement coverage is. Model-based testing has to be made simpler to be used in industry. [ Presentation]
