Don't Judge Software by Its (Code) Coverage

Rolf Johansson (1) , Hans Eriksson (1) , Hans Svensson (2) , Kenneth Östberg (1) , Thomas Arts (2) , Alex Gerdes (2) , Martin Skoglund (1)

1 Electronics / Software
2 Quviq AB

This position paper argues that using code coverage metrics to evaluate the completeness of test cases as prescribed by e.g. ISO26262, is insufficient in a safety context. On the other hand it is impossible to execute test cases that achieve 100% completeness with respect to all possible input data combinations testing all requirements. We propose that existing requirements on code coverage shall be extended with requirements on 100% coverage of the safety requirements. As an example, the paper illustrates how this can be done for the AUTOSAR end-to-end protection library.

Mots clés: Safety; Embedded systems; Coverage metrics; Safety arguing; Automotive; ISO 26262; AUTOSAR

Domaines: Systèmes embarqués

Rolf Johansson, Hans Eriksson, Hans Svensson, Kenneth Östberg, Thomas Arts, et al.. Don't Judge Software by Its (Code) Coverage. SAFECOMP 2013 - Workshop CARS (2nd Workshop on Critical Automotive applications : Robustness & Safety) of the 32nd International Conference on Computer Safety, Reliability and Security, Sep 2013, Toulouse, France. pp.NA. ⟨hal-00848458⟩