Automatic Software Diversity in the Light of Test Suites

Benoit Baudry 1 Simon Allier 1 Marcelino Rodriguez-Cancio 1 Martin Monperrus 2, 3
1 DiverSe - Diversity-centric Software Engineering
Inria Rennes – Bretagne Atlantique , IRISA-D4 - LANGAGE ET GÉNIE LOGICIEL
2 SPIRALS - Self-adaptation for distributed services and large software systems
Inria Lille - Nord Europe, CRIStAL - Centre de Recherche en Informatique, Signal et Automatique de Lille - UMR 9189
Abstract : A few works address the challenge of automating software diversification, and they all share one core idea: using automated test suites to drive diversification. However, there is is lack of solid understanding of how test suites, programs and transformations interact one with another in this process. We explore this intricate interplay in the context of a specific diversification technique called "sosiefication". Sosiefication generates sosie programs, i.e., variants of a program in which some statements are deleted, added or replaced but still pass the test suite of the original program. Our investigation of the influence of test suites on sosiefication exploits the following observation: test suites cover the different regions of programs in very unequal ways. Hence, we hypothesize that sosie synthesis has different performances on a statement that is covered by one hundred test case and on a statement that is covered by a single test case. We synthesize 24583 sosies on 6 popular open-source Java programs. Our results show that there are two dimensions for diversification. The first one lies in the specification: the more test cases cover a statement, the more difficult it is to synthesize sosies. Yet, to our surprise, we are also able to synthesize sosies on highly tested statements (up to 600 test cases), which indicates an intrinsic property of the programs we study. The second dimension is in the code: we manually explore dozens of sosies and characterize new types of forgiving code regions that are prone to diversification.
Type de document :
Pré-publication, Document de travail
11 pages, 4 figures, 8 listings, conference. 2015
Liste complète des métadonnées
Contributeur : Martin Monperrus <>
Soumis le : samedi 12 septembre 2015 - 07:40:09
Dernière modification le : mercredi 2 août 2017 - 10:10:56


  • HAL Id : hal-01198384, version 1
  • ARXIV : 1509.00144


Benoit Baudry, Simon Allier, Marcelino Rodriguez-Cancio, Martin Monperrus. Automatic Software Diversity in the Light of Test Suites. 11 pages, 4 figures, 8 listings, conference. 2015. <hal-01198384>



Consultations de la notice