The CARE Platform for the Analysis of Behavior Model Inference Techniques

Sylvain Lamprier 1 Nicolas Baskiotis 1 Tewfik Ziadi 2 Lom Messan Hillah 2
1 MLIA - Machine Learning and Information Access
LIP6 - Laboratoire d'Informatique de Paris 6
2 MoVe - Modélisation et Vérification
LIP6 - Laboratoire d'Informatique de Paris 6
Abstract : Context: Finite State Machine (FSM) inference from execution traces has received a lot of attention over the past few years. Various approaches have been explored, each holding different properties for the resulting models, but the lack of standard benchmarks limits the ability of comparing the proposed techniques. Evaluation is usually performed on a few case studies, which is useful for assessing the feasibility of the algorithm on particular cases, but fails to demonstrate effectiveness in a broad context. Consequently, understanding the strengths and weaknesses of inference techniques remains a challenging task. Objective: This paper proposes CARE, a general, approach-independent, platform for the intensive evaluation of FSM inference techniques. Method: Grounded in a program specification scheme that provides a good control on the expected program structures, it allows the production of large benchmarks with well identified properties. Results: The CARE platform demonstrates the following features: (1) providing a benchmarking mechanism for FSM inference techniques, (2) allowing analysis of existing techniques w.r.t. a class of programs and/or behaviors, and (3) helping users in choosing the best suited approach for their objective. Moreover, our extensive experiments on different FSM inference techniques highlight that they do not behave in the same manner on every class of program. Characterizing different classes of programs thus helps understanding the strengths and weaknesses of the studied techniques. Conclusion: Experiments reported in this paper show examples of use cases that demonstrate the ability of the platform to generate large and diverse sets of programs, which allows to carry out meaningful inference techniques analysis. The analysis strategies the CARE platform offers open new opportunities for program behavior learning, particularly in conjunction with model checking techniques. The CARE platform is available at http://care.lip6.fr.
Type de document :
Article dans une revue
Information and Software Technology, Elsevier, 2015, 60, pp.32-50. 〈10.1016/j.infsof.2014.12.004〉
Liste complète des métadonnées

https://hal.archives-ouvertes.fr/hal-01176438
Contributeur : Lip6 Publications <>
Soumis le : mercredi 15 juillet 2015 - 13:58:24
Dernière modification le : lundi 29 mai 2017 - 14:21:50

Identifiants

Collections

Citation

Sylvain Lamprier, Nicolas Baskiotis, Tewfik Ziadi, Lom Messan Hillah. The CARE Platform for the Analysis of Behavior Model Inference Techniques. Information and Software Technology, Elsevier, 2015, 60, pp.32-50. 〈10.1016/j.infsof.2014.12.004〉. 〈hal-01176438〉

Partager

Métriques

Consultations de la notice

99