End-to-End Active Learning for Computer Security Experts

Anaël Beaugnon (1, 2, 3) , Pierre Chifflier (1) , Francis Bach (3, 2)

1 ANSSI - Agence nationale de la sécurité des systèmes d'information
2 SIERRA - Statistical Machine Learning and Parsimony
3 LIENS - Laboratoire d'informatique de l'école normale supérieure

Labelling a dataset for supervised learning is particularly expensive in computer security as expert knowledge is required for annotation. Some research works rely on active learning to reduce the labelling cost, but they often assimilate annotators to mere oracles providing ground-truth labels. Most of them completely overlook the user experience while active learning is an interactive procedure. In this paper, we introduce an end-to-end active learning system, ILAB, tailored to the needs of computer security experts. We have designed the active learning strategy and the user interface jointly to effectively reduce the annotation effort. Our user experiments show that ILAB is an efficient active learning system that computer security experts can deploy in real-world annotation projects.

Domaines: Intelligence artificielle [cs.AI]; Apprentissage [cs.LG]; Cryptographie et sécurité [cs.CR]; Interface homme-machine [cs.HC]

Anaël Beaugnon, Pierre Chifflier, Francis Bach. End-to-End Active Learning for Computer Security Experts. AAAI Workshop on Artificial Intelligence for Cyber Security (AICS), Feb 2018, New Orleans, United States. ⟨hal-01888976⟩