Using k-means for redundancy and inconsistency detection: application to industrial requirements

Manel Mezghani (1, 2) , Juyeon Kang Choi (2) , Florence Sèdes (1, 3)

1 IRIT-SIG - Systèmes d’Informations Généralisées
2 Prometil (FRANCE)
3 UT3 - Université Toulouse III - Paul Sabatier

Requirements are usually “hand-written” and suffers from several problems like redundancy and inconsistency. These problems between requirements or sets of requirements impact negatively the success of final products. Manually processing these issues requires too much time and it is very costly. We propose in this paper to automatically handle redundancy and inconsistency issues in a classification approach. The main contribution of this paper is the use of k-means algorithm for redundancy and inconsistency detection in a new context, which is Requirements Engineering context. Also, we introduce a preprocessing step based on the Natural Language Processing techniques in order to see the impact of this latter to the k-means results. We use Part-Of-Speech (POS) tagging and noun chunking in order to detect technical business terms associated with the requirements documents that we analyze. We experiment this approach on real industrial datasets. The results show the efficiency of the k-means clustering algorithm, especially with the preprocessing.

Mots clés: K-means; Requirements engineering; POS tagging; Redundancy; Inconsistency

Domaines: Recherche d'information [cs.IR]

Manel Mezghani, Juyeon Kang Choi, Florence Sèdes. Using k-means for redundancy and inconsistency detection: application to industrial requirements. 23rd International conference on Applications of Natural Language Processing to Information Systems (NLDB 2018), Jun 2018, Paris, France. pp.501-508, ⟨10.1007/978-3-319-91947-8_52⟩. ⟨hal-02305354⟩