HAL will be down for maintenance from Friday, June 10 at 4pm through Monday, June 13 at 9am. More information
Skip to Main content Skip to Navigation
Journal articles

An hybrid method for feature selection based on multiobjective optimization and mutual information

Abstract : In this paper we propose a hybrid approach using mutual information and multi-objective optimization for feature subset selection problem. The hybrid aspect is due to the sequence of a filter method and a wrapper method in order to take advantages of both. The filter method reduces the exploration space by keeping subsets having good internal properties and the wrapper method chooses among the remaining subsets with a classification performances criterion. In the filter step, the subsets are evaluated in a multi-objective way to ensure diversity within the subsets. The evaluation is based on the mutual information to estimate the dependency between features and classes and the redundancy between features within the same subset. We kept the non-dominated (Pareto optimal) subsets for the second step. In the wrapper step, the selection is made according to the stability of the subsets regarding classification performances during learning stage on a set of classifiers to avoid the specialization of the selected subsets for a given classifiers. The proposed hybrid approach is experimented on a variety of reference data sets and compared to the classical feature selection methods FSDD and mRMR. The resulting algorithm outperforms these algorithms and the computation complexity remains acceptable even if it increases with regards to these two fast selection methods.
Document type :
Journal articles
Complete list of metadata

Cited literature [62 references]  Display  Hide  Download

Contributor : Enguerran Grandchamp Connect in order to contact the contributor
Submitted on : Wednesday, March 4, 2020 - 5:30:57 PM
Last modification on : Wednesday, December 22, 2021 - 11:58:05 AM
Long-term archiving on: : Friday, June 5, 2020 - 3:34:02 PM


Publisher files allowed on an open archive


Distributed under a Creative Commons Attribution 4.0 International License



Grandchamp Enguerran, Mohamed Abadi, Olivier Alata. An hybrid method for feature selection based on multiobjective optimization and mutual information. Journal of Informatics and Mathematical Sciences, RGN Publications, 2015, 7 (1), pp.21-48. ⟨10.26713/jims.v7i1.268⟩. ⟨hal-01313378⟩



Record views


Files downloads