Skip to Main content Skip to Navigation
Journal articles

An hybrid method for feature selection based on multiobjective optimization and mutual information

Abstract : In this paper we propose a hybrid approach using mutual information and multi-objective optimization for feature subset selection problem. The hybrid aspect is due to the sequence of a filter method and a wrapper method in order to take advantages of both. The filter method reduces the exploration space by keeping subsets having good internal properties and the wrapper method chooses among the remaining subsets with a classification performances criterion. In the filter step, the subsets are evaluated in a multi-objective way to ensure diversity within the subsets. The evaluation is based on the mutual information to estimate the dependency between features and classes and the redundancy between features within the same subset. We kept the non-dominated (Pareto optimal) subsets for the second step. In the wrapper step, the selection is made according to the stability of the subsets regarding classification performances during learning stage on a set of classifiers to avoid the specialization of the selected subsets for a given classifiers. The proposed hybrid approach is experimented on a variety of reference data sets and compared to the classical feature selection methods FSDD and mRMR. The resulting algorithm outperforms these algorithms and the computation complexity remains acceptable even if it increases with regards to these two fast selection methods.
Complete list of metadatas

Cited literature [62 references]  Display  Hide  Download

https://hal.archives-ouvertes.fr/hal-01313378
Contributor : Enguerran Grandchamp <>
Submitted on : Wednesday, March 4, 2020 - 5:30:57 PM
Last modification on : Friday, March 6, 2020 - 1:02:27 AM

File

b_268-691-1-PB.pdf
Publisher files allowed on an open archive

Licence


Distributed under a Creative Commons Attribution 4.0 International License

Identifiers

Citation

Grandchamp Enguerran, Mohamed Abadi, Olivier Alata. An hybrid method for feature selection based on multiobjective optimization and mutual information. Journal of Informatics and Mathematical Sciences, RGN Publications, 2015, 7 (1), pp.21-48. ⟨10.26713/jims.v7i1.268⟩. ⟨hal-01313378⟩

Share

Metrics

Record views

148

Files downloads

4