Self Adaptive Support Vector Machine: A Multi-Agent Optimization Perspective

Abstract : Support Vector Machines (SVM) have been in the forefront of machine learning research for many years now. They have very nice theoretical properties and have proven to be efficient in many real life applications but the design of SVM training algorithms often gives rise to challenging optimization issues. We propose here to review the basics of Support Vector Machine learning from a multi-agent optimization perspective. Multi-agents systems break down complex optimization problems into elementary “oracle” tasks and perform a collaborative solving process resulting in a self-organized solution of the complex problems. We show how the SVM training problem can also be “tackled” from this point of view and provide several perspectives for binary classification, hyperparameters selection, multiclass learning as well as unsupervised learning. This conceptual work is illustrated through simple examples in order to convey the ideas and understand the behavior of agent cooperation. The proposed models provide simple formulations of complex learning tasks that are sometimes very difficult to solve with classical optimization strategies. The ideas that are discussed open up perspectives for the design of new distributed cooperative learning systems.
Document type :
Journal articles
Complete list of metadatas

Cited literature [29 references]  Display  Hide  Download

https://hal.archives-ouvertes.fr/hal-01387802
Contributor : Open Archive Toulouse Archive Ouverte (oatao) <>
Submitted on : Wednesday, October 26, 2016 - 10:39:25 AM
Last modification on : Friday, January 10, 2020 - 9:09:22 PM

File

couellan_15230.pdf
Files produced by the author(s)

Identifiers

Collections

Citation

Nicolas Couellan, Sophie Jan, Tom Jorquera, Jean-Pierre Georgé. Self Adaptive Support Vector Machine: A Multi-Agent Optimization Perspective. Expert Systems with Applications, Elsevier, 2015, 42 (9), pp.4284-4298. ⟨10.1016/j.eswa.2015.01.028⟩. ⟨hal-01387802⟩

Share

Metrics

Record views

192

Files downloads

413