Skip to Main content Skip to Navigation
Conference papers

Random matrices meet machine learning: A large dimensional analysis of LS-SVM

Abstract : This article proposes a performance analysis of kernel least squares support vector machines (LS-SVMs) based on a random matrix approach, in the regime where both the dimension of data p and their number n grow large at the same rate. Under a two-class Gaussian mixture model for the input data, we prove that the LS-SVM decision function is asymptotically normal with means and covariances shown to depend explicitly on the derivatives of the kernel function. This provides improved understanding along with new insights into the internal workings of SVM-type methods for large datasets.
Document type :
Conference papers
Complete list of metadatas

Cited literature [9 references]  Display  Hide  Download

https://hal.archives-ouvertes.fr/hal-01957749
Contributor : Romain Couillet <>
Submitted on : Tuesday, May 19, 2020 - 4:41:51 PM
Last modification on : Wednesday, September 16, 2020 - 4:50:55 PM

File

couillet_randomRMT4LSSVM.pdf
Files produced by the author(s)

Identifiers

Citation

Zhenyu Liao, Romain Couillet. Random matrices meet machine learning: A large dimensional analysis of LS-SVM. The 42nd IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP 2017), 2017, New Orleans, United States. ⟨10.1109/icassp.2017.7952586⟩. ⟨hal-01957749⟩

Share

Metrics

Record views

90

Files downloads

33