Training performance of echo state neural networks

Romain Couillet (1) , Gilles Wainrib (2) , Harry Sevi (3) , Hafiz Tiomoko Ali (1)

1 L2S - Laboratoire des signaux et systèmes
2 DI-ENS - Département d'informatique - ENS Paris
3 ENS de Lyon - École normale supérieure de Lyon

This article proposes a first theoretical performance analysis of the training phase of large dimensional linear echo-state networks. This analysis is based on advanced methods of random matrix theory. The results provide some new insights on the core features of such networks, thereby helping the practitioner when using them.

Domaines: Mathématiques [math]

Romain Couillet, Gilles Wainrib, Harry Sevi, Hafiz Tiomoko Ali. Training performance of echo state neural networks. 2016 IEEE Statistical Signal Processing Workshop (SSP), Jun 2016, Palma de Majorca, Spain. ⟨10.1109/ssp.2016.7551721⟩. ⟨hal-01633450v1⟩