Deep learning in spiking neural networks - Archive ouverte HAL Accéder directement au contenu
Article Dans Une Revue Neural Networks Année : 2019

Deep Learning in Spiking Neural Networks

Deep learning in spiking neural networks

Saeed Reza Kheradpisheh
Amirhossein Tavanaei
  • Fonction : Auteur
  • PersonId : 1090412
Masoud Ghodrati
  • Fonction : Auteur
  • PersonId : 1090413
Saeed Reza Kheradpisheh
Anthony Maida
  • Fonction : Auteur
  • PersonId : 1090414

Résumé

In recent years, deep learning has revolutionized the field of machine learning, for computer vision in particular. In this approach, a deep (multilayer) artificial neural network (ANN) is trained, most often in a supervised manner using backpropagation. Vast amounts of labeled training examples are required, but the resulting classification accuracy is truly impressive, sometimes outperforming humans. Neurons in an ANN are characterized by a single, static, continuous-valued activation. Yet biological neurons use discrete spikes to compute and transmit information, and the spike times, in addition to the spike rates, matter. Spiking neural networks (SNNs) are thus more biologically realistic than ANNs, and are arguably the only viable option if one wants to understand how the brain computes at the neuronal description level. The spikes of biological neurons are sparse in time and space, and event-driven. Combined with bio-plausible local learning rules, this makes it easier to build low-power, neuromorphic hardware for SNNs. However, training deep SNNs remains a challenge. Spiking neurons’ transfer function is usually non-differentiable, which prevents using backpropagation. Here we review recent supervised and unsupervised methods to train deep SNNs, and compare them in terms of accuracy and computational cost. The emerging picture is that SNNs still lag behind ANNs in terms of accuracy, but the gap is decreasing, and can even vanish on some tasks, while SNNs typically require many fewer operations and are the better candidates to process spatio-temporal data.
Fichier principal
Vignette du fichier
180408150.pdf (2.64 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-02341924 , version 1 (08-02-2021)

Identifiants

Citer

Saeed Reza Kheradpisheh, Amirhossein Tavanaei, Masoud Ghodrati, Saeed Reza Kheradpisheh, Timothée Masquelier, et al.. Deep learning in spiking neural networks. Neural Networks, 2019, 111, pp.47--63. ⟨10.1016/j.neunet.2018.12.002⟩. ⟨hal-02341924⟩
83 Consultations
231 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More