Skip to Main content Skip to Navigation
Journal articles

Learning Spatial Invariance with the Trace Rule in Nonuniform Distributions

Abstract : Convolutional models of object recognition achieve invariance to spatial transformations largely because of the use of a suitably defined pooling operator. This operator typically takes the form of a max or average function defined across units tuned to the same feature. As a model of the brain's ventral pathway, where computations are carried out by weighted synaptic connections, such pooling can lead to spatial invariance only if the weights that connect similarly tuned units to a given pooling unit are of approximately equal strengths. How identical weights can be learned in the face of nonuniformly distributed data remains unclear. In this letter, we show how various versions of the trace learning rule can help solve this problem. This allows us in turn to explain previously published results and make recommendations as to the optimal rule for invariance learning.
Document type :
Journal articles
Complete list of metadata

https://hal.archives-ouvertes.fr/hal-01439658
Contributor : Jean-Baptiste Melmi Connect in order to contact the contributor
Submitted on : Wednesday, January 18, 2017 - 5:05:51 PM
Last modification on : Tuesday, October 19, 2021 - 10:58:52 PM

Identifiers

  • HAL Id : hal-01439658, version 1

Collections

Citation

Jasmin Leveille, Thomas Hannagan. Learning Spatial Invariance with the Trace Rule in Nonuniform Distributions. Neural Computation, Massachusetts Institute of Technology Press (MIT Press), 2013, 25 (5), pp.1261-1276. ⟨hal-01439658⟩

Share

Metrics

Les métriques sont temporairement indisponibles