CMAC Structure Optimization Based on Modified Q-learning Approach and Its Applications

W. Yu 1 K. Madani 2 C. Sabourin 2
2 SYNAPSE
LISSI - Laboratoire Images, Signaux et Systèmes Intelligents
Abstract : Comparing with other neural network based models, CMAC has been applied successfully in many nonlinear control systems because of its computational speed and learning ability. However, for high-dimensional input CMAC in real world applications such as robot, the useable memory is finite or pre-allocated, thus we often have to make our choice between learning accuracy and memory size. This paper discusses how both the number of layer and step quantization influence the approximation quality of CMAC. By experimental enquiry, it is shown that it is possible to decrease the memory size without losing the approximation quality by selecting the adaptive structural parameters. Based on modified Q-learning approach, the CMAC structural parameters can be optimized automatically without increasing the complexity of its structure. The choice of this optimized CMAC structure can achieve a tradeoff between the learning accuracy and finite memory size. At last, this Q-learning based CMAC structure optimization approach is applied on the walk pattern generating for biped robot and workpiece orientation estimation for robot arm assembly respectively.
Type de document :
Chapitre d'ouvrage
K. Madani, A. Dourado-Correia, A. Rosa and J. Filipe. Computational Intelligence- Studies in Computational Intelligence, Revised and Selected Papers of the International Joint Conference, IJCCI 2011,, Springer, pp.347-359, 2013, 〈10.1007/978-3-642-35638-4_23〉
Liste complète des métadonnées

https://hal.archives-ouvertes.fr/hal-01568543
Contributeur : Lab Lissi <>
Soumis le : mardi 25 juillet 2017 - 13:20:11
Dernière modification le : lundi 18 février 2019 - 17:27:48

Lien texte intégral

Identifiants

Collections

Citation

W. Yu, K. Madani, C. Sabourin. CMAC Structure Optimization Based on Modified Q-learning Approach and Its Applications. K. Madani, A. Dourado-Correia, A. Rosa and J. Filipe. Computational Intelligence- Studies in Computational Intelligence, Revised and Selected Papers of the International Joint Conference, IJCCI 2011,, Springer, pp.347-359, 2013, 〈10.1007/978-3-642-35638-4_23〉. 〈hal-01568543〉

Partager

Métriques

Consultations de la notice

34