HAL will be down for maintenance from Friday, June 10 at 4pm through Monday, June 13 at 9am. More information
Skip to Main content Skip to Navigation
Conference papers

Deep unsupervised state representation learning with robotic priors: a robustness analysis

Abstract : Our understanding of the world depends highly on our capacity to produce intuitive and simplified representations which can be easily used to solve problems. We reproduce this simplification process using a neural network to build a low dimensional state representation of the world from images acquired by a robot. As in Jonschkowski et al. 2015, we learn in an unsupervised way using prior knowledge about the world as loss functions called robotic priors and extend this approach to high dimension richer images to learn a 3D representation of the hand position of a robot from RGB images. We propose a quantitative evaluation metric of the learned representation that uses nearest neighbors in the state space and allows to assess its quality and show both the potential and limitations of robotic priors in realistic environments. We augment image size, add distractors and domain randomization, all crucial components to achieve transfer learning to real robots. Finally, we also contribute a new prior to improve the robustness of the representation. The applications of such low dimensional state representation range from easing reinforcement learning (RL) and knowledge transfer across tasks, to facilitating learning from raw data with more efficient and compact high level representations. The results show that the robotic prior approach is able to extract high level representation as the 3D position of an arm and organize it into a compact and coherent space of states in a challenging dataset.
Document type :
Conference papers
Complete list of metadata

Cited literature [29 references]  Display  Hide  Download

https://hal.archives-ouvertes.fr/hal-02381375
Contributor : Natalia Díaz-Rodríguez Connect in order to contact the contributor
Submitted on : Friday, November 29, 2019 - 11:30:20 AM
Last modification on : Wednesday, May 11, 2022 - 3:20:03 PM

File

2019 IJCNN Budapest Unsupervis...
Files produced by the author(s)

Identifiers

Collections

Citation

Timothée Lesort, Mathieu Seurin, Xinrui Li, Natalia Díaz-Rodríguez, David Filliat. Deep unsupervised state representation learning with robotic priors: a robustness analysis. IJCNN 2019 - International Joint Conference on Neural Networks, Jul 2019, Budapest, Hungary. pp.1-8, ⟨10.1109/IJCNN.2019.8852042⟩. ⟨hal-02381375⟩

Share

Metrics

Record views

61

Files downloads

85