Towards vision-based manipulation of plastic materials

Andrea Cherubini 1 Jürgen Leitner 2 Valerio Ortenzi 2 Peter Corke 2
1 IDH - Interactive Digital Humans
LIRMM - Laboratoire d'Informatique de Robotique et de Microélectronique de Montpellier
Abstract : This paper represents a step towards vision-based manipulation of plastic materials. Manipulating deformable objects is made challenging by: 1) the absence of a model for the object deformation, 2) the inherent difficulty of visual tracking of deformable objects, 3) the difficulty in defining a visual error and 4) the difficulty in generating control inputs to minimise the visual error. We propose a novel representation of the task of manipulating deformable objects. In this preliminary case study, the shaping of kinetic sand, we assume a finite set of actions: pushing, tapping and incising. We consider that these action types affect only a subset of the state, i.e., their effect does not affect the entire state of the system (specialized actions). We report the results of a user study to validate these hypotheses and release the recorded dataset. The actions (pushing, tapping and incising) are clearly adopted during the task, although it is clear that 1) participants use also mixed actions and 2) actions' effects can marginally affect the entire state, requesting a relaxation of our specialized actions hypothesis. Moreover, we compute task errors and corresponding control inputs (in the image space) using image processing. Finally, we show how machine learning can be applied to infer the mapping from error to action on the data extracted from the user study.
Liste complète des métadonnées

Cited literature [16 references]  Display  Hide  Download

https://hal.archives-ouvertes.fr/hal-01731230
Contributor : Andrea Cherubini <>
Submitted on : Wednesday, March 14, 2018 - 12:57:13 AM
Last modification on : Friday, April 12, 2019 - 5:20:05 PM
Document(s) archivé(s) le : Friday, June 15, 2018 - 12:38:30 PM

File

2018-sandman.pdf
Files produced by the author(s)

Identifiers

Collections

Citation

Andrea Cherubini, Jürgen Leitner, Valerio Ortenzi, Peter Corke. Towards vision-based manipulation of plastic materials. IROS: Intelligent Robots and Systems, Oct 2018, Madrid, Spain. pp.485-490, ⟨10.1109/IROS.2018.8594108⟩. ⟨hal-01731230⟩

Share

Metrics

Record views

336

Files downloads

441