Hal will be stopped for maintenance from friday on june 10 at 4pm until monday june 13 at 9am. More information
Skip to Main content Skip to Navigation
Conference papers

Towards vision-based manipulation of plastic materials

Andrea Cherubini 1 Jürgen Leitner 2 Valerio Ortenzi 2 Peter Corke 2
1 IDH - Interactive Digital Humans
LIRMM - Laboratoire d'Informatique de Robotique et de Microélectronique de Montpellier
Abstract : This paper represents a step towards vision-based manipulation of plastic materials. Manipulating deformable objects is made challenging by: 1) the absence of a model for the object deformation, 2) the inherent difficulty of visual tracking of deformable objects, 3) the difficulty in defining a visual error and 4) the difficulty in generating control inputs to minimise the visual error. We propose a novel representation of the task of manipulating deformable objects. In this preliminary case study, the shaping of kinetic sand, we assume a finite set of actions: pushing, tapping and incising. We consider that these action types affect only a subset of the state, i.e., their effect does not affect the entire state of the system (specialized actions). We report the results of a user study to validate these hypotheses and release the recorded dataset. The actions (pushing, tapping and incising) are clearly adopted during the task, although it is clear that 1) participants use also mixed actions and 2) actions' effects can marginally affect the entire state, requesting a relaxation of our specialized actions hypothesis. Moreover, we compute task errors and corresponding control inputs (in the image space) using image processing. Finally, we show how machine learning can be applied to infer the mapping from error to action on the data extracted from the user study.
Complete list of metadata

Cited literature [16 references]  Display  Hide  Download

Contributor : Andrea Cherubini Connect in order to contact the contributor
Submitted on : Wednesday, March 14, 2018 - 12:57:13 AM
Last modification on : Wednesday, November 3, 2021 - 7:43:52 AM
Long-term archiving on: : Friday, June 15, 2018 - 12:38:30 PM


Files produced by the author(s)




Andrea Cherubini, Jürgen Leitner, Valerio Ortenzi, Peter Corke. Towards vision-based manipulation of plastic materials. IROS: Intelligent Robots and Systems, Oct 2018, Madrid, Spain. pp.485-490, ⟨10.1109/IROS.2018.8594108⟩. ⟨hal-01731230⟩



Record views


Files downloads