Hand segmentation with structured convolutional learning

Abstract : The availability of cheap and effective depth sensors has resulted in recent advances in human pose estimation and tracking. Detailed estimation of hand pose, however, remains a challenge since fingers are often occluded and may only represent just a few pixels. Moreover, labelled data is difficult to obtain. We propose a deep learning based-approach for hand pose estimation, targeting gesture recognition, that requires very little labelled data. It leverages both unlabeled data and synthetic data from renderings. The key to making it work is to integrate structural information not into the model architecture, which would slow down inference, but into the training objective. We show that adding unlabelled real-world samples significantly improves results compared to a purely supervised setting.
Document type :
Conference papers
Complete list of metadatas

https://hal.archives-ouvertes.fr/hal-01419789
Contributor : Christian Wolf <>
Submitted on : Monday, December 19, 2016 - 10:12:27 PM
Last modification on : Tuesday, February 26, 2019 - 4:35:38 PM

Identifiers

  • HAL Id : hal-01419789, version 1

Citation

Natalia Neverova, Christian Wolf, Graham W. Taylor, Florian Nebout. Hand segmentation with structured convolutional learning. ACCV, Jan 2014, Singapour, Singapore. ⟨hal-01419789⟩

Share

Metrics

Record views

209