Skip to Main content Skip to Navigation
Journal articles

Human body part estimation from depth images via spatially-constrained deep learning

Mingyuan Jiu 1 Christian Wolf 1 Graham W. Taylor 2 Atilla Baskurt 1
1 imagine - Extraction de Caractéristiques et Identification
LIRIS - Laboratoire d'InfoRmatique en Image et Systèmes d'information
Abstract : Object recognition, human pose estimation and scene recognition are applications which are frequently solved through a decomposition into a collection of parts. The resulting local representation has significant advantages, especially in the case of occlusions and when the subject is non-rigid. Detection and recognition require modelling the appearance of the different object parts as well as their spatial layout. This representation has been particularly successful in body part estimation from depth images. Integrating the spatial layout of parts may require the minimization of complex energy functions. This is prohibitive in most real world applications and therefore often omitted. However, ignoring the spatial layout puts all the burden on the classifier, whose only available information is local appearance. We propose a new method to integrate spatial layout into parts classification without costly pairwise terms during testing. Spatial relationships are exploited in the training algorithm, but not during testing. As with competing methods, the proposed method classifies pixels independently, which makes real-time processing possible. We show that training a classifier with spatial relationships increases generalization performance when compared to classical training minimizing classification error on the training set. We present an application to human body part estimation from depth images.
Complete list of metadatas

https://hal.archives-ouvertes.fr/hal-01269994
Contributor : Équipe Gestionnaire Des Publications Si Liris <>
Submitted on : Monday, March 27, 2017 - 11:22:57 AM
Last modification on : Thursday, November 21, 2019 - 2:25:18 AM
Document(s) archivé(s) le : Wednesday, June 28, 2017 - 1:03:01 PM

File

Liris-6327.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-01269994, version 1

Citation

Mingyuan Jiu, Christian Wolf, Graham W. Taylor, Atilla Baskurt. Human body part estimation from depth images via spatially-constrained deep learning. Pattern Recognition Letters, Elsevier, 2014, 1, 50, pp.122-129. ⟨hal-01269994⟩

Share

Metrics

Record views

439

Files downloads

554