Service interruption on Monday 11 July from 12:30 to 13:00: all the sites of the CCSD (HAL, Epiciences, SciencesConf, AureHAL) will be inaccessible (network hardware connection).
Skip to Main content Skip to Navigation
Journal articles

Multi-task deep learning for image segmentation using recursive approximation tasks

Abstract : Fully supervised deep neural networks for segmentation usually require a massive amount of pixel-level labels which are manually expensive to create. In this work, we develop a multi-task learning method to relax this constraint. We regard the segmentation problem as a sequence of approximation subproblems that are recursively defined and in increasing levels of approximation accuracy. The subproblems are handled by a framework that consists of 1) a segmentation task that learns from pixel-level ground truth segmentation masks of a small fraction of the images, 2) a recursive approximation task that conducts partial object regions learning and data-driven mask evolution starting from partial masks of each object instance, and 3) other problem oriented auxiliary tasks that are trained with sparse annotations and promote the learning of dedicated features. Most training images are only labeled by (rough) partial masks, which do not contain exact object boundaries, rather than by their full segmentation masks. During the training phase, the approximation task learns the statistics of these partial masks, and the partial regions are recursively increased towards object boundaries aided by the learned information from the segmentation task in a fully data-driven fashion. The network is trained on an extremely small amount of precisely segmented images and a large set of coarse labels. Annotations can thus be obtained in a cheap way. We demonstrate the efficiency of our approach in three applications with microscopy images and ultrasound images.
Document type :
Journal articles
Complete list of metadata
Contributor : Nicolas Papadakis Connect in order to contact the contributor
Submitted on : Thursday, May 28, 2020 - 10:05:22 AM
Last modification on : Saturday, June 25, 2022 - 10:42:35 AM

Links full text




Rihuan Ke, Aurélie Bugeau, Nicolas Papadakis, Mark Kirkland, Peter Schuetz, et al.. Multi-task deep learning for image segmentation using recursive approximation tasks. IEEE Transactions on Image Processing, Institute of Electrical and Electronics Engineers, 2021, 30, pp.3555-3567. ⟨10.1109/TIP.2021.3062726⟩. ⟨hal-02638394⟩



Record views