Track and Cut: simultaneous tracking and segmentation of multiple objects with graph cuts

Aurélie Bugeau 1 Patrick Pérez 1
1 VISTA - Vision spatio-temporelle et active
IRISA - Institut de Recherche en Informatique et Systèmes Aléatoires, Inria Rennes – Bretagne Atlantique
Abstract : This paper presents a new method to both track and segment multiple objects in videos using min-cut/max-flow optimizations. We introduce objective functions that combine low-level pixel wise measures (color, motion), high-level observations obtained via an independent detection module, motion prediction, and contrast-sensitive contextual regularization. One novelty is that external observations are used without adding any association step. The observations are image regions (pixel sets) that can be provided by any kind of detector. The minimization of appropriate cost functions simultaneously allows “detection-before-track” tracking (track-to-observation assignment and automatic initialization of new tracks) and segmentation of tracked objects. When several tracked objects get mixed up by the detection module (e.g., a single foreground detection mask is obtained for several objects close to each other), a second stage of minimization allows the proper tracking and segmentation of these individual entities despite the confusion of the external detection module.
Type de document :
Article dans une revue
EURASIP Journal on Image and Video Processing, Springer, 2008, 2008, pp.Article ID 317278
Liste complète des métadonnées

https://hal.archives-ouvertes.fr/hal-00522631
Contributeur : Aurélie Bugeau <>
Soumis le : vendredi 1 octobre 2010 - 11:20:25
Dernière modification le : vendredi 16 novembre 2018 - 01:23:56

Identifiants

  • HAL Id : hal-00522631, version 1

Collections

Citation

Aurélie Bugeau, Patrick Pérez. Track and Cut: simultaneous tracking and segmentation of multiple objects with graph cuts. EURASIP Journal on Image and Video Processing, Springer, 2008, 2008, pp.Article ID 317278. 〈hal-00522631〉

Partager

Métriques

Consultations de la notice

148