A time-consistent video segmentation algorithm designed for real-time implementation

Mohammed Elhassani (1) , Delphine Rivasseau (2) , Stéphanie Jehan-Besson (3) , Marinette Revenu (3) , David Tschumperlé (3) , Luc Brun (3) , Marc Duranton (2)

1 GREYC - Groupe de Recherche en Informatique, Image et Instrumentation de Caen
2 NXP Semiconductors
3 Equipe Image - Laboratoire GREYC - UMR6072

In this paper, we propose a time consistent video segmentation algorithm designed for real-time implementation. Our segmentation algorithm is based on a region merging process that combines both spatial and motion information. The spatial segmentation takes benefit of an adaptive decision rule and a specific order of merging. Our method has proven to be efficient for the segmentation of natural images (flat or textured regions) with few parameters to be set. Temporal consistency of the segmentation is ensured by incorporating motion information through the use of an improved change detection mask. This mask is designed using both illumination differences between frames, and region segmentation of the previous frame. By considering both pixel and region levels, we obtain a particularly efficient algorithm at a low computational cost, allowing its implementation in real-time on the TriMedia processor for CIF image sequences.

Domaines: Algorithme et structure de données [cs.DS]; Traitement du signal et de l'image [eess.SP]; Traitement du signal et de l'image [eess.SP]

Mohammed Elhassani, Delphine Rivasseau, Stéphanie Jehan-Besson, Marinette Revenu, David Tschumperlé, et al.. A time-consistent video segmentation algorithm designed for real-time implementation. IEEE International Conference on Electronics, Circuits and Systems, 2006, Nice, France. pp.636 - 639, ⟨10.1109/ICECS.2006.379869⟩. ⟨hal-00090684⟩