Localization of objects in automotive scenes with spatial and temporal information

Capucine Legrand (1) , Vincent Fremont (1) , Frédéric Large (2)

1 Heudiasyc - Heuristique et Diagnostic des Systèmes Complexes [Compiègne]
2 E-MOTION - Geometry and Probability for Motion and Action

In the context of automotive driving assistance, this paper describes a generic (i.e. applicable to both vehicle interior and exterior scenes) vision based approach for scene content analysis. It makes use of temporal and spatial information from a stereoscopic sequence of images to localize objects and estimate their position and motion. The proposed method is divided into three steps. First, image features are selected, tracked and reconstructed in the 3D world space. Second, a clustering step is processed in the 5D space made of the positions and 2D motions parameters. The last step is devoted to clusters interpretation: it is out of the scope of the paper, however orientations are given to illustrate the capabilities of the proposed approach. The paper is organized as follows: first, the use of temporal and spatial information from a stereoscopic sequence is investigated. A state of the art of existing methods is presented. Then, a generic approach for object segmentation is proposed. Lastly, experimental results are presented.

Domaines: Vision par ordinateur et reconnaissance de formes [cs.CV]; Automatique / Robotique

Capucine Legrand, Vincent Fremont, Frédéric Large. Localization of objects in automotive scenes with spatial and temporal information. 11th International IEEE Conference on Intelligent Transportation Systems (ITSC2008), Oct 2008, China. pp.791-796, ⟨10.1109/ITSC.2008.4732563⟩. ⟨hal-00402534⟩