Audiovisual data fusion for successive speakers tracking

Abstract : In this paper, a human speaker tracking method on audio and video data is presented. It is applied to con- versation tracking with a robot. Audiovisual data fusion is performed in a two-steps process. Detection is performed independently on each modality: face detection based on skin color on video data and sound source localization based on the time delay of arrival on audio data. The results of those detection processes are then fused thanks to an adaptation of bayesian filter to detect the speaker. The robot is able to detect the face of the talking person and to detect a new speaker in a conversation.
Document type :
Conference papers
VISIGRAPP - 9th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISAPP 2014), Jan 2014, Lisbonne, Portugal. 2014


https://hal.archives-ouvertes.fr/hal-00935636
Contributor : Quentin Labourey <>
Submitted on : Friday, January 31, 2014 - 3:59:26 PM
Last modification on : Wednesday, June 17, 2015 - 1:17:04 AM

File

LABOUREY_VISAPP_2014.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-00935636, version 1

Citation

Quentin Labourey, Olivier Aycard, Denis Pellerin, Michèle Rombaut. Audiovisual data fusion for successive speakers tracking. VISIGRAPP - 9th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISAPP 2014), Jan 2014, Lisbonne, Portugal. 2014. <hal-00935636>

Export

Share

Metrics

Record views

316

Document downloads

154