GPU implementation of motion estimation for visual saliency

Anis Rahman (1) , Dominique Houzet (1) , Denis Pellerin (1) , Lionel Agud (1)

1 GIPSA-AGPIG - GIPSA - Architecture, Géométrie, Perception, Images, Gestes

Visual attention is a complex concept that includes many processes to find the region of concentration in a visual scene. In this paper, we discuss a spatio-temporal visual saliency model where the visual information contained in videos is divided into two types: static and dynamic that are processed by two separate pathways. These pathways produce intermediate saliency maps that are merged together to get salient regions distinct from what surround them. Evidently, to realize a more robust model will involve inclusion of more complex processes. Likewise, the dynamic pathway of the model involves compute-intensive motion estimation, that when implemented on GPU resulted in a speedup of up to 40x against its sequential counterpart. The implementation involves a number of code and memory optimizations to get the performance gains, resultantly materializing real-time video analysis capability for the visual saliency model.

Domaines: Calcul parallèle, distribué et partagé [cs.DC]; Traitement des images [eess.IV]

Anis Rahman, Dominique Houzet, Denis Pellerin, Lionel Agud. GPU implementation of motion estimation for visual saliency. DASIP 2010 - Conference on Design and Architectures for Signal and Image Processing, Oct 2010, Édimbourg, United Kingdom. pp.1. ⟨hal-00564391⟩