Real-time embedded video denoiser prototype

Andrea Petreto (1, 2) , Thomas Romera (1, 2) , Florian Lemaitre (1) , Manuel Bouyer (3) , Boris Gaillard (2) , Patrice Menard (2) , Quentin Meunier (1) , Lionel Lacassagne (1)

1 ALSOC - Architecture et Logiciels pour Systèmes Embarqués sur Puce
2 Lhéritier - Alcen
3 LIP6

Low light or other poor visibility conditions often generate noise on any vision system. However, video denoising requires a lot of computational effort and most of the state-of-the-art algorithms cannot be run in real-time at camera framerate. Noisy video is thus a major issue especially for embedded systems that provide low computational power. This article presents a new real-time video denoising algorithm for embedded platforms called RTE-VD [1]. We first compare its denoising capabilities with other online and offline algorithms. We show that RTE-VD can achieve real-time performance (25 frames per second) for qHD video (960x540 pixels) on embedded CPUs with an output image quality comparable to state-of-the-art algorithms. In order to reach real-time denoising, we applied several high-level transforms and optimizations. We study the relation between computation time and power consumption on several embedded CPUs and show that it is possible to determine find out frequency and core configurations in order to minimize either the computation time or the energy. Finally, we introduce VIRTANS our embedded real-time video denoiser based on RTE-VD.

Mots clés: Image processing; Real-time; Video denoising; Embedded systems

Domaines: Traitement du signal et de l'image [eess.SP]; Automatique / Robotique; Traitement des images [eess.IV]; Robotique [cs.RO]; Mathématique discrète [cs.DM]; Génie logiciel [cs.SE]; Calcul parallèle, distribué et partagé [cs.DC]; Arithmétique des ordinateurs; Architectures Matérielles [cs.AR]; Algorithme et structure de données [cs.DS]; Vision par ordinateur et reconnaissance de formes [cs.CV]; Traitement du signal et de l'image [eess.SP]

Andrea Petreto, Thomas Romera, Florian Lemaitre, Manuel Bouyer, Boris Gaillard, et al.. Real-time embedded video denoiser prototype. 9th International Symposium - Optronics in Defense and Security (Optro), Jan 2020, Paris, France. ⟨hal-02469914⟩