Multi range Real-time depth inference from a monocular stabilized footage using a Fully Convolutional Neural Network

Clément Pinard (1, 2) , Laure Chevalley (1) , Antoine Manzanera (2) , David Filliat (2)

1 Parrot
2 U2IS - Unité d'Informatique et d'Ingénierie des Systèmes

We propose a neural network architecture for depth map inference from monocular stabilized videos with application to UAV videos in rigid scenes. Training is based on a novel synthetic dataset for navigation that mimics aerial footage from gimbal stabilized monocular camera in rigid scenes. Based on this network, we propose a multi-range architecture for unconstrained UAV flight, leveraging flight data from sensors to make accurate depth maps for uncluttered outdoor environment. We try our algorithm on both synthetic scenes and real UAV flight data. Quantitative results are given for synthetic scenes with a slightly noisy orientation, and show that our multi-range architecture improves depth inference. Along with this article is a video that present our results more thoroughly.

Mots clés: Deep CNN; HDR; Drone; Depth

Domaines: Vision par ordinateur et reconnaissance de formes [cs.CV]; Intelligence artificielle [cs.AI]; Robotique [cs.RO]

Clément Pinard, Laure Chevalley, Antoine Manzanera, David Filliat. Multi range Real-time depth inference from a monocular stabilized footage using a Fully Convolutional Neural Network. European Conference on Mobile Robotics, ENSTA ParisTech, Sep 2017, Paris, France. ⟨hal-01587658⟩