Correcting Motion Distortions in Time-of-Flight Imaging

Beatrix-Emőke Fülöp-Balogh 1 Nicolas Bonneel 1 Julie Digne 1
1 GeoMod - Modélisation Géométrique, Géométrie Algorithmique, Fractales
LIRIS - Laboratoire d'InfoRmatique en Image et Systèmes d'information
Abstract : Time-of-flight point cloud acquisition systems have grown in precision and robustness over the past few years. However, even subtle motion can induce significant distortions due to the long acquisition time. In contrast, there exists sensors that produce depth maps at a higher frame rate, but they suffer from low resolution and accuracy. In this paper, we correct distortions produced by small motions in time-of-flight acquisitions and even output a corrected animated sequence by combining a slow but high-resolution time-of-flight LiDAR system and a fast but low-resolution consumer depth sensor. We cast the problem as a curve-to-volume registration, by seeing a LiDAR point cloud as a curve in a 4-dimensional spacetime and the captured low-resolution depth video as a 4-dimensional spacetime volume. Our approach starts by registering both captured sequences in 4D, in a coarse-to-fine approach. It then computes an optical flow between the low-resolution frames and finally transfers high-resolution details by advecting along the flow. We demonstrate the efficiency of our approach on both synthetic data, on which we can compute registration errors, and real data.
Complete list of metadatas

Cited literature [30 references]  Display  Hide  Download

https://hal.archives-ouvertes.fr/hal-01890418
Contributor : Julie Digne <>
Submitted on : Monday, October 8, 2018 - 3:54:48 PM
Last modification on : Saturday, June 8, 2019 - 10:57:40 AM
Long-term archiving on : Wednesday, January 9, 2019 - 3:26:50 PM

File

preprint.pdf
Files produced by the author(s)

Identifiers

Citation

Beatrix-Emőke Fülöp-Balogh, Nicolas Bonneel, Julie Digne. Correcting Motion Distortions in Time-of-Flight Imaging. Motion, Interaction and Games 2018, Nov 2018, Limassol, Cyprus. 7p, ⟨10.1145/3274247.3274512⟩. ⟨hal-01890418⟩

Share

Metrics

Record views

88

Files downloads

232