LU-Net: An Efficient Network for 3D LiDAR Point Cloud Semantic Segmentation Based on End-to-End-Learned 3D Features and U-Net

Abstract : We propose LU-Net---for LiDAR U-Net, a new method for the semantic segmentation of a 3D LiDAR point cloud. Instead of applying some global 3D segmentation method such as PointNet, we propose an end-to-end architecture for LiDAR point cloud semantic segmentation that efficiently solves the problem as an image processing problem. We first extract high-level 3D features for each point given its 3D neighbors. Then, these features are projected into a 2D multichannel range-image by considering the topology of the sensor. Thanks to these learned features and this projection, we can finally perform the segmentation using a simple U-Net segmentation network, which performs very well while being very efficient. In this way, we can exploit both the 3D nature of the data and the specificity of the LiDAR sensor. This approach outperforms the state-of-the-art by a large margin on the KITTI dataset, as our experiments show. Moreover, this approach operates at 24fps on a single GPU. This is above the acquisition rate of common LiDAR sensors which makes it suitable for real-time applications.
Document type :
Conference papers
Complete list of metadatas

Cited literature [23 references]  Display  Hide  Download

https://hal.archives-ouvertes.fr/hal-02269915
Contributor : Pierre Biasutti <>
Submitted on : Thursday, October 24, 2019 - 3:38:48 PM
Last modification on : Tuesday, October 29, 2019 - 1:42:03 AM

File

LUNet.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-02269915, version 2

Collections

Citation

Pierre Biasutti, Vincent Lepetit, Mathieu Brédif, Jean-François Aujol, Aurélie Bugeau. LU-Net: An Efficient Network for 3D LiDAR Point Cloud Semantic Segmentation Based on End-to-End-Learned 3D Features and U-Net. International Conference on Computer Vision (Workshop), Oct 2019, Séoul, South Korea. ⟨hal-02269915v2⟩

Share

Metrics

Record views

33

Files downloads

113