Image-based Street-side City Modeling

Abstract : We propose an automatic approach to generate street-side 3D photo-realistic models from images captured along the streets at ground level. We first develop a multi-view semantic segmentation method that recognizes and segments each image at pixel level into semantically meaningful areas, each labeled with a specific object class, such as building, sky, ground, vegetation and car. A partition scheme is then introduced to separate buildings into independent blocks using the major line structures of the scene. Finally, for each block, we propose an inverse patch-based orthographic composition and structure analysis method for facade modeling that efficiently regularizes the noisy and missing reconstructed 3D data. Our system has the distinct advantage of producing visually compelling results by imposing strong priors of building regularity. We demonstrate the fully automatic system on a typical city example to validate our methodology.
Document type :
Journal articles
Liste complète des métadonnées

Cited literature [29 references]  Display  Hide  Download

https://hal.archives-ouvertes.fr/hal-01635654
Contributor : Maxime Lhuillier <>
Submitted on : Wednesday, November 15, 2017 - 2:54:39 PM
Last modification on : Tuesday, October 9, 2018 - 9:44:11 AM
Document(s) archivé(s) le : Friday, February 16, 2018 - 2:24:52 PM

File

Sig09.pdf
Files produced by the author(s)

Identifiers

Citation

Jianxiong Xiao, Tian Fang, Peng Zhao, Maxime Lhuillier, Long Quan. Image-based Street-side City Modeling. ACM Transactions on Graphics, Association for Computing Machinery, 2009, 28 (5), pp.114. ⟨10.1145/1618452.1618460⟩. ⟨hal-01635654⟩

Share

Metrics

Record views

203

Files downloads

192