Visual Hull Construction in the Presence of Partial Occlusion

Li Guan (1, 2) , Sudipa Sinha (1) , Jean-Sébastien Franco (3) , Marc Pollefeys (1, 2)

1 UNC - University of North Carolina [Chapel Hill]
2 ETH Zürich - Eidgenössische Technische Hochschule - Swiss Federal Institute of Technology [Zürich]
3 MOVI - Modeling, localization, recognition and interpretation in computer vision

In this paper, we propose a visual hull algorithm, which guarantees a correct construction even in the presence of partial occlusion, while "correct" here means that the real shape is located inside the visual hull. The algorithm is based on a new idea of the "extended silhouette", which requires the silhouette from background subtraction and the "occlusion mask" of the same view. In order to prepare the occlusion mask, we also propose a novel concept of "effective boundary" of moving foreground objects in a video obtained from a static camera. The accumulation of the effective boundary through time automatically gives robust occluder boundaries. We theoretically prove that our algorithm deterministically computes the tightest, correct visual hull in the presence of occlusion. Both synthetic and real examples are given as a demonstration of the correctness of the algorithm. Finally we analyze that this new algorithm is still within the time complexity of the traditional method.

Domaines: Vision par ordinateur et reconnaissance de formes [cs.CV]

Li Guan, Sudipa Sinha, Jean-Sébastien Franco, Marc Pollefeys. Visual Hull Construction in the Presence of Partial Occlusion. Third International Symposium on 3D Data Processing, Visualization, and Transmission, Jun 2006, United States. pp.413-420, ⟨10.1109/3DPVT.2006.147⟩. ⟨hal-00349012⟩