The skyline as a marker for augmented reality in urban context

Abstract : In recent years, augmented reality (AR) technologies have emerged as powerful tools to help visualize the future impacts of new constructions on cities. Many approaches that use costly sensors and height-end platforms to run AR in real-time have been developed. Little efforts have been made to embed AR on mobile phones. In this paper, we present a novel approach that uses the Skyline as a marker in an AR system. This lightweight feature enables real-time matching of virtual and real skyline on smartphones. We use device's embedded instruments to estimate the user's pose. This approximation is used to insert a synthetic object in the live video stream. This first approach gives a very unrealistic impression of the viewed scene: the inserted objects appear to hover and float with the user's movements. In order to address this problem, we use the live video camera feed as additional source of information which provides a redundancy to the instruments estimation. We extract the Skyline (a set of pixels that defines the boundary between the building and the sky) as main visual feature. Our proposal is to use these automatically extracted points and track them throughout the video sequence, to allow synthetic objects to anchor these visual features, making it possible to simulate a a landscape from multiple viewpoints using a smartphone. We use images of the Lyon city (France) to illustrate our proposal.
Complete list of metadatas

https://hal.archives-ouvertes.fr/hal-01872631
Contributor : Mehdi Ayadi <>
Submitted on : Tuesday, September 25, 2018 - 11:21:11 AM
Last modification on : Tuesday, February 26, 2019 - 3:44:45 PM
Long-term archiving on : Wednesday, December 26, 2018 - 12:24:11 PM

File

The skyline as a marker for au...
Files produced by the author(s)

Identifiers

  • HAL Id : hal-01872631, version 1

Citation

Mehdi Ayadi, Leo Valque, Mihaela Scuturici, Serge Miguet, Chokri Amar. The skyline as a marker for augmented reality in urban context. 13th International Symposium on Visual Computing, Nov 2018, Las Vegas, United States. ⟨hal-01872631⟩

Share

Metrics

Record views

263

Files downloads

117