Skip to Main content Skip to Navigation
Conference papers

A Unified Evaluation Framework for Head Motion Prediction Methods in 360° Videos

Miguel Romero Rondon 1 Lucile Sassatelli 1 Ramon Aparicio-Pardo 1 Frédéric Precioso 2, 3
3 MAASAI - Modèles et algorithmes pour l’intelligence artificielle
CRISAM - Inria Sophia Antipolis - Méditerranée , Laboratoire I3S - SPARKS - Scalable and Pervasive softwARe and Knowledge Systems, UNS - Université Nice Sophia Antipolis (... - 2019), JAD - Laboratoire Jean Alexandre Dieudonné
Abstract : The streaming transmissions of 360°videos is a major challenge for the development of Virtual Reality, and require a reliable head motion predictor to identify which region of the sphere to send in high quality and save data rate. Different head motion predictors have been proposed recently. Some of these works have similar evaluation metrics or even share the same dataset, however, none of them compare with each other. In this article we introduce an open software that enables to evaluate heterogeneous head motion prediction methods on various common grounds. The goal is to ease the development of new head/eye motion prediction methods. We first propose an algorithm to create a uniform data structure from each of the datasets. We also provide the description of the algorithms used to compute the saliency maps either estimated from the raw video content or from the users' statistics. We exemplify how to run existing approaches on customizable settings, and finally present the targeted usage of our open framework: how to train and evaluate a new prediction method, and compare it with existing approaches and baselines in common settings. The entire material (code, datasets, neural network weights and documentation) is publicly available. CCS CONCEPTS • Computing methodologies → Model verification and validation ; Virtual reality. KEYWORDS 360°videos, head motion prediction framework, saliency, dataset analysis ACM Reference Format:
Complete list of metadata

Cited literature [17 references]  Display  Hide  Download

https://hal.archives-ouvertes.fr/hal-02615979
Contributor : Lucile Sassatelli <>
Submitted on : Thursday, July 23, 2020 - 7:42:51 PM
Last modification on : Monday, March 29, 2021 - 2:46:21 PM
Long-term archiving on: : Tuesday, December 1, 2020 - 6:29:18 AM

File

ODS2020_CR.pdf
Files produced by the author(s)

Identifiers

Collections

Citation

Miguel Romero Rondon, Lucile Sassatelli, Ramon Aparicio-Pardo, Frédéric Precioso. A Unified Evaluation Framework for Head Motion Prediction Methods in 360° Videos. MMSys '20 - 11th ACM Multimedia Systems Conference, ACM, Jun 2020, Istanbul, Turkey. pp.279-284, ⟨10.1145/3339825.3394934⟩. ⟨hal-02615979⟩

Share

Metrics

Record views

99

Files downloads

205