Effects of Emotions on Head Motion Predictability in 360° Videos

Quentin Guimard (1, 2) , Lucile Sassatelli (1, 2, 3)

1 UniCA - Université Côte d'Azur
2 Laboratoire d'Informatique, Signaux, et Systèmes de Sophia-Antipolis (I3S) / Equipe SIGNET
3 IUF - Institut universitaire de France

While 360° videos watched in a VR headset are gaining in popularity, it is necessary to lower the required bandwidth to stream these immersive videos and obtain a satisfying quality of experience. Doing so requires predicting the user's head motion in advance, which has been tackled by a number of recent prediction methods considering the video content and the user's past motion. However, human motion is a complex process that can depend on many more parameters, including the type of attentional phase the user is currently in, and their emotions, which can be difficult to capture. This is the first article to investigate the effects of user emotions on the predictability of head motion, in connection with video-centric parameters. We formulate and verify hypotheses, and construct a structural equation model of emotion, motion and predictability. We show that the prediction error is higher for higher valence ratings, and that this relationship is mediated by head speed. We also show that the prediction error is lower for higher arousal, but that spatial information moderates the effect of arousal on predictability. This work opens the path to better capture important factors in human motion, to help improve the training process of head motion predictors.

Mots clés: 360° videos; emotions; head motion; predictability; 360° videos; 360°videos

Domaines: Multimédia [cs.MM]; Apprentissage [cs.LG]; Réseaux et télécommunications [cs.NI]; Réseau de neurones [cs.NE]

Quentin Guimard, Lucile Sassatelli. Effects of Emotions on Head Motion Predictability in 360° Videos. International Workshop on Immersive Mixed and Virtual Environment Systems, Jun 2022, Athlone, Ireland. ⟨10.1145/3534086.3534335⟩. ⟨hal-03710272⟩