Snap2Play: A Mixed-Reality Game based on Scene Identification

Tat-Jun Chin , Yilun You (1) , Celine Coutrix (2) , Joo-Hwee Lim , Jean-Pierre Chevallet (3) , Laurence Nigay (2, 1)

1 IIHM - Ingénierie de l’Interaction Homme-Machine
2 LIG - Laboratoire d'Informatique de Grenoble
3 MRIM - Modélisation et Recherche d’Information Multimédia [Grenoble]

The ubiquity of camera phones provides a convenient platform to develop immersive mixed-reality games. In this paper we introduce such a game which is loosely based on the popular card game "Memory", where players are asked to match a pair of identical cards among a set of overturned cards by revealing only two cards at a time. In our game, the players are asked to match a "physical card", which is an image of a scene in the real world, to a "digital card", which corresponds to a scene in a virtual world. The objective is to convey a mixed-reality sensation. Cards are matched with a scene identification engine which consists of multiple classifiers trained on previously collected images. We present our comprehensive overall game design, as well as implementation details and results. Additionally, we also describe how we constructed our scene identification engine and its performance.

Domaines: Interface homme-machine [cs.HC]; Recherche d'information [cs.IR]

Tat-Jun Chin, Yilun You, Celine Coutrix, Joo-Hwee Lim, Jean-Pierre Chevallet, et al.. Snap2Play: A Mixed-Reality Game based on Scene Identification. International Conference on Multimedia Modeling, Jan 2008, Kyoto, Japan. pp.220-229, ⟨10.1007/978-3-540-77409-9_21⟩. ⟨hal-04447348⟩