Immersive Teleoperation of the Eye Gaze of Social Robots Assessing Gaze-Contingent Control of Vergence, Yaw and Pitch of Robotic Eyes

Remi Cambuzat 1, 2 Frédéric Elisei 3, 2 Gérard Bailly 2 Olivier Simonin 1 Anne Spalanzani 1
1 CHROMA - Robots coopératifs et adaptés à la présence humaine en environnements dynamiques
CITI - CITI Centre of Innovation in Telecommunications and Integration of services, Inria Grenoble - Rhône-Alpes
2 GIPSA-CRISSP - CRISSP
GIPSA-DPC - Département Parole et Cognition
3 GIPSA-Services - GIPSA-Services
GIPSA-lab - Grenoble Images Parole Signal Automatique
Abstract : This paper presents a new teleoperation system – called stereo gaze-contingent steering (SGCS) – able to seamlessly control the vergence, yaw and pitch of the eyes of a humanoid robot – here an iCub robot – from the actual gaze direction of a remote pilot. The video stream captured by the cameras embedded in the mobile eyes of the iCub are fed into an HTC Vive R Head-Mounted Display equipped with an SMI R binocular eye-tracker. The SGCS achieves the effective coupling between the eye-tracked gaze of the pilot and the robot's eye movements. SGCS both ensures a faithful reproduction of the pilot's eye movements – that is perquisite for the readability of the robot's gaze patterns by its interlocutor – and maintains the pilot's oculomotor visual clues – that avoids fatigue and sickness due to sensorimotor conflicts. We here assess the precision of this servo-control by asking several pilots to gaze towards known objects positioned in the remote environment. We demonstrate that we succeed in controlling vergence with similar precision as eyes' azimuth and elevation. This system opens the way for robot-mediated human interactions in the personal space, notably when objects in the shared working space are involved.
Complete list of metadatas

Cited literature [35 references]  Display  Hide  Download

https://hal.archives-ouvertes.fr/hal-01779633
Contributor : Remi Cambuzat <>
Submitted on : Thursday, April 26, 2018 - 5:15:25 PM
Last modification on : Thursday, April 11, 2019 - 12:04:12 PM
Long-term archiving on : Tuesday, September 25, 2018 - 12:51:39 PM

File

isr2018-immersive-teleoperatio...
Files produced by the author(s)

Identifiers

  • HAL Id : hal-01779633, version 1

Citation

Remi Cambuzat, Frédéric Elisei, Gérard Bailly, Olivier Simonin, Anne Spalanzani. Immersive Teleoperation of the Eye Gaze of Social Robots Assessing Gaze-Contingent Control of Vergence, Yaw and Pitch of Robotic Eyes. ISR 2018 - 50th International Symposium on Robotics, VDE, Jun 2018, Munich, Germany. pp.232-239. ⟨hal-01779633⟩

Share

Metrics

Record views

326

Files downloads

331