Skip to Main content Skip to Navigation
Conference papers

Appearance-based Eye Control System by Manifold Learning

Abstract : Eye-movements are increasingly employed to study usability issues in HCI (Human-Computer Interaction) contexts. In this paper we introduce our appearance-based eye control system which utilizes 5 specific eye movements, such as closed-eye movement and eye movements with gaze fixation at the positions (up, down, right, left) for HCI applications. In order to measure these eye movements, we employ a fast appearance-based gaze tracking method with manifold learning technique. First we propose to concatenate local eye appearance Center-Symmetric Local Binary Pattern(CS-LBP) descriptor for each subregion of eye image to form an eye appearance feature vector. The calibration phase is then introduced to construct a trainning samples by spectral clustering. After that, Laplacian Eigenmaps will be applied to the trainning set and unseen input together to get the structure of eye manifolds. Finally we can infer the eye movement of the new input by its distances with the clusters in the trainning set. Experimental results demonstrate that our system with quick 4-points calibration not only can reduce the run-time cost, but also provide another way to mesure eye movements without mesuring gaze coordinates to a HCI application such as our eye control system.
Document type :
Conference papers
Complete list of metadata
Contributor : Yvain Queau Connect in order to contact the contributor
Submitted on : Friday, February 7, 2014 - 3:04:34 PM
Last modification on : Wednesday, September 28, 2022 - 4:20:11 PM


  • HAL Id : hal-00943398, version 1


Ke Liang, Youssef Chahir, Michèle Molina, Charles Tijus, François Jouen. Appearance-based Eye Control System by Manifold Learning. 9th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Application (VISAPP 2014), Jan 2014, Lisbonne, Portugal. 8 pp. ⟨hal-00943398⟩



Record views