The Mind-Writing Pupil : A Human-Computer Interface Based on Decoding of Covert Attention through Pupillometry

Abstract : We present a new human-computer interface that is based on decoding of attention through pupillometry. Our method builds on the recent finding that covert visual attention affects the pupillary light response: Your pupil constricts when you covertly (without looking at it) attend to a bright, compared to a dark, stimulus. In our method, participants covertly attend to one of several letters with oscillating brightness. Pupil size reflects the brightness of the selected letter, which allows us-with high accuracy and in real time-to determine which letter the participant intends to select. The performance of our method is comparable to the best covert-attention brain-computer interfaces to date, and has several advantages: no movement other than pupil-size change is required; no physical contact is required (i.e. no electrodes); it is easy to use; and it is reliable. Potential applications include: communication with totally locked-in patients, training of sustained attention, and ultra-secure password input.
Document type :
Journal articles
Complete list of metadatas

Cited literature [41 references]  Display  Hide  Download

https://hal.archives-ouvertes.fr/hal-01432254
Contributor : Jean-Baptiste Melmi <>
Submitted on : Monday, September 17, 2018 - 12:57:18 PM
Last modification on : Thursday, July 11, 2019 - 2:10:08 PM
Long-term archiving on : Tuesday, December 18, 2018 - 1:19:28 PM

File

journal.pone.0148805.PDF
Publication funded by an institution

Licence


Distributed under a Creative Commons Attribution 4.0 International License

Identifiers

Collections

Citation

Sebastiaan Mathôt, Jean-Baptiste Melmi, Lotje Linden, Stefan Stigchel. The Mind-Writing Pupil : A Human-Computer Interface Based on Decoding of Covert Attention through Pupillometry. PLoS ONE, Public Library of Science, 2016, 11 (2), ⟨10.1371/journal.pone.0148805⟩. ⟨hal-01432254⟩

Share

Metrics

Record views

82

Files downloads

92