WiMorse: A Contactless Morse Code Text Input System using Ambient WiFi Signals

Abstract : Recent years have witnessed advances of Internet of Things (IoT) technologies and their applications to enable contactless sensing and human-computer interaction in smart homes. For people with Motor Neurone Disease (MND), their motion capabilities are severely impaired and they have difficulties interacting with IoT devices and even communicating with other people. As the disease progresses, most patients lose their speech function eventually which makes the widely adopted voice-based solutions fail. In contrast, most patients can still move their fingers slightly even after they have lost the control of their arms and hands. Thus we propose to develop a Morse code based text input system, called WiMorse, which allows patients with minimal single-finger control to input and communicate with other people without attaching any sensor to their fingers. WiMorse leverages ubiquitous commodity WiFi devices to track subtle finger movements contactlessly and encode them as Morse code input. In order to sense the very subtle finger movements, we propose to employ the ratio of the Channel State Information (CSI) between two antennas to enhance the Signal to Noise Ratio. To address the severe location dependency issue in wireless sensing with accurate theoretical underpinning and experiments, we propose a signal transformation mechanism to automatically convert signals based on the input position, achieving stable sensing performance. Comprehensive experiments demonstrate that WiMorse can achieve higher than 95% recognition accuracy for finger generated Morse code, and is robust against input position, environment changes, and user diversity.
Document type :
Journal articles
Complete list of metadatas

Cited literature [61 references]  Display  Hide  Download

https://hal.archives-ouvertes.fr/hal-02321060
Contributor : Daqing Zhang <>
Submitted on : Sunday, October 20, 2019 - 3:06:12 PM
Last modification on : Wednesday, October 23, 2019 - 1:47:32 AM

File

4-WiMorse.pdf
Files produced by the author(s)

Identifiers

Collections

Citation

Kai Niu, Fusang Zhang, Yuhang Jiang, Jie Xiong, Qin Lv, et al.. WiMorse: A Contactless Morse Code Text Input System using Ambient WiFi Signals. IEEE internet of things journal, IEEE, 2019, 1, pp.1-1. ⟨10.1109/JIOT.2019.2934904⟩. ⟨hal-02321060⟩

Share

Metrics

Record views

7

Files downloads

47