Your Smart Speaker Can "Hear" Your Heartbeat! - Archive ouverte HAL Accéder directement au contenu
Article Dans Une Revue Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies Année : 2020

Your Smart Speaker Can "Hear" Your Heartbeat!

Résumé

Vital sign monitoring is a common practice amongst medical professionals, and plays a key role in patient care and clinical diagnosis. Traditionally, dedicated equipment is employed to monitor these vital signs. For example, electrocardiograms (ECG) with 3-12 electrodes are attached to the target chest for heartbeat monitoring. In the last few years, wireless sensing becomes a hot research topic and wireless signal itself is utilized for sensing purposes without requiring the target to wear any sensors. The contact-free nature of wireless sensing makes it particularly appealing in current COVID-19 pandemic. Recently, promising progress has been achieved and the sensing granularity has been pushed to millimeter level, fine enough to monitor respiration which causes a chest displacement of 5 mm. While a great success with respiration monitoring, it is still very challenging to monitor heartbeat due to the extremely subtle chest displacement (0.1 - 0.5 mm) - smaller than 10% of that caused by respiration. What makes it worse is that the tiny heartbeat-caused chest displacement is buried inside the respiration-caused displacement. In this paper, we show the feasibility of employing the popular smart speakers (e.g., Amazon Echo) to monitor an individual's heartbeats in a contact-free manner. To extract the submillimeter heartbeat motion in the presence of other interference movements, a series of novel signal processing schemes are employed. We successfully prototype the first real-time heartbeat monitoring system using a commodity smart speaker. Experiment results show that the proposed system can monitor a target's heartbeat accurately, achieving a median heart rate estimation error of 0.75 beat per minute (bpm), and a median heartbeat interval estimation error of 13.28 ms (less than 1.8%), outperforming even some popular commodity products available on the market.
Fichier principal
Vignette du fichier
3432237.pdf (5.56 Mo) Télécharger le fichier
Origine : Publication financée par une institution

Dates et versions

hal-03363346 , version 1 (30-01-2022)

Identifiants

Citer

Fusang Zhang, Zhi Wang, Jin Beihong, Jie Xiong, Daqing Zhang. Your Smart Speaker Can "Hear" Your Heartbeat!. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies , 2020, 4 (4), pp.1-24. ⟨10.1145/3432237⟩. ⟨hal-03363346⟩
20 Consultations
121 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More