Distant Speech Processing for Smart Home Comparison of ASR approaches in distributed microphone network for voice command

Abstract : Voice command in multi-room smart homes for assisting people in loss of autonomy in their daily activities faces several challenges, one of them being the distant condition which impacts ASR performance. This paper presents an overview of multiple techniques for fusion of multi-source audio (pre, middle, post fusion) for automatic speech recognition for in-home voice command. The robustness of the models of speech is obtained by adaptation to the environment and to the task. Experiments are based on several publicly available realistic datasets with participants enacting activities of daily life. The corpora were recorded in natural condition, meaning background noise is sporadic, so there is no extensive background noise in the data. The smart home is equipped with one or two microphones in each room, the distance between them being larger than 1 meter. An evaluation of the most suited techniques improves voice command recognition at the decoding level, by using multiple sources and model adaptation. Although Word Error Rate (WER) is between 26% and 40%, Domotic Error Rate (identical to the WER, but at the level of the voice command) is less than 5.8% for deep neural network models , the method using Feature space Maximum Likelihood Linear Regression (fMLLR) with speaker adaptation training and Subspace Gaussian Mixture Model (SGMM) exhibits comparable results.
Document type :
Journal articles
Liste complète des métadonnées

Cited literature [55 references]  Display  Hide  Download

https://hal.archives-ouvertes.fr/hal-01794225
Contributor : Benjamin Lecouteux <>
Submitted on : Thursday, May 17, 2018 - 1:59:47 PM
Last modification on : Monday, February 11, 2019 - 4:36:02 PM
Document(s) archivé(s) le : Tuesday, September 25, 2018 - 12:08:47 PM

File

DSP4SH.pdf
Files produced by the author(s)

Identifiers

Collections

Citation

Benjamin Lecouteux, Michel Vacher, François Portet. Distant Speech Processing for Smart Home Comparison of ASR approaches in distributed microphone network for voice command. International Journal of Speech Technology, Springer Verlag, 2018, 21, pp.601-618. ⟨https://link.springer.com/article/10.1007/s10772-018-9520-y⟩. ⟨10.1007/s10772-018-9520-y⟩. ⟨hal-01794225⟩

Share

Metrics

Record views

1001

Files downloads

347