 |
Free and accessible knowledge |
Conference papers
CGCNN: COMPLEX GABOR CONVOLUTIONAL NEURAL NETWORK ON RAW SPEECH
Abstract : Convolutional Neural Networks (CNN) have been used in Automatic Speech Recognition (ASR) to learn representations directly from the raw signal instead of hand-crafted acoustic features, providing a richer and lossless input signal. Recent researches propose to inject prior acoustic knowledge to the first convolutional layer by integrating the shape of the impulse responses in order to increase both the interpretability of the learnt acoustic model, and its performances. We propose to combine the complex Gabor filter with complex-valued deep neural networks to replace usual CNN weights kernels, to fully take advantage of its optimal time-frequency resolution and of the complex domain. The conducted experiments on the TIMIT phoneme recognition task shows that the proposed approach reaches top-of-the-line performances while remaining interpretable.
Cited literature [27 references]
https://hal.archives-ouvertes.fr/hal-02474746
Contributor : Paul-Gauthier Noé Connect in order to contact the contributor
Submitted on : Tuesday, February 11, 2020 - 3:46:50 PM
Last modification on : Wednesday, November 3, 2021 - 10:00:34 AM
Long-term archiving on: : Tuesday, May 12, 2020 - 3:18:43 PM
Contributor : Paul-Gauthier Noé Connect in order to contact the contributor
Submitted on : Tuesday, February 11, 2020 - 3:46:50 PM
Last modification on : Wednesday, November 3, 2021 - 10:00:34 AM
Long-term archiving on: : Tuesday, May 12, 2020 - 3:18:43 PM
File
gabor_complex_cnn_final.pdf
Files produced by the author(s)