Skip to Main content Skip to Navigation
Journal articles

End-to-end acoustic modelling for phone recognition of young readers

Abstract : Automatic recognition systems for child speech are lagging behind those dedicated to adult speech in the race of performance. This phenomenon is due to the high acoustic and linguistic variability present in child speech caused by their body development, as well as the lack of available child speech data. Young readers’ speech additionally displays peculiarities, such as slow reading rate and presence of reading mistakes, that hardens the task. This work attempts to tackle the main challenges in phone acoustic modelling for young child speech with limited data and improve understanding of strengths and weaknesses of a wide selection of model architectures in this domain. We find that transfer learning techniques are highly efficient on end-to-end architectures for adult-to-child adaptation with a small amount of child speech data. Through transfer learning, a Transformer model complemented with a Connectionist Temporal Classification (CTC) objective function, reaches a phone error rate of 28.1%, outperforming a state-of-the-art DNN–HMM model by 6.6% relative, as well as other end-to-end architectures by more than 8.5% relative. An analysis of the models’ performance on two specific reading tasks (isolated words and sentences) is provided, showing the influence of the utterance length on attention-based and CTC-based models. The Transformer+CTC model displays an ability to better detect reading mistakes made by children, which can be attributed to the CTC objective function effectively constraining the attention mechanisms to be monotonic.
Complete list of metadata
Contributor : Lucile Gelin Connect in order to contact the contributor
Submitted on : Monday, October 11, 2021 - 1:11:38 PM
Last modification on : Monday, July 4, 2022 - 9:44:43 AM


Distributed under a Creative Commons Attribution 4.0 International License

Links full text



Lucile Gelin, Morgane Daniel, Julien Pinquier, Thomas Pellegrini. End-to-end acoustic modelling for phone recognition of young readers. Speech Communication, Elsevier : North-Holland, 2021, 134, pp.71-84. ⟨10.1016/j.specom.2021.08.003⟩. ⟨hal-03373156⟩



Record views