Skip to Main content Skip to Navigation
Conference papers

Hierarchical-Task Reservoir for Anytime POS Tagging from Continuous Speech

Luca Pedrelli 1 Xavier Hinaut 1
1 Mnemosyne - Mnemonic Synergy
LaBRI - Laboratoire Bordelais de Recherche en Informatique, Inria Bordeaux - Sud-Ouest, IMN - Institut des Maladies Neurodégénératives [Bordeaux]
Abstract : We propose a novel architecture called Hierarchical-Task Reservoir (HTR) suitable for real-time sentence parsing from continuous speech. Accordingly, we introduce a novel task that consists in performing anytime Part-of-Speech (POS) tagging from continuous speech. This HTR architecture is designed to address three sub-tasks (phone, word and POS tag estimation) with increasing levels of abstraction. These tasks are performed by the consecutive layers of the HTR architecture. Interestingly, the qualitative results show that the learning of sub-tasks enforces low frequency dynamics (i.e. with longer timescales) in the more abstract layers. We compared HTR with a baseline hierarchical reservoir architecture (in which each layer is an ESN that addresses the same POS tag estimation). Moreover, we also performed a thorough experimental comparison with several architectural variants. Finally, the HTR obtained the best performance in all experimental comparisons. Overall, the proposed approach will be a useful tool for further studies regarding both the modeling of language comprehension in a neuroscience context and for real-time implementations in Human-Robot Interaction (HRI) context.
Complete list of metadatas

Cited literature [34 references]  Display  Hide  Download

https://hal.inria.fr/hal-02594495
Contributor : Xavier Hinaut <>
Submitted on : Friday, May 15, 2020 - 6:46:11 PM
Last modification on : Tuesday, May 19, 2020 - 1:43:55 AM

File

PedrelliHinaut2020_IJCNN.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-02594495, version 1

Collections

Citation

Luca Pedrelli, Xavier Hinaut. Hierarchical-Task Reservoir for Anytime POS Tagging from Continuous Speech. 2020 International Joint Conference on Neural Networks (IJCNN 2020), Jul 2020, Glasgow, Scotland, United Kingdom. ⟨hal-02594495⟩

Share

Metrics

Record views

79

Files downloads

206