Multimodal Mathematical Expressions Recognition: Case of Speech and Handwriting

Sofiane Medjkoune 1 Harold Mouchère 1 Simon Petitrenaud 2 Christian Viard-Gaudin 1
1 irccyn-ivc
IRCCyN - Institut de Recherche en Communications et en Cybernétique de Nantes
Abstract : In this work, we propose to combine two modalities, handwriting and speech, to build a mathematical expression recognition system. Based on two sub-systems which process each modality, we explore various fusion methods to resolve ambiguities which naturally occur independently. The results that are reported on the HAMEX bimodal database show an improvement with respect to a mono-modal based system.
Complete list of metadatas

Cited literature [14 references]  Display  Hide  Download

https://hal.archives-ouvertes.fr/hal-00852846
Contributor : Harold Mouchère <>
Submitted on : Wednesday, August 21, 2013 - 3:23:54 PM
Last modification on : Wednesday, December 19, 2018 - 3:02:08 PM
Long-term archiving on : Thursday, April 6, 2017 - 3:36:22 AM

File

10.1007_978-3-642-39330-3_9.pd...
Publisher files allowed on an open archive

Identifiers

Citation

Sofiane Medjkoune, Harold Mouchère, Simon Petitrenaud, Christian Viard-Gaudin. Multimodal Mathematical Expressions Recognition: Case of Speech and Handwriting. 15th International Conference on Human-Computer Interaction, Jul 2013, Las Vegas, United States. pp.77-86, ⟨10.1007/978-3-642-39330-3_9⟩. ⟨hal-00852846⟩

Share

Metrics

Record views

582

Files downloads

210