Multimodal Mathematical Expressions Recognition: Case of Speech and Handwriting

Sofiane Medjkoune 1 Harold Mouchère 1 Simon Petitrenaud 2 Christian Viard-Gaudin 1
1 irccyn-ivc
IRCCyN - Institut de Recherche en Communications et en Cybernétique de Nantes
2 LIUM - Laboratoire d'Informatique de l'Université du Mans
Abstract : In this work, we propose to combine two modalities, handwriting and speech, to build a mathematical expression recognition system. Based on two sub-systems which process each modality, we explore various fusion methods to resolve ambiguities which naturally occur independently. The results that are reported on the HAMEX bimodal database show an improvement with respect to a mono-modal based system.
Keywords : Multimodality graphical languages data fusion handwriting speech
Document type :
Conference papers
Complete list of metadatas

Cited literature [14 references]  Display  Hide  Download
https://hal.archives-ouvertes.fr/hal-00852846
Contributor : Harold Mouchère <>
Submitted on : Wednesday, August 21, 2013 - 3:23:54 PM
Last modification on : Wednesday, December 19, 2018 - 3:02:08 PM
Long-term archiving on: Thursday, April 6, 2017 - 3:36:22 AM

File

10.1007_978-3-642-39330-3_9.pd...
Publisher files allowed on an open archive

Identifiers

Collections

CNRS | UNIV-LEMANS | EC-NANTES | UNAM | IRCCYN | UNIV-NANTES | LIUM | LIUM-LST

Citation

Sofiane Medjkoune, Harold Mouchère, Simon Petitrenaud, Christian Viard-Gaudin. Multimodal Mathematical Expressions Recognition: Case of Speech and Handwriting. 15th International Conference on Human-Computer Interaction, Jul 2013, Las Vegas, United States. pp.77-86, ⟨10.1007/978-3-642-39330-3_9⟩. ⟨hal-00852846⟩

Export

BibTeX TEI DC DCterms EndNote

Share

Metrics

Record views

605

Files downloads

271

Contact

Informations

CCSD