Using Online Handwriting and Audio Streams for Mathematical Expressions Recognition: a Bimodal Approach

Sofiane Medjkoune 1 Harold Mouchère 1 Simon Petitrenaud 2 Christian Viard-Gaudin 1
1 irccyn-ivc
IRCCyN - Institut de Recherche en Communications et en Cybernétique de Nantes
2 LIUM - Laboratoire d'Informatique de l'Université du Mans
Abstract : The work reported in this paper concerns the problem of mathematical expressions recognition. This task is known to be a very hard one. We propose to alleviate the difficulties by taking into account two complementary modalities. The modalities referred to are handwriting and audio ones. To combine the signals coming from both modalities, various fusion methods are explored. Performances evaluated on the HAMEX dataset show a significant improvement compared to a single modality (handwriting) based system.
Keywords : Mathematical expression Handwriting Speech Data Fusion Belief functions
Document type :
Conference papers
Complete list of metadatas

Cited literature [16 references]  Display  Hide  Download
https://hal.archives-ouvertes.fr/hal-00852860
Contributor : Harold Mouchère <>
Submitted on : Wednesday, August 21, 2013 - 3:41:01 PM
Last modification on : Wednesday, December 19, 2018 - 3:02:08 PM
Long-term archiving on: Friday, November 22, 2013 - 4:15:56 AM

File

PapierDRR2013_Sofiane.pdf
Files produced by the author(s)

Identifiers

Collections

CNRS | UNIV-LEMANS | EC-NANTES | UNAM | IRCCYN | UNIV-NANTES | LIUM | LIUM-LST

Citation

Sofiane Medjkoune, Harold Mouchère, Simon Petitrenaud, Christian Viard-Gaudin. Using Online Handwriting and Audio Streams for Mathematical Expressions Recognition: a Bimodal Approach. Document Recognition and Retrieval XX, Feb 2013, Burlingame, United States. pp.865810-865810-11, ⟨10.1007/978-3-642-39330-3_9⟩. ⟨hal-00852860⟩

Export

BibTeX TEI DC DCterms EndNote

Share

Metrics

Record views

496

Files downloads

286

Contact

Informations

CCSD