Using Online Handwriting and Audio Streams for Mathematical Expressions Recognition: a Bimodal Approach

Sofiane Medjkoune 1 Harold Mouchère 1 Simon Petitrenaud 2 Christian Viard-Gaudin 1
1 irccyn-ivc
IRCCyN - Institut de Recherche en Communications et en Cybernétique de Nantes
Abstract : The work reported in this paper concerns the problem of mathematical expressions recognition. This task is known to be a very hard one. We propose to alleviate the difficulties by taking into account two complementary modalities. The modalities referred to are handwriting and audio ones. To combine the signals coming from both modalities, various fusion methods are explored. Performances evaluated on the HAMEX dataset show a significant improvement compared to a single modality (handwriting) based system.
Complete list of metadatas

Cited literature [16 references]  Display  Hide  Download

https://hal.archives-ouvertes.fr/hal-00852860
Contributor : Harold Mouchère <>
Submitted on : Wednesday, August 21, 2013 - 3:41:01 PM
Last modification on : Wednesday, December 19, 2018 - 3:02:08 PM
Long-term archiving on : Friday, November 22, 2013 - 4:15:56 AM

File

PapierDRR2013_Sofiane.pdf
Files produced by the author(s)

Identifiers

Citation

Sofiane Medjkoune, Harold Mouchère, Simon Petitrenaud, Christian Viard-Gaudin. Using Online Handwriting and Audio Streams for Mathematical Expressions Recognition: a Bimodal Approach. Document Recognition and Retrieval XX, Feb 2013, Burlingame, United States. pp.865810-865810-11, ⟨10.1007/978-3-642-39330-3_9⟩. ⟨hal-00852860⟩

Share

Metrics

Record views

461

Files downloads

232