Using Speech for Handwritten Mathematical Expression Recognition Disambiguation

Sofiane Medjkoune 1 Harold Mouchère 1 Simon Petitrenaud 2 Christian Viard-Gaudin 1
1 irccyn-ivc
IRCCyN - Institut de Recherche en Communications et en Cybernétique de Nantes
2 LIUM - Laboratoire d'Informatique de l'Université du Mans
Abstract : The main goal of this work is to set up a multimodal system dedicated to mathematical expression recognition. In the proposed architecture, the transcription coming out from a speech recognition system is used to disambiguate the result of a handwriting recognition module. A set of keywords is built from the transcription module and used to rescore the outputs of both the handwriting classifier and the structural analysis module. Performances evaluated on theHAMEX dataset show a significant improvement over a single modality system.
Keywords : Mathematical expression Handwriting recognition Speech recognition Data Fusion
Document type :
Conference papers
Complete list of metadatas

Cited literature [14 references]  Display  Hide  Download
https://hal.archives-ouvertes.fr/hal-00717855
Contributor : Harold Mouchère <>
Submitted on : Monday, October 1, 2012 - 12:27:29 PM
Last modification on : Wednesday, December 19, 2018 - 3:02:08 PM
Long-term archiving on : Wednesday, January 2, 2013 - 2:50:11 AM

File

Medjkoune2012_MathExprReco.pdf
Publisher files allowed on an open archive

Identifiers

  • HAL Id : hal-00717855, version 1

Collections

UNIV-LEMANS | EC-NANTES | IRCCYN | UNIV-NANTES | UNAM | LIUM | LIUM-LST

Citation

Sofiane Medjkoune, Harold Mouchère, Simon Petitrenaud, Christian Viard-Gaudin. Using Speech for Handwritten Mathematical Expression Recognition Disambiguation. 2012 International Conference on Frontiers in Handwriting Recognition, Sep 2012, Bari, Italy. pp.1-6. ⟨hal-00717855⟩

Export

BibTeX TEI DC DCterms EndNote

Share

Metrics

Record views

381

Files downloads

296

Contact

support.ccsd.cnrs.fr
hal.support@ccsd.cnrs.fr
Logo CCSD