Approches multimodales pour la reconnaissance d’expressions mathématiques

Abstract : In this paper, we report some results related to mathematical expression recognition. We tackle this problem, known to be very difficult, using multimodal information –handwriting and speech–. This bimodality aspect of the information provides greater reliability since the modalities in concern are very complementary. We present a complete operating system in which the fusion process is done in every step of the mathematical expression recognition process (symbol identification, relation identification and interpretation). The bimodal system is evaluated on real bimodal data from the HAMEX dataset and the obtained results are compared to a single modality (handwriting) based system.
Document type :
Journal articles
Complete list of metadatas

https://hal.archives-ouvertes.fr/hal-01150818
Contributor : Harold Mouchère <>
Submitted on : Monday, May 11, 2015 - 9:26:57 PM
Last modification on : Wednesday, December 19, 2018 - 3:02:05 PM

Identifiers

  • HAL Id : hal-01150818, version 1

Citation

Sofiane Medjkoune, Harold Mouchère, Simon Petitrenaud, Christian Viard-Gaudin. Approches multimodales pour la reconnaissance d’expressions mathématiques. Revue des Sciences et Technologies de l'Information - Série Document Numérique, Lavoisier, 2014, 17 (3), pp.97-122. ⟨http://www.cairn.info/revue-document-numerique-2014-3-page-97.htm⟩. ⟨hal-01150818⟩

Share

Metrics

Record views

227