HAL will be down for maintenance from Friday, June 10 at 4pm through Monday, June 13 at 9am. More information
Skip to Main content Skip to Navigation

New Architectures for Handwritten Mathematical Expressions Recognition

Ting Zhang 1, 2
Abstract : As an appealing topic in pattern recognition, handwritten mathematical expression recognition exhibits a big research challenge and underpins many practical applications. Both a large set of symbols (more than 100) and 2-D structures increase the difficulty of this recognition problem. In this thesis, we focus on online handwritten mathematical expression recognition using BLSTM and CTC topology, and finally build a graph-driven recognition system, bypassing the high time complexity and manual work in the classical grammar-driven systems. To allow the 2-D structured language to be handled by the sequence classifier, we extend the chain-structured BLSTM to an original Tree-based BLSTM, which could label a tree structured data. The CTC layer is adapted with local constraints, to align the outputs and at the same time benefit from introducing the additional ’blank’ class. The proposed system addresses the recognition task as a graph building problem. The input expression is a sequence of strokes, and then an intermediate graph is derived considering temporal and spatial relations among strokes. Next, several trees are derived from the graph and labeled with Tree-based BLSTM. The last step is to merge these labeled trees to build an admissible stroke label graph (SLG) modeling 2-D formulas uniquely. One major difference with the traditional approaches is that there is no explicit segmentation, recognition and layout extraction steps but a unique trainable system that produces directly a SLG describing a mathematical expression. The proposed system, without any grammar, achieves competitive results in online math expression recognition domain.
Complete list of metadata

Cited literature [89 references]  Display  Hide  Download

Contributor : Harold Mouchère Connect in order to contact the contributor
Submitted on : Friday, March 30, 2018 - 9:50:38 AM
Last modification on : Wednesday, April 27, 2022 - 3:48:00 AM


New Architectures for Handwrit...
Files produced by the author(s)


  • HAL Id : tel-01754478, version 1


Ting Zhang. New Architectures for Handwritten Mathematical Expressions Recognition. Image Processing [eess.IV]. Université de nantes, 2017. English. ⟨tel-01754478⟩



Record views


Files downloads