Stroke-Based Performance Metrics for Handwritten Mathematical Expressions

Richard Zanibbi 1, * Amit Pillay 1 Harold Mouchère 2 Christian Viard-Gaudin 2 Dorothea Blostein 3
* Corresponding author
2 irccyn-ivc
IRCCyN - Institut de Recherche en Communications et en Cybernétique de Nantes
Abstract : Evaluating mathematical expression recognition involves a complex interaction of input primitives (e.g. pen/finger strokes), recognized symbols, and recognized spatial structure. Existing performance metrics simplify this problem by separating the assessment of spatial structure from the assessment of symbol segmentation and classification. These metrics do not characterize the overall accuracy of a penbased mathematics recognition, making it difficult to compare math recognition algorithms, and preventing the use of machine learning algorithms requiring a criterion function characterizing overall system performance. To address this problem, we introduce performance metrics that bridge the gap from handwritten strokes to spatial structure. Our metrics are computed using bipartite graphs that represent classification, segmentation and spatial structure at the stroke level. Overall correctness of an expression is measured by counting the number of relabelings of nodes and edges needed to make the bipartite graph for a recognition result match the bipartite graph for ground truth. This metric may also be used with other primitive types (e.g. image pixels).
Complete list of metadatas

https://hal.archives-ouvertes.fr/hal-00615215
Contributor : Harold Mouchère <>
Submitted on : Thursday, August 18, 2011 - 11:49:39 AM
Last modification on : Wednesday, January 23, 2019 - 10:36:16 AM

Identifiers

  • HAL Id : hal-00615215, version 1

Collections

Citation

Richard Zanibbi, Amit Pillay, Harold Mouchère, Christian Viard-Gaudin, Dorothea Blostein. Stroke-Based Performance Metrics for Handwritten Mathematical Expressions. 11th International Conference on Document Analysis and Recognition, ICDAR 2011, Sep 2011, Beijing, China. ⟨hal-00615215⟩

Share

Metrics

Record views

147