New Spatial-Organization-Based Scale and Rotation Invariant Features for Heterogeneous-Content Camera-Based Document Image Retrieval

Quoc Bao Dang (1) , Mickal Coustaty , Muhammad Muzzamil Luqman (1) , Jean Marc Ogier , Cao Dê Tran (2)

1 L3I - Laboratoire Informatique, Image et Interaction - EA 2118
2 ICT department

In this paper, we extend our earlier proposed feature descriptor named Scale and Rotation Invariant Features (SRIF) and a camera-based heterogeneous-content information spotting system based on the latter. Through its capacity to manage heterogeneous content in document images, SRIF represents an extension to existing strategies such as LLAH, which are dedicated to textual document images. This paper proposes new extensions of SRIF based on geometrical constraints between pairs of nearest points around a keypoint. SRIF has built-in capabilities to deal with feature point extraction errors which are introduced in camera-captured documents. To validate our method and compare it to the state-of-the-art, we have constructed three datasets of heterogeneous-content document images, along with the corresponding ground truths. Our experiment results confirm that SRIF outperforms the state-of-the-art in terms of processing time with equal or greater recall and precision for retrieval and spotting results.

Mots clés: Document capture Feature extraction Feature descriptor Feature evaluation Feature selection Document indexing Information search and retrieval Camera-based document analysis and recognition Document image retrieval Query by example Pattern recognition

Domaines: Vision par ordinateur et reconnaissance de formes [cs.CV]; Traitement du texte et du document

Quoc Bao Dang, Mickal Coustaty, Muhammad Muzzamil Luqman, Jean Marc Ogier, Cao Dê Tran. New Spatial-Organization-Based Scale and Rotation Invariant Features for Heterogeneous-Content Camera-Based Document Image Retrieval. Pattern Recognition Letters, 2018, ⟨10.1016/j.patrec.2018.07.009⟩. ⟨hal-01838116⟩