SmartDoc 2017 Video Capture: Mobile Document Acquisition in Video Mode

J Chazalon (1, 2) , Petra Gomez-Krämer (1) , J.-C Burie (1) , M Coustaty (1) , S Eskenazi (1) , M Luqman (1) , N Nayef (1) , M Rusiñol (3) , N. Sidère (1) , J.-M Ogier (1)

1 L3I - Laboratoire Informatique, Image et Interaction - EA 2118
2 LRDE - Laboratoire de Recherche et de Développement de l'EPITA
3 CVC - Computer Vision Center (Centre de visio per computador)

As mobile document acquisition using smartphones is getting more and more common, along with the continuous improvement of mobile devices (both in terms of computing power and image quality), we can wonder to which extent mobile phones can replace desktop scanners. Modern applications can cope with perspective distortion and normalize the contrast of a document page captured with a smartphone, and in some cases like bottle labels or posters, smartphones even have the advantage of allowing the acquisition of non-flat or large documents. However, several cases remain hard to handle, such as reflective documents (identity cards, badges, glossy magazine cover, etc.) or large documents for which some regions require an important amount of detail. This paper introduces the SmartDoc 2017 benchmark (named "SmartDoc Video Capture"), which aims at assessing whether capturing documents using the video mode of a smartphone could solve those issues. The task under evaluation is both a stitching and a reconstruction problem, as the user can move the device over different parts of the document to capture details or try to erase highlights. The material released consists of a dataset, an evaluation method and the associated tool, a sample method, and the tools required to extend the dataset. All the components are released publicly under very permissive licenses, and we particularly cared about maximizing the ease of understanding, usage and improvement.

Domaines: Traitement des images [eess.IV]; Intelligence artificielle [cs.AI]; Informatique et langage [cs.CL]; Vision par ordinateur et reconnaissance de formes [cs.CV]; Bibliothèque électronique [cs.DL]; Interface homme-machine [cs.HC]; Recherche d'information [cs.IR]; Apprentissage [cs.LG]; Traitement du texte et du document

J Chazalon, Petra Gomez-Krämer, J.-C Burie, M Coustaty, S Eskenazi, et al.. SmartDoc 2017 Video Capture: Mobile Document Acquisition in Video Mode. International Workshop on Open Services and Tools for Document Analysis (ICDAR-OST), Nov 2017, Kyoto, Japan. pp.11-16, ⟨10.1109/ICDAR.2017.306⟩. ⟨hal-01900024⟩