Skip to Main content Skip to Navigation
New interface
Conference papers

Transformers for Historical Handwritten Text Recognition

Abstract : Handwritten documents are recently getting more and more publicly available, but searching efficiently information through them is difficult. Handwritten Text Recognition systems automatically transcribe documents and offer excellent solutions to make the content of handwritten documents available. Neural networks are currently the state-of-the-art approaches for this task. Recently, Transformer architectures have gained in popularity in many fields. We present the works we have done so far toward an efficient architecture using transformer layers for the field of Handwritten Text Recognition. Architectures using Transformer for Handwritten Text Recognition are presented. Our architectures aim to replace recurrent layers with transformers, while combining optical recognition and language modeling in end-to-end model. We manage to obtain state-of-the-art results on the IAM dataset with one of our architecture.
Complete list of metadata
Contributor : Killian Barrere Connect in order to contact the contributor
Submitted on : Friday, December 17, 2021 - 11:31:57 AM
Last modification on : Friday, August 5, 2022 - 2:54:52 PM
Long-term archiving on: : Friday, March 18, 2022 - 6:43:18 PM


Files produced by the author(s)


  • HAL Id : hal-03485262, version 1


Killian Barrere, Yann Soullard, Aurélie Lemaitre, Bertrand Coüasnon. Transformers for Historical Handwritten Text Recognition. Doctoral Consortium - ICDAR 2021, Nibal Nayef and Jean-Christophe Burie, Sep 2021, Lausanne, Switzerland. ⟨hal-03485262⟩



Record views


Files downloads