Text Edges Guided Network for Historical Document Super Resolution

Boraq Madi, Reem Alaasam, Jihad El-Sana

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

1 Scopus citations

Abstract

Super-resolution aims to increase the resolution and the clarity of the details in low-resolution images, and document images are no exception. Although significant improvements have been achieved in super-resolution for different domains, historical document images have not been addressed well. Most of the current works in the text domain deal with modern fonts and rely on extracting prior semantic information from a recognizer to super-resolve images. The absence of a reliable handwritten recognizer for Arabic documents, where historical documents have a complex structure and overlapping parts, makes these text-domain works inapplicable. This paper presents a Text-Attention-ed Super Resolution GAN (TASR-GAN) to address this problem. The model deals with historical Arabic documents and does not rely on prior semantic information. Since our input domain documents, text edges are essential for quality and readability; thus, we introduce a new loss function called text edge loss. This loss function provides more attention and weight to text edge information and guides through optimization to super-resolve images with accurate small regions’ details and fine edges to improve image quality. Experiments on six Arabic manuscripts show that the proposed TASR achieves state-of-the-art performance in terms of PSNR/SSIM metrics and significantly improves the visual image quality, mainly the edges of small regions details, and eliminates artifacts noises. Also, a grid search experiment has been conducted to tune the best hyperparameters values for our text edge loss function.

Original languageEnglish
Title of host publicationFrontiers in Handwriting Recognition - 18th International Conference, ICFHR 2022, Proceedings
EditorsUtkarsh Porwal, Alicia Fornés, Faisal Shafait
PublisherSpringer Science and Business Media Deutschland GmbH
Pages18-33
Number of pages16
ISBN (Print)9783031216473
DOIs
StatePublished - 1 Jan 2022
Event18th International Conference on Frontiers in Handwriting Recognition, ICFHR 2022 - Hyderabad, India
Duration: 4 Dec 20227 Dec 2022

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume13639 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference18th International Conference on Frontiers in Handwriting Recognition, ICFHR 2022
Country/TerritoryIndia
CityHyderabad
Period4/12/227/12/22

Keywords

  • Generative adversarial networks
  • Historical handwritten documents
  • Super-resolution

ASJC Scopus subject areas

  • Theoretical Computer Science
  • General Computer Science

Fingerprint

Dive into the research topics of 'Text Edges Guided Network for Historical Document Super Resolution'. Together they form a unique fingerprint.

Cite this