Stroke Extraction of Chinese Character Based on Deep Structure Deformable Image Registration

by   Meng Li, et al.

Stroke extraction of Chinese characters plays an important role in the field of character recognition and generation. The most existing character stroke extraction methods focus on image morphological features. These methods usually lead to errors of cross strokes extraction and stroke matching due to rarely using stroke semantics and prior information. In this paper, we propose a deep learning-based character stroke extraction method that takes semantic features and prior information of strokes into consideration. This method consists of three parts: image registration-based stroke registration that establishes the rough registration of the reference strokes and the target as prior information; image semantic segmentation-based stroke segmentation that preliminarily separates target strokes into seven categories; and high-precision extraction of single strokes. In the stroke registration, we propose a structure deformable image registration network to achieve structure-deformable transformation while maintaining the stable morphology of single strokes for character images with complex structures. In order to verify the effectiveness of the method, we construct two datasets respectively for calligraphy characters and regular handwriting characters. The experimental results show that our method strongly outperforms the baselines. Code is available at


page 2

page 3

page 5

page 6

page 7


Unsupervised Deformable Image Registration with Absent Correspondences in Pre-operative and Post-Recurrence Brain Tumor MRI Scans

Registration of pre-operative and post-recurrence brain images is often ...

Chinese Text Recognition with A Pre-Trained CLIP-Like Model Through Image-IDS Aligning

Scene text recognition has been studied for decades due to its broad app...

Stroke-Based Autoencoders: Self-Supervised Learners for Efficient Zero-Shot Chinese Character Recognition

Chinese characters carry a wealth of morphological and semantic informat...

INSPIRE: Intensity and Spatial Information-Based Deformable Image Registration

We present INSPIRE, a top-performing general-purpose method for deformab...

XMorpher: Full Transformer for Deformable Medical Image Registration via Cross Attention

An effective backbone network is important to deep learning-based Deform...

Towards Saner Deep Image Registration

With recent advances in computing hardware and surges of deep-learning a...

Joint Facade Registration and Segmentation for Urban Localization

This paper presents an efficient approach for solving jointly facade reg...

Please sign up or login with your details

Forgot password? Click here to reset