GenText: Unsupervised Artistic Text Generation via Decoupled Font and Texture Manipulation

07/20/2022
by   Qirui Huang, et al.
0

Automatic artistic text generation is an emerging topic which receives increasing attention due to its wide applications. The artistic text can be divided into three components, content, font, and texture, respectively. Existing artistic text generation models usually focus on manipulating one aspect of the above components, which is a sub-optimal solution for controllable general artistic text generation. To remedy this issue, we propose a novel approach, namely GenText, to achieve general artistic text style transfer by separably migrating the font and texture styles from the different source images to the target images in an unsupervised manner. Specifically, our current work incorporates three different stages, stylization, destylization, and font transfer, respectively, into a unified platform with a single powerful encoder network and two separate style generator networks, one for font transfer, the other for stylization and destylization. The destylization stage first extracts the font style of the font reference image, then the font transfer stage generates the target content with the desired font style. Finally, the stylization stage renders the resulted font image with respect to the texture style in the reference image. Moreover, considering the difficult data acquisition of paired artistic text images, our model is designed under the unsupervised setting, where all stages can be effectively optimized from unpaired data. Qualitative and quantitative results are performed on artistic text benchmarks, which demonstrate the superior performance of our proposed model. The code with models will become publicly available in the future.

READ FULL TEXT

page 2

page 5

page 12

page 13

page 14

research
12/01/2021

CLIPstyler: Image Style Transfer with a Single Text Condition

Existing neural style transfer methods require reference style images to...
research
05/07/2020

Learning Implicit Text Generation via Feature Matching

Generative feature matching network (GFMN) is an approach for training i...
research
05/28/2019

Unsupervised Controllable Text Generation with Global Variation Discovery and Disentanglement

Existing controllable text generation systems rely on annotated attribut...
research
03/02/2020

Style Example-Guided Text Generation using Generative Adversarial Transformers

We introduce a language generative model framework for generating a styl...
research
05/05/2023

Stylized Data-to-Text Generation: A Case Study in the E-Commerce Domain

Existing data-to-text generation efforts mainly focus on generating a co...
research
10/07/2022

Unsupervised Neural Stylistic Text Generation using Transfer learning and Adapters

Research has shown that personality is a key driver to improve engagemen...
research
02/24/2020

Learning to Select Bi-Aspect Information for Document-Scale Text Content Manipulation

In this paper, we focus on a new practical task, document-scale text con...

Please sign up or login with your details

Forgot password? Click here to reset