Text and Style Conditioned GAN for Generation of Offline Handwriting Lines

09/01/2020
by   Brian Davis, et al.
2

This paper presents a GAN for generating images of handwritten lines conditioned on arbitrary text and latent style vectors. Unlike prior work, which produce stroke points or single-word images, this model generates entire lines of offline handwriting. The model produces variable-sized images by using style vectors to determine character widths. A generator network is trained with GAN and autoencoder techniques to learn style, and uses a pre-trained handwriting recognition network to induce legibility. A study using human evaluators demonstrates that the model produces images that appear to be written by a human. After training, the encoder network can extract a style vector from an image, allowing images in a similar style to be generated, but with arbitrary text.

READ FULL TEXT

page 5

page 16

page 31

research
03/01/2019

Adversarial Generation of Handwritten Text Images Conditioned on Sequences

State-of-the-art offline handwriting text recognition systems tend to us...
research
05/29/2019

GlyphGAN: Style-Consistent Font Generation Based on Generative Adversarial Networks

In this paper, we propose GlyphGAN: style-consistent font generation bas...
research
12/20/2018

Generating lyrics with variational autoencoder and multi-modal artist embeddings

We present a system for generating song lyrics lines conditioned on the ...
research
04/08/2021

Handwriting Transformers

We propose a novel transformer-based styled handwritten text image gener...
research
06/13/2017

Adversarially Regularized Autoencoders

While autoencoders are a key technique in representation learning for co...
research
12/22/2021

JoJoGAN: One Shot Face Stylization

While there have been recent advances in few-shot image stylization, the...
research
03/05/2020

GANwriting: Content-Conditioned Generation of Styled Handwritten Word Images

Although current image generation methods have reached impressive qualit...

Please sign up or login with your details

Forgot password? Click here to reset