MOST-Net: A Memory Oriented Style Transfer Network for Face Sketch Synthesis

by   Fan Ji, et al.
Beijing University of Posts and Telecommunications

Face sketch synthesis has been widely used in multi-media entertainment and law enforcement. Despite the recent developments in deep neural networks, accurate and realistic face sketch synthesis is still a challenging task due to the diversity and complexity of human faces. Current image-to-image translation-based face sketch synthesis frequently encounters over-fitting problems when it comes to small-scale datasets. To tackle this problem, we present an end-to-end Memory Oriented Style Transfer Network (MOST-Net) for face sketch synthesis which can produce high-fidelity sketches with limited data. Specifically, an external self-supervised dynamic memory module is introduced to capture the domain alignment knowledge in the long term. In this way, our proposed model could obtain the domain-transfer ability by establishing the durable relationship between faces and corresponding sketches on the feature level. Furthermore, we design a novel Memory Refinement Loss (MR Loss) for feature alignment in the memory module, which enhances the accuracy of memory slots in an unsupervised manner. Extensive experiments on the CUFS and the CUFSF datasets show that our MOST-Net achieves state-of-the-art performance, especially in terms of the Structural Similarity Index(SSIM).


page 1

page 3

page 5


Self-Supervised Sketch-to-Image Synthesis

Imagining a colored realistic image from an arbitrarily drawn sketch is ...

Face Sketch Synthesis with Style Transfer using Pyramid Column Feature

In this paper, we propose a novel framework based on deep neural network...

Face Sketch Synthesis via Semantic-Driven Generative Adversarial Network

Face sketch synthesis has made significant progress with the development...

r-BTN: Cross-domain Face Composite and Synthesis from Limited Facial Patches

We start by asking an interesting yet challenging question, "If an eyewi...

Deep Facial Synthesis: A New Challenge

The goal of this paper is to conduct a comprehensive study on the facial...

Style Transfer for Anime Sketches with Enhanced Residual U-net and Auxiliary Classifier GAN

Recently, with the revolutionary neural style transferring methods, cred...

Random Sampling for Fast Face Sketch Synthesis

Exemplar-based face sketch synthesis plays an important role in both dig...

Please sign up or login with your details

Forgot password? Click here to reset