Not Only Generative Art: Stable Diffusion for Content-Style Disentanglement in Art Analysis

by   Yankun Wu, et al.

The duality of content and style is inherent to the nature of art. For humans, these two elements are clearly different: content refers to the objects and concepts in the piece of art, and style to the way it is expressed. This duality poses an important challenge for computer vision. The visual appearance of objects and concepts is modulated by the style that may reflect the author's emotions, social trends, artistic movement, etc., and their deep comprehension undoubtfully requires to handle both. A promising step towards a general paradigm for art analysis is to disentangle content and style, whereas relying on human annotations to cull a single aspect of artworks has limitations in learning semantic concepts and the visual appearance of paintings. We thus present GOYA, a method that distills the artistic knowledge captured in a recent generative model to disentangle content and style. Experiments show that synthetically generated images sufficiently serve as a proxy of the real distribution of artworks, allowing GOYA to separately represent the two elements of art while keeping more information than existing methods.


page 1

page 5

page 7

page 12

page 13

page 14


Formal Analysis of Art: Proxy Learning of Visual Concepts from Style Through Language Models

We present a machine learning system that can quantify fine art painting...

LiveStyle – An Application to Transfer Artistic Styles

Art is a variety of human activities that include the production of visu...

Demographic Influences on Contemporary Art with Unsupervised Style Embeddings

Computational art analysis has, through its reliance on classification t...

PARASOL: Parametric Style Control for Diffusion Image Synthesis

We propose PARASOL, a multi-modal synthesis model that enables disentang...

MIXGAN: Learning Concepts from Different Domains for Mixture Generation

In this work, we present an interesting attempt on mixture generation: a...

Understanding Ancient Coin Images

In recent years, a range of problems within the broad umbrella of automa...

Automatic Modeling of Social Concepts Evoked by Art Images as Multimodal Frames

Social concepts referring to non-physical objects–such as revolution, vi...

Please sign up or login with your details

Forgot password? Click here to reset