Multiresolution Textual Inversion

11/30/2022
by   Giannis Daras, et al.
0

We extend Textual Inversion to learn pseudo-words that represent a concept at different resolutions. This allows us to generate images that use the concept with different levels of detail and also to manipulate different resolutions using language. Once learned, the user can generate images at different levels of agreement to the original concept; "A photo of S^*(0)" produces the exact object while the prompt "A photo of S^*(0.8)" only matches the rough outlines and colors. Our framework allows us to generate images that use different resolutions of an image (e.g. details, textures, styles) as separate pseudo-words that can be composed in various ways. We open-soure our code in the following URL: https://github.com/giannisdaras/multires_textual_inversion

READ FULL TEXT

page 1

page 3

page 4

research
08/02/2022

An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversion

Text-to-image models offer unprecedented freedom to guide creation throu...
research
08/21/2023

Backdooring Textual Inversion for Concept Censorship

Recent years have witnessed success in AIGC (AI Generated Content). Peop...
research
11/23/2022

Inversion-Based Style Transfer with Diffusion Models

The artistic style within a painting is the means of expression, which i...
research
08/15/2023

Inversion-by-Inversion: Exemplar-based Sketch-to-Photo Synthesis via Stochastic Differential Equations without Training

Exemplar-based sketch-to-photo synthesis allows users to generate photo-...
research
09/12/2023

Catch You Everything Everywhere: Guarding Textual Inversion via Concept Watermarking

AIGC (AI-Generated Content) has achieved tremendous success in many appl...
research
08/03/2023

Lode Enhancer: Level Co-creation Through Scaling

We explore AI-powered upscaling as a design assistance tool in the conte...
research
10/24/2022

IQUAFLOW: A new framework to measure image quality

IQUAFLOW is a new image quality framework that provides a set of tools t...

Please sign up or login with your details

Forgot password? Click here to reset