FigGen: Text to Scientific Figure Generation

06/01/2023
by   Juan A. Rodriguez, et al.
26

The generative modeling landscape has experienced tremendous growth in recent years, particularly in generating natural images and art. Recent techniques have shown impressive potential in creating complex visual compositions while delivering impressive realism and quality. However, state-of-the-art methods have been focusing on the narrow domain of natural images, while other distributions remain unexplored. In this paper, we introduce the problem of text-to-figure generation, that is creating scientific figures of papers from text descriptions. We present FigGen, a diffusion-based approach for text-to-figure as well as the main challenges of the proposed task. Code and models are available at https://github.com/joanrod/figure-diffusion

READ FULL TEXT

page 5

page 6

research
05/25/2023

Uni-ControlNet: All-in-One Control to Text-to-Image Diffusion Models

Text-to-Image diffusion models have made tremendous progress over the pa...
research
11/15/2022

Versatile Diffusion: Text, Images and Variations All in One Diffusion Model

The recent advances in diffusion models have set an impressive milestone...
research
05/22/2023

If at First You Don't Succeed, Try, Try Again: Faithful Diffusion-based Text-to-Image Generation by Selection

Despite their impressive capabilities, diffusion-based text-to-image (T2...
research
05/04/2023

Diffusion Explainer: Visual Explanation for Text-to-image Stable Diffusion

Diffusion-based generative models' impressive ability to create convinci...
research
08/31/2023

Generate Your Own Scotland: Satellite Image Generation Conditioned on Maps

Despite recent advancements in image generation, diffusion models still ...
research
08/30/2019

Alchemy: Techniques for Rectification Based Irregular Scene Text Recognition

Reading text from natural images is challenging due to the great variety...
research
10/19/2022

OCR-VQGAN: Taming Text-within-Image Generation

Synthetic image generation has recently experienced significant improvem...

Please sign up or login with your details

Forgot password? Click here to reset