Generate Your Own Scotland: Satellite Image Generation Conditioned on Maps

08/31/2023
by   Miguel Espinosa, et al.
0

Despite recent advancements in image generation, diffusion models still remain largely underexplored in Earth Observation. In this paper we show that state-of-the-art pretrained diffusion models can be conditioned on cartographic data to generate realistic satellite images. We provide two large datasets of paired OpenStreetMap images and satellite views over the region of Mainland Scotland and the Central Belt. We train a ControlNet model and qualitatively evaluate the results, demonstrating that both image quality and map fidelity are possible. Finally, we provide some insights on the opportunities and challenges of applying these models for remote sensing. Our model weights and code for creating the dataset are publicly available at https://github.com/miquel-espinosa/map-sat.

READ FULL TEXT

page 1

page 2

page 4

page 6

page 7

page 8

research
08/31/2023

Diffusion Models for Interferometric Satellite Aperture Radar

Probabilistic Diffusion Models (PDMs) have recently emerged as a very pr...
research
08/08/2023

DiffCR: A Fast Conditional Diffusion Framework for Cloud Removal from Optical Satellite Images

Optical satellite images are a critical data source; however, cloud cove...
research
09/03/2023

RSDiff: Remote Sensing Image Generation from Text Using Diffusion Model

Satellite imagery generation and super-resolution are pivotal tasks in r...
research
05/22/2023

AudioToken: Adaptation of Text-Conditioned Diffusion Models for Audio-to-Image Generation

In recent years, image generation has shown a great leap in performance,...
research
04/09/2023

NeRF applied to satellite imagery for surface reconstruction

We present Sat-NeRF, a modified implementation of the recently introduce...
research
06/01/2023

FigGen: Text to Scientific Figure Generation

The generative modeling landscape has experienced tremendous growth in r...

Please sign up or login with your details

Forgot password? Click here to reset