Generate Your Own Scotland: Satellite Image Generation Conditioned on Maps

by   Miguel Espinosa, et al.

Despite recent advancements in image generation, diffusion models still remain largely underexplored in Earth Observation. In this paper we show that state-of-the-art pretrained diffusion models can be conditioned on cartographic data to generate realistic satellite images. We provide two large datasets of paired OpenStreetMap images and satellite views over the region of Mainland Scotland and the Central Belt. We train a ControlNet model and qualitatively evaluate the results, demonstrating that both image quality and map fidelity are possible. Finally, we provide some insights on the opportunities and challenges of applying these models for remote sensing. Our model weights and code for creating the dataset are publicly available at


page 1

page 2

page 4

page 6

page 7

page 8


Diffusion Models for Interferometric Satellite Aperture Radar

Probabilistic Diffusion Models (PDMs) have recently emerged as a very pr...

DiffCR: A Fast Conditional Diffusion Framework for Cloud Removal from Optical Satellite Images

Optical satellite images are a critical data source; however, cloud cove...

RSDiff: Remote Sensing Image Generation from Text Using Diffusion Model

Satellite imagery generation and super-resolution are pivotal tasks in r...

AudioToken: Adaptation of Text-Conditioned Diffusion Models for Audio-to-Image Generation

In recent years, image generation has shown a great leap in performance,...

NeRF applied to satellite imagery for surface reconstruction

We present Sat-NeRF, a modified implementation of the recently introduce...

FigGen: Text to Scientific Figure Generation

The generative modeling landscape has experienced tremendous growth in r...

Please sign up or login with your details

Forgot password? Click here to reset