SketchyScene: Richly-Annotated Scene Sketches

08/07/2018
by   Changqing Zou, et al.
0

We contribute the first large-scale dataset of scene sketches, SketchyScene, with the goal of advancing research on sketch understanding at both the object and scene level. The dataset is created through a novel and carefully designed crowdsourcing pipeline, enabling users to efficiently generate large quantities of realistic and diverse scene sketches. SketchyScene contains more than 29,000 scene-level sketches, 7,000+ pairs of scene templates and photos, and 11,000+ object sketches. All objects in the scene sketches have ground-truth semantic and instance masks. The dataset is also highly scalable and extensible, easily allowing augmenting and/or changing scene composition. We demonstrate the potential impact of SketchyScene by training new computational models for semantic segmentation of scene sketches and showing how the new dataset enables several applications including image retrieval, sketch colorization, editing, and captioning, etc. The dataset and code can be found at https://github.com/SketchyScene/SketchyScene.

READ FULL TEXT

page 7

page 8

page 14

research
04/03/2020

Google Landmarks Dataset v2 – A Large-Scale Benchmark for Instance-Level Recognition and Retrieval

While image retrieval and instance recognition techniques are progressin...
research
03/04/2022

FS-COCO: Towards Understanding of Freehand Sketches of Common Objects in Context

We advance sketch research to scenes with the first dataset of freehand ...
research
08/30/2018

LUCSS: Language-based User-customized Colourization of Scene Sketches

We introduce LUCSS, a language-based system for interactive col- orizati...
research
08/19/2023

DESOBAv2: Towards Large-scale Real-world Dataset for Shadow Generation

Image composition refers to inserting a foreground object into a backgro...
research
04/25/2022

SceneTrilogy: On Scene Sketches and its Relationship with Text and Photo

We for the first time extend multi-modal scene understanding to include ...
research
03/17/2022

TO-Scene: A Large-scale Dataset for Understanding 3D Tabletop Scenes

Many basic indoor activities such as eating or writing are always conduc...
research
03/24/2023

AssetField: Assets Mining and Reconfiguration in Ground Feature Plane Representation

Both indoor and outdoor environments are inherently structured and repet...

Please sign up or login with your details

Forgot password? Click here to reset