Free Lunch for Co-Saliency Detection: Context Adjustment

by   Lingdong Kong, et al.
Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences
University of Illinois at Urbana-Champaign
Nanyang Technological University

We unveil a long-standing problem in the prevailing co-saliency detection systems: there is indeed inconsistency between training and testing. Constructing a high-quality co-saliency detection dataset involves time-consuming and labor-intensive pixel-level labeling, which has forced most recent works to rely instead on semantic segmentation or saliency detection datasets for training. However, the lack of proper co-saliency and the absence of multiple foreground objects in these datasets can lead to spurious variations and inherent biases learned by models. To tackle this, we introduce the idea of counterfactual training through context adjustment, and propose a "cost-free" group-cut-paste (GCP) procedure to leverage images from off-the-shelf saliency detection datasets and synthesize new samples. Following GCP, we collect a novel dataset called Context Adjustment Training. The two variants of our dataset, i.e., CAT and CAT+, consist of 16,750 and 33,500 images, respectively. All images are automatically annotated with high-quality masks. As a side-product, object categories, as well as edge information, are also provided to facilitate other related works. Extensive experiments with state-of-the-art models are conducted to demonstrate the superiority of our dataset. We hope that the scale, diversity, and quality of CAT/CAT+ can benefit researchers in this area and beyond. The dataset and benchmark toolkit will be accessible through our project page.


page 1

page 4

page 5

page 6

page 8


STC: A Simple to Complex Framework for Weakly-supervised Semantic Segmentation

Recently, significant improvement has been made on semantic object segme...

Grid Saliency for Context Explanations of Semantic Segmentation

Recently, there has been a growing interest in developing saliency metho...

Gradient-Induced Co-Saliency Detection

Co-saliency detection (Co-SOD) aims to segment the common salient foregr...

Triple-cooperative Video Shadow Detection

Shadow detection in a single image has received significant research int...

ATLANTIS: A Benchmark for Semantic Segmentation of Waterbody Images

Vision-based semantic segmentation of waterbodies and nearby related obj...

Comprehensive Saliency Fusion for Object Co-segmentation

Object co-segmentation has drawn significant attention in recent years, ...

Big GANs Are Watching You: Towards Unsupervised Object Segmentation with Off-the-Shelf Generative Models

Since collecting pixel-level groundtruth data is expensive, unsupervised...

Please sign up or login with your details

Forgot password? Click here to reset