Geography-Aware Self-Supervised Learning

11/19/2020
by   Kumar Ayush, et al.
2

Contrastive learning methods have significantly narrowed the gap between supervised and unsupervised learning on computer vision tasks. In this paper, we explore their application to remote sensing, where unlabeled data is often abundant but labeled data is scarce. We first show that due to their different characteristics, a non-trivial gap persists between contrastive and supervised learning on standard benchmarks. To close the gap, we propose novel training methods that exploit the spatiotemporal structure of remote sensing data. We leverage spatially aligned images over time to construct temporal positive pairs in contrastive learning and geo-location to design pre-text tasks. Our experiments show that our proposed method closes the gap between contrastive and supervised learning on image classification, object detection and semantic segmentation for remote sensing and other geo-tagged image datasets

READ FULL TEXT

page 3

page 4

page 5

page 7

research
06/20/2021

Remote Sensing Images Semantic Segmentation with General Remote Sensing Vision Model via a Self-Supervised Contrastive Learning Method

A new learning paradigm, self-supervised learning (SSL), can be used to ...
research
09/06/2022

Multimodal contrastive learning for remote sensing tasks

Self-supervised methods have shown tremendous success in the field of co...
research
11/24/2022

Contrastive pretraining for semantic segmentation is robust to noisy positive pairs

Domain-specific variants of contrastive learning can construct positive ...
research
04/13/2023

A Contrastive Method Based on Elevation Data for Remote Sensing with Scarce and High Level Semantic Labels

This work proposes a hybrid unsupervised/supervised learning method to p...
research
06/28/2023

GraSS: Contrastive Learning with Gradient Guided Sampling Strategy for Remote Sensing Image Semantic Segmentation

Self-supervised contrastive learning (SSCL) has achieved significant mil...
research
02/11/2023

Multispectral Self-Supervised Learning with Viewmaker Networks

Contrastive learning methods have been applied to a range of domains and...
research
04/10/2022

TOV: The Original Vision Model for Optical Remote Sensing Image Understanding via Self-supervised Learning

Do we on the right way for remote sensing image understanding (RSIU) by ...

Please sign up or login with your details

Forgot password? Click here to reset