A Self-Training Framework Based on Multi-Scale Attention Fusion for Weakly Supervised Semantic Segmentation

05/10/2023
by   Guoqing Yang, et al.
5

Weakly supervised semantic segmentation (WSSS) based on image-level labels is challenging since it is hard to obtain complete semantic regions. To address this issue, we propose a self-training method that utilizes fused multi-scale class-aware attention maps. Our observation is that attention maps of different scales contain rich complementary information, especially for large and small objects. Therefore, we collect information from attention maps of different scales and obtain multi-scale attention maps. We then apply denoising and reactivation strategies to enhance the potential regions and reduce noisy areas. Finally, we use the refined attention maps to retrain the network. Experiments showthat our method enables the model to extract rich semantic information from multi-scale images and achieves 72.4 PASCAL VOC 2012 validation and test sets. The code is available at https://bupt-ai-cz.github.io/SMAF.

READ FULL TEXT

page 1

page 3

page 4

page 5

research
04/03/2023

WeakTr: Exploring Plain Vision Transformer for Weakly-supervised Semantic Segmentation

This paper explores the properties of the plain Vision Transformer (ViT)...
research
12/10/2021

Exploring Pixel-level Self-supervision for Weakly Supervised Semantic Segmentation

Existing studies in weakly supervised semantic segmentation (WSSS) have ...
research
08/26/2021

Self-supervised Multi-scale Consistency for Weakly Supervised Segmentation Learning

Collecting large-scale medical datasets with fine-grained annotations is...
research
07/09/2018

Attention to Refine through Multi-Scales for Semantic Segmentation

This paper proposes a novel attention model for semantic segmentation, w...
research
11/29/2022

Segment-based fusion of multi-sensor multi-scale satellite soil moisture retrievals

Synergetic use of sensors for soil moisture retrieval is attracting cons...
research
07/18/2023

CG-fusion CAM: Online segmentation of laser-induced damage on large-aperture optics

Online segmentation of laser-induced damage on large-aperture optics in ...
research
05/21/2020

Hierarchical Multi-Scale Attention for Semantic Segmentation

Multi-scale inference is commonly used to improve the results of semanti...

Please sign up or login with your details

Forgot password? Click here to reset