Counting with Adaptive Auxiliary Learning

03/08/2022
by   Yanda Meng, et al.
8

This paper proposes an adaptive auxiliary task learning based approach for object counting problems. Unlike existing auxiliary task learning based methods, we develop an attention-enhanced adaptively shared backbone network to enable both task-shared and task-tailored features learning in an end-to-end manner. The network seamlessly combines standard Convolution Neural Network (CNN) and Graph Convolution Network (GCN) for feature extraction and feature reasoning among different domains of tasks. Our approach gains enriched contextual information by iteratively and hierarchically fusing the features across different task branches of the adaptive CNN backbone. The whole framework pays special attention to the objects' spatial locations and varied density levels, informed by object (or crowd) segmentation and density level segmentation auxiliary tasks. In particular, thanks to the proposed dilated contrastive density loss function, our network benefits from individual and regional context supervision in terms of pixel-independent and pixel-dependent feature learning mechanisms, along with strengthened robustness. Experiments on seven challenging multi-domain datasets demonstrate that our method achieves superior performance to the state-of-the-art auxiliary task learning based counting methods. Our code is made publicly available at: https://github.com/smallmax00/Counting_With_Adaptive_Auxiliary

READ FULL TEXT

page 1

page 4

page 8

page 9

page 11

research
09/07/2022

Semi-supervised Crowd Counting via Density Agency

In this paper, we propose a new agency-guided semi-supervised counting a...
research
07/28/2021

Spatial Uncertainty-Aware Semi-Supervised Crowd Counting

Semi-supervised approaches for crowd counting attract attention, as the ...
research
08/23/2019

MTCNET: Multi-task Learning Paradigm for Crowd Count Estimation

We propose a Multi-Task Learning (MTL) paradigm based deep neural networ...
research
02/21/2022

Multiscale Crowd Counting and Localization By Multitask Point Supervision

We propose a multitask approach for crowd counting and person localizati...
research
05/04/2023

MTLSegFormer: Multi-task Learning with Transformers for Semantic Segmentation in Precision Agriculture

Multi-task learning has proven to be effective in improving the performa...
research
05/04/2020

Words aren't enough, their order matters: On the Robustness of Grounding Visual Referring Expressions

Visual referring expression recognition is a challenging task that requi...
research
04/12/2022

Medusa: Universal Feature Learning via Attentional Multitasking

Recent approaches to multi-task learning (MTL) have focused on modelling...

Please sign up or login with your details

Forgot password? Click here to reset