Disjoint Contrastive Regression Learning for Multi-Sourced Annotations

by   Xiaoqian Ruan, et al.

Large-scale datasets are important for the development of deep learning models. Such datasets usually require a heavy workload of annotations, which are extremely time-consuming and expensive. To accelerate the annotation procedure, multiple annotators may be employed to label different subsets of the data. However, the inconsistency and bias among different annotators are harmful to the model training, especially for qualitative and subjective tasks.To address this challenge, in this paper, we propose a novel contrastive regression framework to address the disjoint annotations problem, where each sample is labeled by only one annotator and multiple annotators work on disjoint subsets of the data. To take account of both the intra-annotator consistency and inter-annotator inconsistency, two strategies are employed.Firstly, a contrastive-based loss is applied to learn the relative ranking among different samples of the same annotator, with the assumption that the ranking of samples from the same annotator is unanimous. Secondly, we apply the gradient reversal layer to learn robust representations that are invariant to different annotators. Experiments on the facial expression prediction task, as well as the image quality assessment task, verify the effectiveness of our proposed framework.


page 3

page 4


Class adaptive threshold and negative class guided noisy annotation robust Facial Expression Recognition

The hindering problem in facial expression recognition (FER) is the pres...

Learning from Mixed Datasets: A Monotonic Image Quality Assessment Model

Deep learning based image quality assessment (IQA) models usually learn ...

Image Quality Assessment using Contrastive Learning

We consider the problem of obtaining image quality representations in a ...

Find Beauty in the Rare: Contrastive Composition Feature Clustering for Nontrivial Cropping Box Regression

Automatic image cropping algorithms aim to recompose images like human-b...

Dynamic Adaptive Threshold based Learning for Noisy Annotations Robust Facial Expression Recognition

The real-world facial expression recognition (FER) datasets suffer from ...

I2CR: Improving Noise Robustness on Keyword Spotting Using Inter-Intra Contrastive Regularization

Noise robustness in keyword spotting remains a challenge as many models ...

Please sign up or login with your details

Forgot password? Click here to reset