Unbiased Loss Functions for Extreme Classification With Missing Labels

by   Erik Schultheis, et al.

The goal in extreme multi-label classification (XMC) is to tag an instance with a small subset of relevant labels from an extremely large set of possible labels. In addition to the computational burden arising from large number of training instances, features and labels, problems in XMC are faced with two statistical challenges, (i) large number of 'tail-labels' – those which occur very infrequently, and (ii) missing labels as it is virtually impossible to manually assign every relevant label to an instance. In this work, we derive an unbiased estimator for general formulation of loss functions which decompose over labels, and then infer the forms for commonly used loss functions such as hinge- and squared-hinge-loss and binary cross-entropy loss. We show that the derived unbiased estimators, in the form of appropriate weighting factors, can be easily incorporated in state-of-the-art algorithms for extreme classification, thereby scaling to datasets with hundreds of thousand labels. However, empirically, we find a slightly altered version that gives more relative weight to tail labels to perform even better. We suspect is due to the label imbalance in the dataset, which is not explicitly addressed by our theoretically derived estimator. Minimizing the proposed loss functions leads to significant improvement over existing methods (up to 20 benchmark datasets in XMC.


Adversarial Extreme Multi-label Classification

The goal in extreme multi-label classification is to learn a classifier ...

Unbiased Loss Functions for Multilabel Classification with Missing Labels

This paper considers binary and multilabel classification problems in a ...

How Can We Tame the Long-Tail of Chest X-ray Datasets?

Chest X-rays (CXRs) are a medical imaging modality that is used to infer...

Disentangling Sampling and Labeling Bias for Learning in Large-Output Spaces

Negative sampling schemes enable efficient training given a large number...

Review of Extreme Multilabel Classification

Extreme multilabel classification or XML, in short, has emerged as a new...

Simple and Robust Loss Design for Multi-Label Learning with Missing Labels

Multi-label learning in the presence of missing labels (MLML) is a chall...

A Flexible Class of Dependence-aware Multi-Label Loss Functions

Multi-label classification is the task of assigning a subset of labels t...

Please sign up or login with your details

Forgot password? Click here to reset