Joint Binary Neural Network for Multi-label Learning with Applications to Emotion Classification

by   Huihui He, et al.

Recently the deep learning techniques have achieved success in multi-label classification due to its automatic representation learning ability and the end-to-end learning framework. Existing deep neural networks in multi-label classification can be divided into two kinds: binary relevance neural network (BRNN) and threshold dependent neural network (TDNN). However, the former needs to train a set of isolate binary networks which ignore dependencies between labels and have heavy computational load, while the latter needs an additional threshold function mechanism to transform the multi-class probabilities to multi-label outputs. In this paper, we propose a joint binary neural network (JBNN), to address these shortcomings. In JBNN, the representation of the text is fed to a set of logistic functions instead of a softmax function, and the multiple binary classifications are carried out synchronously in one neural network framework. Moreover, the relations between labels are captured via training on a joint binary cross entropy (JBCE) loss. To better meet multi-label emotion classification, we further proposed to incorporate the prior label relations into the JBCE loss. The experimental results on the benchmark dataset show that our model performs significantly better than the state-of-the-art multi-label emotion classification methods, in both classification performance and computational efficiency.


page 1

page 2

page 3

page 4


LNEMLC: Label Network Embeddings for Multi-Label Classification

Multi-label classification aims to classify instances with discrete non-...

Seq2Emo for Multi-label Emotion Classification Based on Latent Variable Chains Transformation

Emotion detection in text is an important task in NLP and is essential i...

Deep multi-class learning from label proportions

We propose a learning algorithm capable of learning from label proportio...

CascadeML: An Automatic Neural Network Architecture Evolution and Training Algorithm for Multi-label Classification

Multi-label classification is an approach which allows a datapoint to be...

From Softmax to Sparsemax: A Sparse Model of Attention and Multi-Label Classification

We propose sparsemax, a new activation function similar to the tradition...

Deep Neural Networks for Czech Multi-label Document Classification

This paper is focused on automatic multi-label document classification o...

Interval Type-2 Fuzzy Neural Networks for Multi-Label Classification

Prediction of multi-dimensional labels plays an important role in machin...

Please sign up or login with your details

Forgot password? Click here to reset