Compositional coding capsule network with k-means routing for text classification

10/22/2018
by   Hao Ren, et al.
0

Text classification is a challenging problem which aims to identify the category of text. Recently, Capsule Networks (CapsNets) are proposed for image classification, it has been shown that CapsNets have several advantages over Convolutional Neural Networks (CNNs), while, their validity in the domain of text has less been explored. An effective method named deep compositional code learning has been proposed lately. This method can save many parameters about word embeddings without any significant sacrifices in performance. In this paper, we introduce the Compositional Coding (CC) mechanism between capsules, and we propose a new routing algorithm, which is based on k-means clustering theory. Experiments conducted on eight challenging text classification datasets show the proposed method achieves similar accuracy compared to the state-of-the-art approach with significantly fewer parameters.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/12/2018

Text classification using capsules

This paper presents an empirical exploration of the use of capsule netwo...
research
03/29/2018

Investigating Capsule Networks with Dynamic Routing for Text Classification

In this study, we explore capsule networks with dynamic routing for text...
research
07/05/2017

A Deep Network with Visual Text Composition Behavior

While natural languages are compositional, how state-of-the-art neural m...
research
07/02/2020

A Novel BGCapsule Network for Text Classification

Several text classification tasks such as sentiment analysis, news categ...
research
07/23/2020

Sequential Routing Framework: Fully Capsule Network-based Speech Recognition

Capsule networks (CapsNets) have recently gotten attention as alternativ...
research
02/03/2015

Deep Boosting: Layered Feature Mining for General Image Classification

Constructing effective representations is a critical but challenging pro...
research
11/14/2020

Supervised Text Classification using Text Search

Supervised text classification is a classical and active area of ML rese...

Please sign up or login with your details

Forgot password? Click here to reset