Joint Sentiment/Topic Modeling on Text Data Using Boosted Restricted Boltzmann Machine

by   Masoud Fatemi, et al.

Recently by the development of the Internet and the Web, different types of social media such as web blogs become an immense source of text data. Through the processing of these data, it is possible to discover practical information about different topics, individuals opinions and a thorough understanding of the society. Therefore, applying models which can automatically extract the subjective information from the documents would be efficient and helpful. Topic modeling methods, also sentiment analysis are the most raised topics in the natural language processing and text mining fields. In this paper a new structure for joint sentiment-topic modeling based on Restricted Boltzmann Machine (RBM) which is a type of neural networks is proposed. By modifying the structure of RBM as well as appending a layer which is analogous to sentiment of text data to it, we propose a generative structure for joint sentiment topic modeling based on neutral networks. The proposed method is supervised and trained by the Contrastive Divergence algorithm. The new attached layer in the proposed model is a layer with the multinomial probability distribution which can be used in text data sentiment classification or any other supervised application. The proposed model is compared with existing models in the experiments such as evaluating as a generative model, sentiment classification, information retrieval and the corresponding results demonstrate the efficiency of the method.


page 1

page 2

page 3

page 4


Twitter Sentiment Analysis System

Social media is increasingly used by humans to express their feelings an...

Conceptualization Topic Modeling

Recently, topic modeling has been widely used to discover the abstract t...

Types of Approaches, Applications and Challenges in the Development of Sentiment Analysis Systems

Today, the web has become a mandatory platform to express users' opinion...

An Embedding-based Joint Sentiment-Topic Model for Short Texts

Short text is a popular avenue of sharing feedback, opinions and reviews...

Tecnologica cosa: Modeling Storyteller Personalities in Boccaccio's Decameron

We explore Boccaccio's Decameron to see how digital humanities tools can...

Text Network Exploration via Heterogeneous Web of Topics

A text network refers to a data type that each vertex is associated with...

Neural Contrastive Clustering: Fully Unsupervised Bias Reduction for Sentiment Classification

Background: Neural networks produce biased classification results due to...

Please sign up or login with your details

Forgot password? Click here to reset