Towards Autoencoding Variational Inference for Aspect-based Opinion Summary

by   Tai Hoang, et al.

Aspect-based Opinion Summary (AOS), consisting of aspect discovery and sentiment classification steps, has recently been emerging as one of the most crucial data mining tasks in e-commerce systems. Along this direction, the LDA-based model is considered as a notably suitable approach, since this model offers both topic modeling and sentiment classification. However, unlike traditional topic modeling, in the context of aspect discovery it is often required some initial seed words, whose prior knowledge is not easy to be incorporated into LDA models. Moreover, LDA approaches rely on sampling methods, which need to load the whole corpus into memory, making them hardly scalable. In this research, we study an alternative approach for AOS problem, based on Autoencoding Variational Inference (AVI). Firstly, we introduce the Autoencoding Variational Inference for Aspect Discovery (AVIAD) model, which extends the previous work of Autoencoding Variational Inference for Topic Models (AVITM) to embed prior knowledge of seed words. This work includes enhancement of the previous AVI architecture and also modification of the loss function. Ultimately, we present the Autoencoding Variational Inference for Joint Sentiment/Topic (AVIJST) model. In this model, we substantially extend the AVI model to support the JST model, which performs topic modeling for corresponding sentiment. The experimental results show that our proposed models enjoy higher topic coherent, faster convergence time and better accuracy on sentiment classification, as compared to their LDA-based counterparts.


Using Variational Inference and MapReduce to Scale Topic Modeling

Latent Dirichlet Allocation (LDA) is a popular topic modeling technique ...

Autoencoding Variational Inference For Topic Models

Topic models are one of the most popular methods for learning representa...

Large-Scale Joint Topic, Sentiment & User Preference Analysis for Online Reviews

This paper presents a non-trivial reconstruction of a previous joint top...

On some provably correct cases of variational inference for topic models

Variational inference is a very efficient and popular heuristic used in ...

TDAM: a Topic-Dependent Attention Model for Sentiment Analysis

We propose a topic-dependent attention model for sentiment classificatio...

Expectation-Propogation for the Generative Aspect Model

The generative aspect model is an extension of the multinomial model for...

Scalable Modeling of Conversational-role based Self-presentation Characteristics in Large Online Forums

Online discussion forums are complex webs of overlapping subcommunities ...

Please sign up or login with your details

Forgot password? Click here to reset