Few-shot Joint Multimodal Aspect-Sentiment Analysis Based on Generative Multimodal Prompt

by   Xiaocui Yang, et al.
Northeastern University
Nanjing University
Singapore University of Technology and Design

We have witnessed the rapid proliferation of multimodal data on numerous social media platforms. Conventional studies typically require massive labeled data to train models for Multimodal Aspect-Based Sentiment Analysis (MABSA). However, collecting and annotating fine-grained multimodal data for MABSA is tough. To alleviate the above issue, we perform three MABSA-related tasks with quite a small number of labeled multimodal samples. We first build diverse and comprehensive multimodal few-shot datasets according to the data distribution. To capture the specific prompt for each aspect term in a few-shot scenario, we propose a novel Generative Multimodal Prompt (GMP) model for MABSA, which includes the Multimodal Encoder module and the N-Stream Decoders module. We further introduce a subtask to predict the number of aspect terms in each instance to construct the multimodal prompt. Extensive experiments on two datasets demonstrate that our approach outperforms strong baselines on two MABSA-related tasks in the few-shot setting.


page 1

page 2

page 3

page 4


Few-shot Multimodal Sentiment Analysis based on Multimodal Probabilistic Fusion Prompts

Multimodal sentiment analysis is a trending topic with the explosion of ...

MACSA: A Multimodal Aspect-Category Sentiment Analysis Dataset with Multimodal Fine-grained Aligned Annotations

Multimodal fine-grained sentiment analysis has recently attracted increa...

Targeted Sentiment Analysis: A Data-Driven Categorization

Targeted sentiment analysis (TSA), also known as aspect based sentiment ...

PGCD: a position-guied contributive distribution unit for aspect based sentiment analysis

Aspect based sentiment analysis (ABSA), exploring sentim- ent polarity o...

Syntax-aware Hybrid prompt model for Few-shot multi-modal sentiment analysis

Multimodal Sentiment Analysis (MSA) has been a popular topic in natural ...

Multimodal Adversarially Learned Inference with Factorized Discriminators

Learning from multimodal data is an important research topic in machine ...

Adaptive Prompt Learning-based Few-Shot Sentiment Analysis

In the field of natural language processing, sentiment analysis via deep...

Please sign up or login with your details

Forgot password? Click here to reset