SANCL: Multimodal Review Helpfulness Prediction with Selective Attention and Natural Contrastive Learning

by   Wei Han, et al.

With the boom of e-commerce, Multimodal Review Helpfulness Prediction (MRHP), which aims to sort product reviews according to the predicted helpfulness scores has become a research hotspot. Previous work on this task focuses on attention-based modality fusion, information integration, and relation modeling, which primarily exposes the following drawbacks: 1) the model may fail to capture the really essential information due to its indiscriminate attention formulation; 2) lack appropriate modeling methods that take full advantage of correlation among provided data. In this paper, we propose SANCL: Selective Attention and Natural Contrastive Learning for MRHP. SANCL adopts a probe-based strategy to enforce high attention weights on the regions of greater significance. It also constructs a contrastive learning framework based on natural matching properties in the dataset. Experimental results on two benchmark datasets with three categories show that SANCL achieves state-of-the-art baseline performance with lower memory consumption.


Adaptive Contrastive Learning on Multimodal Transformer for Review Helpfulness Predictions

Modern Review Helpfulness Prediction systems are dependent upon multiple...

Gradient-Boosted Decision Tree for Listwise Context Model in Multimodal Review Helpfulness Prediction

Multimodal Review Helpfulness Prediction (MRHP) aims to rank product rev...

Unified Contrastive Fusion Transformer for Multimodal Human Action Recognition

Various types of sensors have been considered to develop human action re...

Multimodal Contrastive Learning and Tabular Attention for Automated Alzheimer's Disease Prediction

Alongside neuroimaging such as MRI scans and PET, Alzheimer's disease (A...

Attention-based Fusion for Outfit Recommendation

This paper describes an attention-based fusion method for outfit recomme...

Multimodal SuperCon: Classifier for Drivers of Deforestation in Indonesia

Deforestation is one of the contributing factors to climate change. Clim...

Multimodal and Contrastive Learning for Click Fraud Detection

Advertising click fraud detection plays one of the vital roles in curren...

Please sign up or login with your details

Forgot password? Click here to reset