Deep Reinforcement Learning-Based Product Recommender for Online Advertising

by   Milad Vaali Esfahaani, et al.

In online advertising, recommender systems try to propose items from a list of products to potential customers according to their interests. Such systems have been increasingly deployed in E-commerce due to the rapid growth of information technology and availability of large datasets. The ever-increasing progress in the field of artificial intelligence has provided powerful tools for dealing with such real-life problems. Deep reinforcement learning (RL) that deploys deep neural networks as universal function approximators can be viewed as a valid approach for design and implementation of recommender systems. This paper provides a comparative study between value-based and policy-based deep RL algorithms for designing recommender systems for online advertising. The RecoGym environment is adopted for training these RL-based recommender systems, where the long short term memory (LSTM) is deployed to build value and policy networks in these two approaches, respectively. LSTM is used to take account of the key role that order plays in the sequence of item observations by users. The designed recommender systems aim at maximising the click-through rate (CTR) for the recommended items. Finally, guidelines are provided for choosing proper RL algorithms for different scenarios that the recommender system is expected to handle.


page 1

page 2

page 3

page 4

page 5

page 6

page 7

page 8


A Survey on Reinforcement Learning for Recommender Systems

Recommender systems have been widely applied in different real-life scen...

Telepath: Understanding Users from a Human Vision Perspective in Large-Scale Recommender Systems

Designing an e-commerce recommender system that serves hundreds of milli...

Deep Reinforcement Learning for Dynamic Recommendation with Model-agnostic Counterfactual Policy Synthesis

Recent advances in recommender systems have proved the potential of Rein...

Optimized Recommender Systems with Deep Reinforcement Learning

Recommender Systems have been the cornerstone of online retailers. Tradi...

Order Matters at Fanatics Recommending Sequentially Ordered Products by LSTM Embedded with Word2Vec

A unique challenge for e-commerce recommendation is that customers are o...

Random Graphs for Performance Evaluation of Recommender Systems

The purpose of this article is to introduce a new analytical framework d...

Learning to Expand Audience via Meta Hybrid Experts and Critics for Recommendation and Advertising

In recommender systems and advertising platforms, marketers always want ...

Please sign up or login with your details

Forgot password? Click here to reset