Ranking for Relevance and Display Preferences in Complex Presentation Layouts

by   Harrie Oosterhuis, et al.

Learning to Rank has traditionally considered settings where given the relevance information of objects, the desired order in which to rank the objects is clear. However, with today's large variety of users and layouts this is not always the case. In this paper, we consider so-called complex ranking settings where it is not clear what should be displayed, that is, what the relevant items are, and how they should be displayed, that is, where the most relevant items should be placed. These ranking settings are complex as they involve both traditional ranking and inferring the best display order. Existing learning to rank methods cannot handle such complex ranking settings as they assume that the display order is known beforehand. To address this gap we introduce a novel Deep Reinforcement Learning method that is capable of learning complex rankings, both the layout and the best ranking given the layout, from weak reward signals. Our proposed method does so by selecting documents and positions sequentially, hence it ranks both the documents and positions, which is why we call it the Double-Rank Model (DRM). Our experiments show that DRM outperforms all existing methods in complex ranking settings, thus it leads to substantial ranking improvements in cases where the display order is not known a priori.


Rank Aggregation Using Scoring Rules

To aggregate rankings into a social ranking, one can use scoring systems...

Learning-to-Rank with BERT in TF-Ranking

This paper describes a machine learning algorithm for document (re)ranki...

Generator and Critic: A Deep Reinforcement Learning Approach for Slate Re-ranking in E-commerce

The slate re-ranking problem considers the mutual influences between ite...

Unconfounded Propensity Estimation for Unbiased Ranking

The goal of unbiased learning to rank (ULTR) is to leverage implicit use...

Learning from User Interactions with Rankings: A Unification of the Field

Ranking systems form the basis for online search engines and recommendat...

Learning to Rank when Grades Matter

Graded labels are ubiquitous in real-world learning-to-rank applications...

New algorithms and goodness-of-fit diagnostics from remarkable properties of ranking models

The forward order assumption postulates that the ranking process of the ...

Please sign up or login with your details

Forgot password? Click here to reset