PR-Net: Preference Reasoning for Personalized Video Highlight Detection

by   Runnan Chen, et al.

Personalized video highlight detection aims to shorten a long video to interesting moments according to a user's preference, which has recently raised the community's attention. Current methods regard the user's history as holistic information to predict the user's preference but negating the inherent diversity of the user's interests, resulting in vague preference representation. In this paper, we propose a simple yet efficient preference reasoning framework (PR-Net) to explicitly take the diverse interests into account for frame-level highlight prediction. Specifically, distinct user-specific preferences for each input query frame are produced, presented as the similarity weighted sum of history highlights to the corresponding query frame. Next, distinct comprehensive preferences are formed by the user-specific preferences and a learnable generic preference for more overall highlight measurement. Lastly, the degree of highlight and non-highlight for each query frame is calculated as semantic similarity to its comprehensive and non-highlight preferences, respectively. Besides, to alleviate the ambiguity due to the incomplete annotation, a new bi-directional contrastive loss is proposed to ensure a compact and differentiable metric space. In this way, our method significantly outperforms state-of-the-art methods with a relative improvement of 12


page 1

page 5

page 6

page 7


Adaptive Video Highlight Detection by Learning from User History

Recently, there is an increasing interest in highlight detection researc...

Attentive Long Short-Term Preference Modeling for Personalized Product Search

E-commerce users may expect different products even for the same query, ...

PHD-GIFs: Personalized Highlight Detection for Automatic GIF Creation

Highlight detection models are typically trained to identify cues that m...

Where's YOUR focus: Personalized Attention

Human visual attention is subjective and biased according to the persona...

Image Conditioned Keyframe-Based Video Summarization Using Object Detection

Video summarization plays an important role in selecting keyframe for un...

Skyline Operators and Regret Minimization Techniques for Managing User Preferences in the Query Process

The problem of selecting the most representative tuples from a dataset h...

Edge Labelled Graphs and Property Graphs; a comparison from the user perspective

This study compares participant acceptance of the property graph and edg...

Please sign up or login with your details

Forgot password? Click here to reset