Using Mise-En-Scène Visual Features based on MPEG-7 and Deep Learning for Movie Recommendation

by   Yashar Deldjoo, et al.

Item features play an important role in movie recommender systems, where recommendations can be generated by using explicit or implicit preferences of users on traditional features (attributes) such as tag, genre, and cast. Typically, movie features are human-generated, either editorially (e.g., genre and cast) or by leveraging the wisdom of the crowd (e.g., tag), and as such, they are prone to noise and are expensive to collect. Moreover, these features are often rare or absent for new items, making it difficult or even impossible to provide good quality recommendations. In this paper, we show that user's preferences on movies can be better described in terms of the mise-en-scène features, i.e., the visual aspects of a movie that characterize design, aesthetics and style (e.g., colors, textures). We use both MPEG-7 visual descriptors and Deep Learning hidden layers as example of mise-en-scène features that can visually describe movies. Interestingly, mise-en-scène features can be computed automatically from video files or even from trailers, offering more flexibility in handling new items, avoiding the need for costly and error-prone human-based tagging, and providing good scalability. We have conducted a set of experiments on a large catalogue of 4K movies. Results show that recommendations based on mise-en-scène features consistently provide the best performance with respect to richer sets of more traditional features, such as genre and tag.


Content-Based Personalized Recommender System Using Entity Embeddings

Recommender systems are a class of machine learning algorithms that prov...

Towards Evaluating User Profiling Methods Based on Explicit Ratings on Item Features

In order to improve the accuracy of recommendations, many recommender sy...

Beyond Labels: Leveraging Deep Learning and LLMs for Content Metadata

Content metadata plays a very important role in movie recommender system...

MTS Kion Implicit Contextualised Sequential Dataset for Movie Recommendation

We present a new movie and TV show recommendation dataset collected from...

Dynamic inference of user context through social tag embedding for music recommendation

Music listening preferences at a given time depend on a wide range of co...

Combining Aspects of Genetic Algorithms with Weighted Recommender Hybridization

Recommender systems are established means to inspire users to watch inte...

On Interpretation and Measurement of Soft Attributes for Recommendation

We address how to robustly interpret natural language refinements (or cr...

Please sign up or login with your details

Forgot password? Click here to reset