One Deep Music Representation to Rule Them All? : A comparative analysis of different representation learning strategies

by   Jaehun Kim, et al.

Inspired by the success of deploying deep learning in the fields of Computer Vision and Natural Language Processing, this learning paradigm has also found its way into the field of Music Information Retrieval. In order to benefit from deep learning in an effective, but also efficient manner, deep transfer learning has become a common approach. In this approach, it is possible to reuse the output of a pre-trained neural network as the basis for a new, yet unseen learning task. The underlying hypothesis is that if the initial and new learning tasks show commonalities and are applied to the same type of data (e.g. music audio), the generated deep representation of the data is also informative for the new task. Since, however, most of the networks used to generate deep representations are trained using a single initial learning task, the validity of the above hypothesis is questionable for an arbitrary new learning task. In this paper we present the results of our investigation of what the best ways are to generate deep representations for the data and learning tasks in the music domain. We conducted this investigation via an extensive empirical study that involves multiple learning tasks, as well as multiple deep learning architectures with varying levels of information sharing between tasks, in order to learn music representations. We then validate these representations considering multiple unseen learning tasks for evaluation. The results of our experiments yield several insights on how to approach the design of methods for learning widely deployable deep data representations in the music domain.


DLR : Toward a deep learned rhythmic representation for music content analysis

In the use of deep neural networks, it is crucial to provide appropriate...

Learning music audio representations via weak language supervision

Audio representations for music information retrieval are typically lear...

Transfer learning for music classification and regression tasks

In this paper, we present a transfer learning approach for music classif...

A Tutorial on Deep Learning for Music Information Retrieval

Following their success in Computer Vision and other areas, deep learnin...

A General Framework for Learning Prosodic-Enhanced Representation of Rap Lyrics

Learning and analyzing rap lyrics is a significant basis for many web ap...

Learning useful representations for shifting tasks and distributions

Does the dominant approach to learn representations (as a side effect of...

Gradients as Features for Deep Representation Learning

We address the challenging problem of deep representation learning–the e...

Please sign up or login with your details

Forgot password? Click here to reset