Audio-to-Score Alignment Using Deep Automatic Music Transcription

07/27/2021
by   Federico Simonetta, et al.
0

Audio-to-score alignment (A2SA) is a multimodal task consisting in the alignment of audio signals to music scores. Recent literature confirms the benefits of Automatic Music Transcription (AMT) for A2SA at the frame-level. In this work, we aim to elaborate on the exploitation of AMT Deep Learning (DL) models for achieving alignment at the note-level. We propose a method which benefits from HMM-based score-to-score alignment and AMT, showing a remarkable advancement beyond the state-of-the-art. We design a systematic procedure to take advantage of large datasets which do not offer an aligned score. Finally, we perform a thorough comparison and extensive tests on multiple datasets.

READ FULL TEXT
research
11/13/2017

Audio-to-score alignment of piano music using RNN-based automatic music transcription

We propose a framework for audio-to-score alignment on piano performance...
research
02/22/2020

DECIBEL: Improving Audio Chord Estimation for Popular Music by Alignment and Integration of Crowd-Sourced Symbolic Representations

Automatic Chord Estimation (ACE) is a fundamental task in Music Informat...
research
02/18/2019

End-to-end Lyrics Alignment for Polyphonic Music Using an Audio-to-Character Recognition Model

Time-aligned lyrics can enrich the music listening experience by enablin...
research
06/03/2019

Evaluating Non-aligned Musical Score Transcriptions with MV2H

The original MV2H metric was designed to evaluate systems which transcri...
research
07/29/2020

Improved Handling of Repeats and Jumps in Audio-Sheet Image Synchronization

This paper studies the problem of automatically generating piano score f...
research
07/10/2023

HCLAS-X: Hierarchical and Cascaded Lyrics Alignment System Using Multimodal Cross-Correlation

In this work, we address the challenge of lyrics alignment, which involv...
research
05/29/2019

A new definition of the distortion matrix for an audio-to-score alignment system

In this paper we present a new definition of the distortion matrix for a...

Please sign up or login with your details

Forgot password? Click here to reset