On the inconsistency of separable losses for structured prediction

01/25/2023

∙

by   Caio Corro, et al.

∙

0

∙

share

In this paper, we prove that separable negative log-likelihood losses for structured prediction are not necessarily Bayes consistent, or, in other words, minimizing these losses may not result in a model that predicts the most probable structure in the data distribution for a given input. This fact opens the question of whether these losses are well-adapted for structured prediction and, if so, why.