Explainable Model-specific Algorithm Selection for Multi-Label Classification

11/21/2022
by   Ana Kostovska, et al.
0

Multi-label classification (MLC) is an ML task of predictive modeling in which a data instance can simultaneously belong to multiple classes. MLC is increasingly gaining interest in different application domains such as text mining, computer vision, and bioinformatics. Several MLC algorithms have been proposed in the literature, resulting in a meta-optimization problem that the user needs to address: which MLC approach to select for a given dataset? To address this algorithm selection problem, we investigate in this work the quality of an automated approach that uses characteristics of the datasets - so-called features - and a trained algorithm selector to choose which algorithm to apply for a given task. For our empirical evaluation, we use a portfolio of 38 datasets. We consider eight MLC algorithms, whose quality we evaluate using six different performance metrics. We show that our automated algorithm selector outperforms any of the single MLC algorithms, and this is for all evaluated performance measures. Our selection approach is explainable, a characteristic that we exploit to investigate which meta-features have the largest influence on the decisions made by the algorithm selector. Finally, we also quantify the importance of the most significant meta-features for various domains.

READ FULL TEXT

page 5

page 6

page 7

research
09/20/2023

Multi-Label Takagi-Sugeno-Kang Fuzzy System

Multi-label classification can effectively identify the relevant labels ...
research
11/17/2020

Towards Meta-Algorithm Selection

Instance-specific algorithm selection (AS) deals with the automatic sele...
research
06/28/2021

Explaining the Performance of Multi-label Classification Methods with Data Set Properties

Meta learning generalizes the empirical experience with different learni...
research
04/21/2021

Interpretation of multi-label classification models using shapley values

Multi-label classification is a type of classification task, it is used ...
research
10/26/2021

Meta-Learning for Multi-Label Few-Shot Classification

Even with the luxury of having abundant data, multi-label classification...
research
11/16/2020

Automatic selection of clustering algorithms using supervised graph embedding

The widespread adoption of machine learning (ML) techniques and the exte...
research
02/14/2021

Comprehensive Comparative Study of Multi-Label Classification Methods

Multi-label classification (MLC) has recently received increasing intere...

Please sign up or login with your details

Forgot password? Click here to reset