Explainable Landscape Analysis in Automated Algorithm Performance Prediction

03/22/2022
by   Risto Trajanov, et al.
0

Predicting the performance of an optimization algorithm on a new problem instance is crucial in order to select the most appropriate algorithm for solving that problem instance. For this purpose, recent studies learn a supervised machine learning (ML) model using a set of problem landscape features linked to the performance achieved by the optimization algorithm. However, these models are black-box with the only goal of achieving good predictive performance, without providing explanations which landscape features contribute the most to the prediction of the performance achieved by the optimization algorithm. In this study, we investigate the expressiveness of problem landscape features utilized by different supervised ML models in automated algorithm performance prediction. The experimental results point out that the selection of the supervised ML method is crucial, since different supervised ML regression models utilize the problem landscape features differently and there is no common pattern with regard to which landscape features are the most informative.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/22/2021

Explainable Landscape-Aware Optimization Performance Prediction

Efficient solving of an unseen optimization problem is related to approp...
research
06/01/2023

Algorithm Instance Footprint: Separating Easily Solvable and Challenging Problem Instances

In black-box optimization, it is essential to understand why an algorith...
research
02/01/2021

Towards Explainable Exploratory Landscape Analysis: Extreme Feature Selection for Classifying BBOB Functions

Facilitated by the recent advances of Machine Learning (ML), the automat...
research
04/22/2021

Personalizing Performance Regression Models to Black-Box Optimization Problems

Accurately predicting the performance of different optimization algorith...
research
04/15/2022

The Importance of Landscape Features for Performance Prediction of Modular CMA-ES Variants

Selecting the most suitable algorithm and determining its hyperparameter...
research
06/30/2023

Comparing Algorithm Selection Approaches on Black-Box Optimization Problems

Performance complementarity of solvers available to tackle black-box opt...
research
09/30/2020

Linear Matrix Factorization Embeddings for Single-objective Optimization Landscapes

Automated per-instance algorithm selection and configuration have shown ...

Please sign up or login with your details

Forgot password? Click here to reset