Using Automated Algorithm Configuration for Parameter Control

02/23/2023
by   Deyao Chen, et al.
0

Dynamic Algorithm Configuration (DAC) tackles the question of how to automatically learn policies to control parameters of algorithms in a data-driven fashion. This question has received considerable attention from the evolutionary community in recent years. Having a good benchmark collection to gain structural understanding on the effectiveness and limitations of different solution methods for DAC is therefore strongly desirable. Following recent work on proposing DAC benchmarks with well-understood theoretical properties and ground truth information, in this work, we suggest as a new DAC benchmark the controlling of the key parameter λ in the (1+(λ,λ)) Genetic Algorithm for solving OneMax problems. We conduct a study on how to solve the DAC problem via the use of (static) automated algorithm configuration on the benchmark, and propose techniques to significantly improve the performance of the approach. Our approach is able to consistently outperform the default parameter control policy of the benchmark derived from previous theoretical work on sufficiently large problem sizes. We also present new findings on the landscape of the parameter-control search policies and propose methods to compute stronger baselines for the benchmark via numerical approximations of the true optimal policies.

READ FULL TEXT
research
02/07/2022

Theory-inspired Parameter Control Benchmarks for Dynamic Algorithm Configuration

It has long been observed that the performance of evolutionary algorithm...
research
05/27/2022

Automated Dynamic Algorithm Configuration

The performance of an algorithm often critically depends on its paramete...
research
09/14/2017

Warmstarting of Model-based Algorithm Configuration

The performance of many hard combinatorial problem solvers depends stron...
research
05/18/2021

DACBench: A Benchmark Library for Dynamic Algorithm Configuration

Dynamic Algorithm Configuration (DAC) aims to dynamically control a targ...
research
04/16/2018

Theory of Parameter Control for Discrete Black-Box Optimization: Provable Performance Gains Through Dynamic Parameter Choices

Parameter control aims at realizing performance gains through a dynamic ...
research
04/14/2021

Lazy Parameter Tuning and Control: Choosing All Parameters Randomly From a Power-Law Distribution

Most evolutionary algorithms have multiple parameters and their values d...
research
08/08/2019

How much data is sufficient to learn high-performing algorithms?

Algorithms for scientific analysis typically have tunable parameters tha...

Please sign up or login with your details

Forgot password? Click here to reset