Linear Combination of Distance Measures for Surrogate Models in Genetic Programming

by   Martin Zaefferer, et al.
TH Köln

Surrogate models are a well established approach to reduce the number of expensive function evaluations in continuous optimization. In the context of genetic programming, surrogate modeling still poses a challenge, due to the complex genotype-phenotype relationships. We investigate how different genotypic and phenotypic distance measures can be used to learn Kriging models as surrogates. We compare the measures and suggest to use their linear combination in a kernel. We test the resulting model in an optimization framework, using symbolic regression problem instances as a benchmark. Our experiments show that the model provides valuable information. Firstly, the model enables an improved optimization performance compared to a model-free algorithm. Furthermore, the model provides information on the contribution of different distance measures. The data indicates that a phenotypic distance measure is important during the early stages of an optimization run when less data is available. In contrast, genotypic measures, such as the tree edit distance, contribute more during the later stages.


Improving NeuroEvolution Efficiency by Surrogate Model-based Optimization with Phenotypic Distance Kernels

In NeuroEvolution, the topologies of artificial neural networks are opti...

Distance-based Kernels for Surrogate Model-based Neuroevolution

The topology optimization of artificial neural networks can be particula...

Surrogate Models for Enhancing the Efficiency of Neuroevolution in Reinforcement Learning

In the last years, reinforcement learning received a lot of attention. O...

Online Diversity Control in Symbolic Regression via a Fast Hash-based Tree Similarity Measure

Diversity represents an important aspect of genetic programming, being d...

Relationship Detection Measures for Binary SoC Data

System-on-Chip (SoC) designs are used in every aspect of computing and t...

Please sign up or login with your details

Forgot password? Click here to reset