Experimental Investigation and Evaluation of Model-based Hyperparameter Optimization

07/19/2021
by   Eva Bartz, et al.
0

Machine learning algorithms such as random forests or xgboost are gaining more importance and are increasingly incorporated into production processes in order to enable comprehensive digitization and, if possible, automation of processes. Hyperparameters of these algorithms used have to be set appropriately, which can be referred to as hyperparameter tuning or optimization. Based on the concept of tunability, this article presents an overview of theoretical and practical results for popular machine learning algorithms. This overview is accompanied by an experimental analysis of 30 hyperparameters from six relevant machine learning algorithms. In particular, it provides (i) a survey of important hyperparameters, (ii) two parameter tuning studies, and (iii) one extensive global parameter tuning study, as well as (iv) a new way, based on consensus ranking, to analyze results from multiple algorithms. The R package mlr is used as a uniform interface to the machine learning models. The R package SPOT is used to perform the actual tuning (optimization). All additional code is provided together with this paper.

READ FULL TEXT

page 27

page 33

research
07/15/2020

Importance of Tuning Hyperparameters of Machine Learning Algorithms

The performance of many machine learning algorithms depends on their hyp...
research
05/04/2020

Cost Effective Optimization for Cost-related Hyperparameters

The increasing demand for democratizing machine learning algorithms for ...
research
11/19/2020

On tuning deep learning models: a data mining perspective

Deep learning algorithms vary depending on the underlying connection mec...
research
07/23/2020

MLJ: A Julia package for composable Machine Learning

MLJ (Machine Learing in Julia) is an open source software package provid...
research
01/16/2022

Discrete Simulation Optimization for Tuning Machine Learning Method Hyperparameters

Machine learning methods are being increasingly used in most technical a...
research
01/27/2022

Consolidated learning – a domain-specific model-free optimization strategy with examples for XGBoost and MIMIC-IV

For many machine learning models, a choice of hyperparameters is a cruci...
research
01/13/2022

Hyperparameter Importance for Machine Learning Algorithms

Hyperparameter plays an essential role in the fitting of supervised mach...

Please sign up or login with your details

Forgot password? Click here to reset