Resource-Aware Pareto-Optimal Automated Machine Learning Platform

10/30/2020
by   Yao Yang, et al.
0

In this study, we introduce a novel platform Resource-Aware AutoML (RA-AutoML) which enables flexible and generalized algorithms to build machine learning models subjected to multiple objectives, as well as resource and hard-ware constraints. RA-AutoML intelligently conducts Hyper-Parameter Search(HPS) as well as Neural Architecture Search (NAS) to build models optimizing predefined objectives. RA-AutoML is a versatile framework that allows user to prescribe many resource/hardware constraints along with objectives demanded by the problem at hand or business requirements. At its core, RA-AutoML relies on our in-house search-engine algorithm,MOBOGA, which combines a modified constraint-aware Bayesian Optimization and Genetic Algorithm to construct Pareto optimal candidates. Our experiments on CIFAR-10 dataset shows very good accuracy compared to results obtained by state-of-art neural network models, while subjected to resource constraints in the form of model size.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/12/2019

Grid Search, Random Search, Genetic Algorithm: A Big Comparison for NAS

In this paper, we compare the three most popular algorithms for hyperpar...
research
01/27/2023

BOMP-NAS: Bayesian Optimization Mixed Precision NAS

Bayesian Optimization Mixed-Precision Neural Architecture Search (BOMP-N...
research
05/12/2019

Budgeted Training: Rethinking Deep Neural Network Training Under Resource Constraints

In most practical settings and theoretical analysis, one assumes that a ...
research
05/01/2022

Budgeted Classification with Rejection: An Evolutionary Method with Multiple Objectives

Classification systems are often deployed in resource-constrained settin...
research
06/12/2018

Resource-Efficient Neural Architect

Neural Architecture Search (NAS) is a laborious process. Prior work on a...
research
02/16/2021

IronMan: GNN-assisted Design Space Exploration in High-Level Synthesis via Reinforcement Learning

Despite the great success of High-Level Synthesis (HLS) tools, we observ...
research
11/06/2018

On the Resource Consumption of M2M Random Access: Efficiency and Pareto Optimality

The advent of Machine-to-Machine communication has sparked a new wave of...

Please sign up or login with your details

Forgot password? Click here to reset