Trends in Neural Architecture Search: Towards the Acceleration of Search

08/19/2021
by   Youngkee Kim, et al.
0

In modern deep learning research, finding optimal (or near optimal) neural network models is one of major research directions and it is widely studied in many applications. In this paper, the main research trends of neural architecture search (NAS) are classified as neuro-evolutionary algorithms, reinforcement learning based algorithms, and one-shot architecture search approaches. Furthermore, each research trend is introduced and finally all the major three trends are compared. Lastly, the future research directions of NAS research trends are discussed.

READ FULL TEXT

page 1

page 3

research
09/05/2019

Best Practices for Scientific Research on Neural Architecture Search

We describe a set of best practices for the young field of neural archit...
research
10/13/2021

Improving the sample-efficiency of neural architecture search with reinforcement learning

Designing complex architectures has been an essential cogwheel in the re...
research
05/04/2019

A Survey on Neural Architecture Search

The growing interest in both the automation of machine learning and deep...
research
04/11/2023

Efficient Automation of Neural Network Design: A Survey on Differentiable Neural Architecture Search

In the past few years, Differentiable Neural Architecture Search (DNAS) ...
research
05/22/2020

An Introduction to Neural Architecture Search for Convolutional Networks

Neural Architecture Search (NAS) is a research field concerned with util...
research
02/19/2020

Neural Architecture Search For Fault Diagnosis

Data-driven methods have made great progress in fault diagnosis, especia...
research
06/11/2022

A Review on Plastic Artificial Neural Networks: Exploring the Intersection between Neural Architecture Search and Continual Learning

Despite the significant advances achieved in Artificial Neural Networks ...

Please sign up or login with your details

Forgot password? Click here to reset