Generative NeuroEvolution for Deep Learning

by   Phillip Verbancsics, et al.

An important goal for the machine learning (ML) community is to create approaches that can learn solutions with human-level capability. One domain where humans have held a significant advantage is visual processing. A significant approach to addressing this gap has been machine learning approaches that are inspired from the natural systems, such as artificial neural networks (ANNs), evolutionary computation (EC), and generative and developmental systems (GDS). Research into deep learning has demonstrated that such architectures can achieve performance competitive with humans on some visual tasks; however, these systems have been primarily trained through supervised and unsupervised learning algorithms. Alternatively, research is showing that evolution may have a significant role in the development of visual systems. Thus this paper investigates the role neuro-evolution (NE) can take in deep learning. In particular, the Hypercube-based NeuroEvolution of Augmenting Topologies is a NE approach that can effectively learn large neural structures by training an indirect encoding that compresses the ANN weight pattern as a function of geometry. The results show that HyperNEAT struggles with performing image classification by itself, but can be effective in training a feature extractor that other ML approaches can learn from. Thus NeuroEvolution combined with other ML methods provides an intriguing area of research that can replicate the processes in nature.


page 1

page 2

page 3

page 4


Redefining Wireless Communication for 6G: Signal Processing Meets Deep Learning

The year 2019 witnessed the rollout of 5G standard, which promises to of...

Robustness Evaluation of Deep Unsupervised Learning Algorithms for Intrusion Detection Systems

Recently, advances in deep learning have been observed in various fields...

Neurogenesis Deep Learning

Neural machine learning methods, such as deep neural networks (DNN), hav...

Hierarchical Deep Learning Architecture For 10K Objects Classification

Evolution of visual object recognition architectures based on Convolutio...

Deep Learning for Classification Tasks on Geospatial Vector Polygons

In this paper, we evaluate the accuracy of deep learning approaches on g...

An Implementation of Vector Quantization using the Genetic Algorithm Approach

The application of machine learning(ML) and genetic programming(GP) to t...

A Logic-Based Framework Leveraging Neural Networks for Studying the Evolution of Neurological Disorders

Deductive formalisms have been strongly developed in recent years; among...

Please sign up or login with your details

Forgot password? Click here to reset