Gegelati: Lightweight Artificial Intelligence through Generic and Evolvable Tangled Program Graphs

12/15/2020
by   Karol Desnos, et al.
1

Tangled Program Graph (TPG) is a reinforcement learning technique based on genetic programming concepts. On state-of-the-art learning environments, TPGs have been shown to offer comparable competence with Deep Neural Networks (DNNs), for a fraction of their computational and storage cost. This lightness of TPGs, both for training and inference, makes them an interesting model to implement Artificial Intelligences (AIs) on embedded systems with limited computational and storage resources. In this paper, we introduce the Gegelati library for TPGs. Besides introducing the general concepts and features of the library, two main contributions are detailed in the paper: 1/ The parallelization of the deterministic training process of TPGs, for supporting heterogeneous Multiprocessor Systems-on-Chips (MPSoCs). 2/ The support for customizable instruction sets and data types within the genetically evolved programs of the TPG model. The scalability of the parallel training process is demonstrated through experiments on architectures ranging from a high-end 24-core processor to a low-power heterogeneous MPSoC. The impact of customizable instructions on the outcome of a training process is demonstrated on a state-of-the-art reinforcement learning environment. CCS Concepts: ∙ Computer systems organization → Embedded systems; ∙ Computing methodologies → Machine learning.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/20/2021

HeterPS: Distributed Deep Learning With Reinforcement Learning Based Scheduling in Heterogeneous Environments

Deep neural networks (DNNs) exploit many layers and a large number of pa...
research
11/07/2017

SparCE: Sparsity aware General Purpose Core Extensions to Accelerate Deep Neural Networks

Deep Neural Networks (DNNs) have emerged as the method of choice for sol...
research
09/02/2020

Dual Precision Deep Neural Network

On-line Precision scalability of the deep neural networks(DNNs) is a cri...
research
02/07/2022

Link Prediction of Artificial Intelligence Concepts using Low Computational Power

This paper presents an approach proposed for the Science4cast 2021 compe...
research
06/30/2020

Deep neural networks for the evaluation and design of photonic devices

The data sciences revolution is poised to transform the way photonic sys...
research
08/19/2020

Intelligent Replication Management for HDFS Using Reinforcement Learning

Storage systems for cloud computing merge a large number of commodity co...
research
07/17/2019

Photonic architecture for reinforcement learning

The last decade has seen an unprecedented growth in artificial intellige...

Please sign up or login with your details

Forgot password? Click here to reset