Emergent communication enhances foraging behaviour in evolved swarms controlled by Spiking Neural Networks

12/16/2022
by   Cristian Jimenez-Romero, et al.
0

Social insects such as ants communicate via pheromones which allows them to coordinate their activity and solve complex tasks as a swarm, e.g. foraging for food. This behaviour was shaped through evolutionary processes. In computational models, self-coordination in swarms has been implemented using probabilistic or action rules to shape the decision of each agent and the collective behaviour. However, manual tuned decision rules may limit the behaviour of the swarm. In this work we investigate the emergence of self-coordination and communication in evolved swarms without defining any rule. We evolve a swarm of agents representing an ant colony. We use a genetic algorithm to optimize a spiking neural network (SNN) which serves as an artificial brain to control the behaviour of each agent. The goal of the colony is to find optimal ways to forage for food in the shortest amount of time. In the evolutionary phase, the ants are able to learn to collaborate by depositing pheromone near food piles and near the nest to guide its cohorts. The pheromone usage is not encoded into the network; instead, this behaviour is established through the optimization procedure. We observe that pheromone-based communication enables the ants to perform better in comparison to colonies where communication did not emerge. We assess the foraging performance by comparing the SNN based model to a rule based system. Our results show that the SNN based model can complete the foraging task more efficiently in a shorter time. Our approach illustrates that even in the absence of pre-defined rules, self coordination via pheromone emerges as a result of the network optimization. This work serves as a proof of concept for the possibility of creating complex applications utilizing SNNs as underlying architectures for multi-agent interactions where communication and self-coordination is desired.

READ FULL TEXT

page 4

page 5

page 9

page 10

page 11

research
02/21/2015

Reinforcement Learning in a Neurally Controlled Robot Using Dopamine Modulated STDP

Recent work has shown that dopamine-modulated STDP can solve many of the...
research
12/07/2020

A multi-agent evolutionary robotics framework to train spiking neural networks

A novel multi-agent evolutionary robotics (ER) based framework, inspired...
research
07/30/2015

A Model for Foraging Ants, Controlled by Spiking Neural Networks and Double Pheromones

A model of an Ant System where ants are controlled by a spiking neural c...
research
04/17/2023

Control and Coordination of a SWARM of Unmanned Surface Vehicles using Deep Reinforcement Learning in ROS

An unmanned surface vehicle (USV) can perform complex missions by contin...
research
04/25/2023

Adaptive Collective Responses to Local Stimuli in Anonymous Dynamic Networks

We develop a framework for self-induced phase changes in programmable ma...
research
01/25/2022

Hacking the Colony: On the Disruptive Effect of Misleading Pheromone and How to Defend Against It

Ants have evolved to seek and retrieve food by leaving trails of pheromo...
research
07/27/2017

Dynamic Switching Networks

The concept of emergence is a powerful concept to explain very complex b...

Please sign up or login with your details

Forgot password? Click here to reset