Variational Quantum Soft Actor-Critic for Robotic Arm Control

12/20/2022
by   Alberto Acuto, et al.
0

Deep Reinforcement Learning is emerging as a promising approach for the continuous control task of robotic arm movement. However, the challenges of learning robust and versatile control capabilities are still far from being resolved for real-world applications, mainly because of two common issues of this learning paradigm: the exploration strategy and the slow learning speed, sometimes known as "the curse of dimensionality". This work aims at exploring and assessing the advantages of the application of Quantum Computing to one of the state-of-art Reinforcement Learning techniques for continuous control - namely Soft Actor-Critic. Specifically, the performance of a Variational Quantum Soft Actor-Critic on the movement of a virtual robotic arm has been investigated by means of digital simulations of quantum circuits. A quantum advantage over the classical algorithm has been found in terms of a significant decrease in the amount of required parameters for satisfactory model training, paving the way for further promising developments.

READ FULL TEXT

page 3

page 7

page 8

page 10

research
12/20/2021

Variational Quantum Soft Actor-Critic

Quantum computing has a superior advantage in tackling specific problems...
research
01/30/2023

PAC-Bayesian Soft Actor-Critic Learning

Actor-critic algorithms address the dual goals of reinforcement learning...
research
03/21/2023

SACPlanner: Real-World Collision Avoidance with a Soft Actor Critic Local Planner and Polar State Representations

We study the training performance of ROS local planners based on Reinfor...
research
08/25/2020

t-Soft Update of Target Network for Deep Reinforcement Learning

This paper proposes a new robust update rule of the target network for d...
research
01/12/2023

Asynchronous training of quantum reinforcement learning

The development of quantum machine learning (QML) has received a lot of ...
research
08/30/2021

Identifying optimal cycles in quantum thermal machines with reinforcement-learning

The optimal control of open quantum systems is a challenging task but ha...
research
09/07/2023

Hybrid of representation learning and reinforcement learning for dynamic and complex robotic motion planning

Motion planning is the soul of robot decision making. Classical planning...

Please sign up or login with your details

Forgot password? Click here to reset