Noise-Robust End-to-End Quantum Control using Deep Autoregressive Policy Networks

by   Jiahao Yao, et al.

Variational quantum eigensolvers have recently received increased attention, as they enable the use of quantum computing devices to find solutions to complex problems, such as the ground energy and ground state of strongly-correlated quantum many-body systems. In many applications, it is the optimization of both continuous and discrete parameters that poses a formidable challenge. Using reinforcement learning (RL), we present a hybrid policy gradient algorithm capable of simultaneously optimizing continuous and discrete degrees of freedom in an uncertainty-resilient way. The hybrid policy is modeled by a deep autoregressive neural network to capture causality. We employ the algorithm to prepare the ground state of the nonintegrable quantum Ising model in a unitary process, parametrized by a generalized quantum approximate optimization ansatz: the RL agent solves the discrete combinatorial problem of constructing the optimal sequences of unitaries out of a predefined set and, at the same time, it optimizes the continuous durations for which these unitaries are applied. We demonstrate the noise-robust features of the agent by considering three sources of uncertainty: classical and quantum measurement noise, and errors in the control unitary durations. Our work exhibits the beneficial synergy between reinforcement learning and quantum control.


page 11

page 16

page 18

page 19

page 21

page 22

page 23

page 28


Reinforcement Learning for Many-Body Ground State Preparation based on Counter-Diabatic Driving

The Quantum Approximate Optimization Ansatz (QAOA) is a prominent exampl...

Policy Gradient based Quantum Approximate Optimization Algorithm

The quantum approximate optimization algorithm (QAOA), as a hybrid quant...

Quantum Observables for continuous control of the Quantum Approximate Optimization Algorithm via Reinforcement Learning

We present a classical control mechanism for Quantum devices using Reinf...

Control of Continuous Quantum Systems with Many Degrees of Freedom based on Convergent Reinforcement Learning

With the development of experimental quantum technology, quantum control...

Quantum reinforcement learning in continuous action space

Quantum mechanics has the potential to speed up machine learning algorit...

Monte Carlo Tree Search based Hybrid Optimization of Variational Quantum Circuits

Variational quantum algorithms stand at the forefront of simulations on ...

DISK: Learning local features with policy gradient

Local feature frameworks are difficult to learn in an end-to-end fashion...

Please sign up or login with your details

Forgot password? Click here to reset