DeepAI AI Chat
Log In Sign Up

Quantum Architecture Search via Continual Reinforcement Learning

by   Esther Ye, et al.
Boston University
Brookhaven National Laboratory

Quantum computing has promised significant improvement in solving difficult computational tasks over classical computers. Designing quantum circuits for practical use, however, is not a trivial objective and requires expert-level knowledge. To aid this endeavor, this paper proposes a machine learning-based method to construct quantum circuit architectures. Previous works have demonstrated that classical deep reinforcement learning (DRL) algorithms can successfully construct quantum circuit architectures without encoded physics knowledge. However, these DRL-based works are not generalizable to settings with changing device noises, thus requiring considerable amounts of training resources to keep the RL models up-to-date. With this in mind, we incorporated continual learning to enhance the performance of our algorithm. In this paper, we present the Probabilistic Policy Reuse with deep Q-learning (PPR-DQL) framework to tackle this circuit design challenge. By conducting numerical simulations over various noise patterns, we demonstrate that the RL agent with PPR was able to find the quantum gate sequence to generate the two-qubit Bell state faster than the agent that was trained from scratch. The proposed framework is general and can be applied to other quantum gate synthesis or control problems – including the automatic calibration of quantum devices.


Quantum Architecture Search via Deep Reinforcement Learning

Recent advances in quantum computing have drawn considerable attention t...

Decoding surface codes with deep reinforcement learning and probabilistic policy reuse

Quantum computing (QC) promises significant advantages on certain hard c...

Quantum Multi-Agent Reinforcement Learning via Variational Quantum Circuit Design

In recent years, quantum computing (QC) has been getting a lot of attent...

Quantum reinforcement learning in continuous action space

Quantum mechanics has the potential to speed up machine learning algorit...

Evolutionary Quantum Architecture Search for Parametrized Quantum Circuits

Recent advancements in quantum computing have shown promising computatio...

Asynchronous training of quantum reinforcement learning

The development of quantum machine learning (QML) has received a lot of ...

Optimizing Tensor Network Contraction Using Reinforcement Learning

Quantum Computing (QC) stands to revolutionize computing, but is current...