Combining Reinforcement Learning and Optimal Transport for the Traveling Salesman Problem

03/02/2022
by   Yong Liang Goh, et al.
4

The traveling salesman problem is a fundamental combinatorial optimization problem with strong exact algorithms. However, as problems scale up, these exact algorithms fail to provide a solution in a reasonable time. To resolve this, current works look at utilizing deep learning to construct reasonable solutions. Such efforts have been very successful, but tend to be slow and compute intensive. This paper exemplifies the integration of entropic regularized optimal transport techniques as a layer in a deep reinforcement learning network. We show that we can construct a model capable of learning without supervision and inferences significantly faster than current autoregressive approaches. We also empirically evaluate the benefits of including optimal transport algorithms within deep learning models to enforce assignment constraints during end-to-end training.

READ FULL TEXT
research
06/28/2023

Recent Advances in Optimal Transport for Machine Learning

Recently, Optimal Transport has been proposed as a probabilistic framewo...
research
01/31/2023

Optimal Transport Perturbations for Safe Reinforcement Learning with Robustness Guarantees

Robustness and safety are critical for the trustworthy deployment of dee...
research
09/07/2023

Optimal Transport with Tempered Exponential Measures

In the field of optimal transport, two prominent subfields face each oth...
research
11/02/2022

Entropic Neural Optimal Transport via Diffusion Processes

We propose a novel neural algorithm for the fundamental problem of compu...
research
03/07/2022

A Push-Relabel Based Additive Approximation for Optimal Transport

Optimal Transport is a popular distance metric for measuring similarity ...
research
02/15/2021

Distributionally-Constrained Policy Optimization via Unbalanced Optimal Transport

We consider constrained policy optimization in Reinforcement Learning, w...
research
09/22/2019

Volume Preserving Image Segmentation with Entropic Regularization Optimal Transport and Its Applications in Deep Learning

Image segmentation with a volume constraint is an important prior for ma...

Please sign up or login with your details

Forgot password? Click here to reset