AI Chat AI Image Generator AI Video Text to Speech

Distributed Function Minimization in Apache Spark

09/17/2019

∙

by Andrea Schioppa, et al.

∙

∙

We report on an open-source implementation for distributed function minimization on top of Apache Spark by using gradient and quasi-Newton methods. We show-case it with an application to Optimal Transport and some scalability tests on classification and regression problems.

page 1

page 2

page 3

page 4

research

∙ 04/27/2023

Computing the L1 optimal transport density: a FEM approach

The L^1 optimal transport density μ^* is the unique L^∞ solution of the ...

0 Federico Piazzon, et al. ∙

research

∙ 08/30/2019

A Newton algorithm for semi-discrete optimal transport with storage fees and quantitative convergence of cells

In this paper we will continue analysis of the semi-discrete optimal tra...

0 Mohit Bansil, et al. ∙

research

∙ 10/18/2017

A Sinkhorn-Newton method for entropic optimal transport

We consider the entropic regularization of discretized optimal transport...

0 Christoph Brauer, et al. ∙

research

∙ 04/12/2021

Metasurfaces and Optimal transport

This paper provides a theoretical and numerical approach to show existen...

0 Cristian E. Gutiérrez, et al. ∙

research

∙ 08/07/2018

A distributed regression analysis application based on SAS software Part II: Cox proportional hazards regression

Previous work has demonstrated the feasibility and value of conducting d...

0 Yury Vilk, et al. ∙

research

∙ 09/18/2020

SISTA: learning optimal transport costs under sparsity constraints

In this paper, we describe a novel iterative procedure called SISTA to l...

0 Guillaume Carlier, et al. ∙

research

∙ 11/16/2012

Distance Majorization and Its Applications

The problem of minimizing a continuously differentiable convex function ...

0 Eric C. Chi, et al. ∙