SGDLibrary: A MATLAB library for stochastic gradient descent algorithms

10/27/2017
by   Hiroyuki Kasai, et al.
0

We consider the problem of finding the minimizer of a function f: R^d →R of the form f(w) = 1/n∑_if_i(w). This problem has been studied intensively in recent years in machine learning research field. One typical but promising approach for large-scale data is stochastic optimization algorithm. SGDLibrary is a flexible, extensible and efficient pure-Matlab library of a collection of stochastic optimization algorithms. The purpose of the library is to provide researchers and implementers a comprehensive evaluation environment of those algorithms on various machine learning problems.

READ FULL TEXT

page 11

page 12

page 13

page 14

page 17

page 18

page 19

page 21

research
06/30/2019

A Note On The Popularity of Stochastic Optimization Algorithms in Different Fields: A Quantitative Analysis from 2007 to 2017

Stochastic optimization algorithms are often used to solve complex large...
research
05/05/2019

A Latent Variational Framework for Stochastic Optimization

This paper provides a unifying theoretical framework for stochastic opti...
research
04/04/2019

Adaptive Sequential Machine Learning

A framework previously introduced in [3] for solving a sequence of stoch...
research
10/29/2020

A stochastic optimization algorithm for analyzing planar central and balanced configurations in the n-body problem

A stochastic optimization algorithm for analyzing planar central and bal...
research
02/20/2019

Active Probabilistic Inference on Matrices for Pre-Conditioning in Stochastic Optimization

Pre-conditioning is a well-known concept that can significantly improve ...
research
03/02/2016

Without-Replacement Sampling for Stochastic Gradient Methods: Convergence Results and Application to Distributed Optimization

Stochastic gradient methods for machine learning and optimization proble...
research
02/06/2023

Target-based Surrogates for Stochastic Optimization

We consider minimizing functions for which it is expensive to compute th...

Please sign up or login with your details

Forgot password? Click here to reset