research
∙
06/02/2023
MKOR: Momentum-Enabled Kronecker-Factor-Based Optimizer Using Rank-1 Updates
This work proposes a Momentum-Enabled Kronecker-Factor-Based Optimizer U...
share
research
∙
05/22/2023
A Framework for Fine-Grained Synchronization of Dependent GPU Kernels
Machine Learning (ML) models contain highly-parallel computations, such ...
research
∙
11/24/2021
Vectorizing Sparse Matrix Codes with Dependency Driven Trace Analysis
Sparse computations frequently appear in scientific simulations and the ...
research
∙
11/24/2021
Composing Loop-carried Dependence with Other Loops
Sparse fusion is a compile-time loop transformation and runtime scheduli...
research
∙
08/20/2021
L-DQN: An Asynchronous Limited-Memory Distributed Quasi-Newton Method
This work proposes a distributed algorithm for solving empirical risk mi...
research
∙
06/07/2021
TENGraD: Time-Efficient Natural Gradient Descent with Exact Fisher-Block Inversion
This work proposes a time-efficient Natural Gradient Descent method, cal...
research
∙
07/19/2019
ASYNC: Asynchronous Machine Learning on Distributed Systems
ASYNC is a framework that supports the implementation of asynchronous ma...
research
∙
12/18/2018
MatRox: A Model-Based Algorithm with an Efficient Storage Format for Parallel HSS-Structured Matrix Approximations
We present MatRox, a novel model-based algorithm and implementation of H...
research
∙
07/27/2018
Sparse Matrix Code Dependence Analysis Simplification at Compile Time
Analyzing array-based computations to determine data dependences is usef...
research
∙
10/24/2017
Avoiding Communication in Proximal Methods for Convex Optimization Problems
The fast iterative soft thresholding algorithm (FISTA) is used to solve ...
research
∙
05/28/2017
A Unified Optimization Approach for Sparse Tensor Operations on GPUs
Sparse tensors appear in many large-scale applications with multidimensi...
research
∙
05/18/2017