research
∙
03/21/2023
Sparse Iso-FLOP Transformations for Maximizing Training Efficiency
Recent works have explored the use of weight sparsity to improve the tra...
share
research
∙
03/18/2023
SPDF: Sparse Pre-training and Dense Fine-tuning for Large Language Models
The pre-training and fine-tuning paradigm has contributed to a number of...
research
∙
06/11/2021
Instance-Level Task Parameters: A Robust Multi-task Weighting Framework
Recent works have shown that deep neural networks benefit from multi-tas...
research
∙
05/27/2021
Training With Data Dependent Dynamic Learning Rates
Recently many first and second order variants of SGD have been proposed ...
research
∙
02/18/2021
Dynamic curriculum learning via data parameters for noise robust keyword spotting
We propose dynamic curriculum learning via data parameters for noise rob...
research
∙
09/20/2020
Learning Soft Labels via Meta Learning
One-hot labels do not represent soft decision boundaries among concepts,...
research
∙
03/17/2018
Learning Unsupervised Visual Grounding Through Semantic Self-Supervision
Localizing natural language phrases in images is a challenging problem t...
research
∙
06/08/2016