research
∙
08/23/2023
Pre-gated MoE: An Algorithm-System Co-Design for Fast and Scalable Mixture-of-Expert Inference
Large language models (LLMs) based on transformers have made significant...
share
research
∙
05/31/2023
Adam Accumulation to Reduce Memory Footprints of both Activations and Gradients for Large-scale DNN Training
Running out of GPU memory has become a main bottleneck for large-scale D...
research
∙
05/31/2023
Accurate and Structured Pruning for Efficient Automatic Speech Recognition
Automatic Speech Recognition (ASR) has seen remarkable advancements with...
research
∙
05/21/2023
Integer or Floating Point? New Outlooks for Low-Bit Quantization on Large Language Models
Efficient deployment of large language models (LLMs) necessitates low-bi...
research
∙
12/29/2021
Dense-to-Sparse Gate for Mixture-of-Experts
Mixture-of-experts (MoE) is becoming popular due to its success in impro...
research
∙
11/01/2018