research
∙
09/16/2023
Accelerating In-Browser Deep Learning Inference on Diverse Edge Clients through Just-in-Time Kernel Optimizations
Web applications are increasingly becoming the primary platform for AI s...
share
research
∙
08/23/2023
Pre-gated MoE: An Algorithm-System Co-Design for Fast and Scalable Mixture-of-Expert Inference
Large language models (LLMs) based on transformers have made significant...
research
∙
06/26/2023
Constraint-aware and Ranking-distilled Token Pruning for Efficient Transformer Inference
Deploying pre-trained transformer models like BERT on downstream tasks i...
research
∙
05/31/2023
Adam Accumulation to Reduce Memory Footprints of both Activations and Gradients for Large-scale DNN Training
Running out of GPU memory has become a main bottleneck for large-scale D...
research
∙
05/31/2023
Accurate and Structured Pruning for Efficient Automatic Speech Recognition
Automatic Speech Recognition (ASR) has seen remarkable advancements with...
research
∙
05/21/2023
Integer or Floating Point? New Outlooks for Low-Bit Quantization on Large Language Models
Efficient deployment of large language models (LLMs) necessitates low-bi...
research
∙
03/17/2023
ElasticViT: Conflict-aware Supernet Training for Deploying Fast Vision Transformer on Diverse Mobile Devices
Neural Architecture Search (NAS) has shown promising performance in the ...
research
∙
03/15/2023
Gamify Stencil Dwarf on Cloud for Democratizing Scientific Computing
Stencil computation is one of the most important kernels in various scie...
research
∙
03/15/2023
SpaceEvo: Hardware-Friendly Search Space Design for Efficient INT8 Inference
The combination of Neural Architecture Search (NAS) and quantization has...
research
∙
02/07/2023
LUT-NN: Towards Unified Neural Network Inference by Table Lookup
DNN inference requires huge effort of system development and resource co...
research
∙
08/30/2022
SwiftPruner: Reinforced Evolutionary Pruning for Efficient Ad Relevance
Ad relevance modeling plays a critical role in online advertising system...
research
∙
06/29/2022
Turbo: Opportunistic Enhancement for Edge Video Analytics
Edge computing is being widely used for video analytics. To alleviate th...
research
∙
06/15/2022
Understanding and Optimizing Deep Learning Cold-Start Latency on Edge Devices
DNNs are ubiquitous on edge devices nowadays. With its increasing import...
research
∙
11/30/2021
In-Bed Human Pose Estimation from Unseen and Privacy-Preserving Image Domains
Medical applications have benefited from the rapid advancement in comput...
research
∙
10/15/2020