research
∙
07/16/2023
Do Emergent Abilities Exist in Quantized Large Language Models: An Empirical Study
Despite the superior performance, Large Language Models (LLMs) require s...
share
research
∙
03/27/2023
Scaling Pre-trained Language Models to Deeper via Parameter-efficient Architecture
In this paper, we propose a highly parameter-efficient approach to scali...
research
∙
03/02/2022
Parameter-Efficient Mixture-of-Experts Architecture for Pre-trained Language Models
The state-of-the-art Mixture-of-Experts (short as MoE) architecture has ...
research
∙
06/04/2021
Enabling Lightweight Fine-tuning for Pre-trained Language Model Compression based on Matrix Product Operators
This paper presents a novel pre-trained language models (PLM) compressio...
research
∙
12/22/2020
Compressing LSTM Networks by Matrix Product Operators
Long Short-Term Memory (LSTM) models are the building blocks of many sta...
research
∙
10/10/2020
A Model Compression Method with Matrix Product Operators for Speech Enhancement
The deep neural network (DNN) based speech enhancement approaches have a...
research
∙
04/11/2019