research
∙
10/13/2021
Towards Efficient NLP: A Standard Evaluation and A Strong Baseline
Supersized pre-trained language models have pushed the accuracy of vario...
share
research
∙
09/26/2021
Paradigm Shift in Natural Language Processing
In the era of deep learning, modeling for most NLP tasks has converged t...
research
∙
09/10/2021
Learning to Teach with Student Feedback
Knowledge distillation (KD) has gained much attention due to its effecti...
research
∙
05/28/2021
Accelerating BERT Inference for Sequence Labeling via Early-Exit
Both performance and efficiency are crucial factors for sequence labelin...
research
∙
05/28/2021
Early Exiting with Ensemble Internal Classifiers
As a simple technique to accelerate inference of large-scale pre-trained...
research
∙
04/11/2021
Does syntax matter? A strong baseline for Aspect-based Sentiment Analysis with RoBERTa
Aspect-based Sentiment Analysis (ABSA), aiming at predicting the polarit...
research
∙
10/01/2020
CoLAKE: Contextualized Language and Knowledge Embedding
With the emerging branch of incorporating factual knowledge into pre-tra...
research
∙
03/18/2020
Pre-trained Models for Natural Language Processing: A Survey
Recently, the emergence of pre-trained models (PTMs) has brought natural...
research
∙
11/12/2019