research
∙
09/20/2023
Making Small Language Models Better Multi-task Learners with Mixture-of-Task-Adapters
Recently, Large Language Models (LLMs) have achieved amazing zero-shot l...
share
research
∙
09/11/2023
PAI-Diffusion: Constructing and Serving a Family of Open Chinese Diffusion Models for Text-to-image Synthesis on the Cloud
Text-to-image synthesis for the Chinese language poses unique challenges...
research
∙
08/29/2023
TransPrompt v2: A Transferable Prompting Framework for Cross-task Text Classification
Text classification is one of the most imperative tasks in natural langu...
research
∙
08/07/2023
DiffSynth: Latent In-Iteration Deflickering for Realistic Video Synthesis
In recent years, diffusion models have emerged as the most powerful appr...
research
∙
07/31/2023
On the Trustworthiness Landscape of State-of-the-art Generative Models: A Comprehensive Survey
Diffusion models and large language models have emerged as leading-edge ...
research
∙
07/16/2023
On the Robustness of Split Learning against Adversarial Attacks
Split learning enables collaborative deep learning model training while ...
research
∙
05/28/2023
ConaCLIP: Exploring Distillation of Fully-Connected Knowledge Interaction Graph for Lightweight Text-Image Retrieval
Large-scale pre-trained text-image models with dual-encoder architecture...
research
∙
05/24/2023
Towards Adaptive Prefix Tuning for Parameter-Efficient Language Model Fine-tuning
Fine-tuning large pre-trained language models on various downstream task...
research
∙
05/24/2023
Optimal Linear Subspace Search: Learning to Construct Fast and High-Quality Schedulers for Diffusion Models
In recent years, diffusion models have become the most popular and power...
research
∙
02/17/2023
Uncertainty-aware Self-training for Low-resource Neural Sequence Labeling
Neural sequence labeling (NSL) aims at assigning labels for input langua...
research
∙
12/05/2022
Refiner: Data Refining against Gradient Leakage Attacks in Federated Learning
Federated Learning (FL) is pervasive in privacy-focused IoT environments...
research
∙
10/31/2022
TW-BAG: Tensor-wise Brain-aware Gate Network for Inpainting Disrupted Diffusion Tensor Imaging
Diffusion Weighted Imaging (DWI) is an advanced imaging technique common...
research
∙
10/17/2022
SpanProto: A Two-stage Span-based Prototypical Network for Few-shot Named Entity Recognition
Few-shot Named Entity Recognition (NER) aims to identify named entities ...
research
∙
10/11/2022
Revisiting and Advancing Chinese Natural Language Understanding with Accelerated Heterogeneous Knowledge Pre-training
Recently, knowledge-enhanced pre-trained language models (KEPLMs) improv...
research
∙
05/27/2022
Understanding Long Programming Languages with Structure-Aware Sparse Attention
Programming-based Pre-trained Language Models (PPLMs) such as CodeBERT h...
research
∙
05/11/2022
Towards Unified Prompt Tuning for Few-shot Text Classification
Prompt-based fine-tuning has boosted the performance of Pre-trained Lang...
research
∙
05/06/2022
KECP: Knowledge Enhanced Contrastive Prompting for Few-shot Extractive Question Answering
Extractive Question Answering (EQA) is one of the most important tasks i...
research
∙
04/30/2022
EasyNLP: A Comprehensive and Easy-to-use Toolkit for Natural Language Processing
The success of Pre-Trained Models (PTMs) has reshaped the development of...
research
∙
04/01/2022
Making Pre-trained Language Models End-to-end Few-shot Learners with Contrastive Prompt Tuning
Pre-trained Language Models (PLMs) have achieved remarkable performance ...
research
∙
02/27/2022
HiCLRE: A Hierarchical Contrastive Learning Framework for Distantly Supervised Relation Extraction
Distant supervision assumes that any sentence containing the same entity...
research
∙
12/14/2021
From Dense to Sparse: Contrastive Pruning for Better Pre-trained Language Model Compression
Pre-trained Language Models (PLMs) have achieved great success in variou...
research
∙
12/02/2021
DKPLM: Decomposable Knowledge-enhanced Pre-trained Language Model for Natural Language Understanding
Knowledge-Enhanced Pre-trained Language Models (KEPLMs) are pre-trained ...
research
∙
08/20/2021
SMedBERT: A Knowledge-Enhanced Pre-trained Language Model with Structured Semantics for Medical Text Mining
Recently, the performance of Pre-trained Language Models (PLMs) has been...
research
∙
12/02/2020
Meta-KD: A Meta Knowledge Distillation Framework for Language Model Compression across Domains
Pre-trained language models have been applied to various NLP tasks with ...
research
∙
11/18/2020
EasyTransfer – A Simple and Scalable Deep Transfer Learning Platform for NLP Applications
The literature has witnessed the success of applying deep Transfer Learn...
research
∙
10/28/2020
INT8 Winograd Acceleration for Conv1D Equipped ASR Models Deployed on Mobile Devices
The intensive computation of Automatic Speech Recognition (ASR) models o...
research
∙
09/14/2020
EasyASR: A Distributed Machine Learning Platform for End-to-end Automatic Speech Recognition
We present EasyASR, a distributed machine learning platform for training...
research
∙
08/24/2020
Knowledge-Empowered Representation Learning for Chinese Medical Reading Comprehension: Task, Model and Resources
Machine Reading Comprehension (MRC) aims to extract answers to questions...
research
∙
08/04/2020
Weakly Supervised Construction of ASR Systems with Massive Video Data
Building Automatic Speech Recognition (ASR) systems from scratch is sign...
research
∙
03/29/2020
Meta Fine-Tuning Neural Language Models for Multi-Domain Text Mining
Pre-trained neural language models bring significant improvement for var...
research
∙
02/25/2020
KEML: A Knowledge-Enriched Meta-Learning Framework for Lexical Relation Classification
Lexical relations describe how concepts are semantically related, in the...
research
∙
03/11/2019