research
∙
07/17/2023
BUS:Efficient and Effective Vision-language Pre-training with Bottom-Up Patch Summarization
Vision Transformer (ViT) based Vision-Language Pre-training (VLP) models...
share
research
∙
06/24/2023
DiffDTM: A conditional structure-free framework for bioactive molecules generation targeted for dual proteins
Advances in deep generative models shed light on de novo molecule genera...
research
∙
05/24/2023
Towards Adaptive Prefix Tuning for Parameter-Efficient Language Model Fine-tuning
Fine-tuning large pre-trained language models on various downstream task...
research
∙
04/17/2023
VECO 2.0: Cross-lingual Language Model Pre-training with Multi-granularity Contrastive Learning
Recent studies have demonstrated the potential of cross-lingual transfer...
research
∙
04/11/2023
RRHF: Rank Responses to Align Language Models with Human Feedback without tears
Reinforcement Learning from Human Feedback (RLHF) facilitates the alignm...
research
∙
03/18/2023
Revisiting Automatic Question Summarization Evaluation in the Biomedical Domain
Automatic evaluation metrics have been facilitating the rapid developmen...
research
∙
03/01/2023
RAMM: Retrieval-augmented Biomedical Visual Question Answering with Multi-modal Pre-training
Vision-and-language multi-modal pretraining and fine-tuning have shown g...
research
∙
02/02/2023
Molecular Geometry-aware Transformer for accurate 3D Atomic System modeling
Molecular dynamic simulations are important in computational physics, ch...
research
∙
02/01/2023
mPLUG-2: A Modularized Multi-modal Foundation Model Across Text, Image and Video
Recent years have witnessed a big convergence of language, vision, and m...
research
∙
01/05/2023
Adaptively Clustering Neighbor Elements for Image Captioning
We design a novel global-local Transformer named Ada-ClustFormer (ACF) t...
research
∙
01/05/2023
Learning Trajectory-Word Alignments for Video-Language Tasks
Aligning objects with words plays a critical role in Image-Language BERT...
research
∙
12/20/2022
SeqDiffuSeq: Text Diffusion with Encoder-Decoder Transformers
Diffusion model, a new generative modelling paradigm, has achieved great...
research
∙
12/17/2022
HyPe: Better Pre-trained Language Model Fine-tuning with Hidden Representation Perturbation
Language models with the Transformers structure have shown great perform...
research
∙
10/17/2022
SpanProto: A Two-stage Span-based Prototypical Network for Few-shot Named Entity Recognition
Few-shot Named Entity Recognition (NER) aims to identify named entities ...
research
∙
08/18/2022
Open Information Extraction from 2007 to 2022 – A Survey
Open information extraction is an important NLP task that targets extrac...
research
∙
05/24/2022
mPLUG: Effective and Efficient Vision-Language Learning by Cross-modal Skip-connections
Large-scale pretrained foundation models have been an emerging paradigm ...
research
∙
05/23/2022
Parameter-Efficient Sparsity for Large Language Models Fine-Tuning
With the dramatically increased number of parameters in language models,...
research
∙
05/11/2022
Towards Unified Prompt Tuning for Few-shot Text Classification
Prompt-based fine-tuning has boosted the performance of Pre-trained Lang...
research
∙
04/15/2022
Image Captioning In the Transformer Age
Image Captioning (IC) has achieved astonishing developments by incorpora...
research
∙
04/09/2022
Contrastive Demonstration Tuning for Pre-trained Language Models
Pretrained language models can be effectively stimulated by textual prom...
research
∙
04/06/2022
Probing Structured Pruning on Multilingual Pre-trained Models: Settings, Algorithms, and Efficiency
Structured pruning has been extensively studied on monolingual pre-train...
research
∙
04/01/2022
Making Pre-trained Language Models End-to-end Few-shot Learners with Contrastive Prompt Tuning
Pre-trained Language Models (PLMs) have achieved remarkable performance ...
research
∙
03/03/2022
Code Synonyms Do Matter: Multiple Synonyms Matching Network for Automatic ICD Coding
Automatic ICD coding is defined as assigning disease codes to electronic...
research
∙
12/14/2021
From Dense to Sparse: Contrastive Pruning for Better Pre-trained Language Model Compression
Pre-trained Language Models (PLMs) have achieved great success in variou...
research
∙
12/02/2021
LOGEN: Few-shot Logical Knowledge-Conditioned Text Generation with Self-training
Natural language generation from structured data mainly focuses on surfa...
research
∙
11/17/2021
Achieving Human Parity on Visual Question Answering
The Visual Question Answering (VQA) task utilizes both visual image and ...
research
∙
11/11/2021
A Chinese Multi-type Complex Questions Answering Dataset over Wikidata
Complex Knowledge Base Question Answering is a popular area of research ...
research
∙
10/14/2021
Fusing Heterogeneous Factors with Triaffine Mechanism for Nested Named Entity Recognition
Nested entities are observed in many domains due to their compositionali...
research
∙
09/13/2021
Raise a Child in Large Language Model: Towards Effective and Generalizable Fine-tuning
Recent pretrained language models extend from millions to billions of pa...
research
∙
06/03/2021
E2E-VLP: End-to-End Vision-Language Pre-training Enhanced by Visual Learning
Vision-language pre-training (VLP) on large-scale image-text pairs has a...
research
∙
05/24/2021
StructuralLM: Structural Pre-training for Form Understanding
Large pre-trained language models achieve state-of-the-art results when ...
research
∙
04/21/2021
Improving Biomedical Pretrained Language Models with Knowledge
Pretrained language models have shown success in many natural language p...
research
∙
04/15/2021
Automated Conformance Testing for JavaScript Engines via Deep Compiler Fuzzing
JavaScript (JS) is a popular, platform-independent programming language....
research
∙
04/15/2021
Lattice-BERT: Leveraging Multi-Granularity Representations in Chinese Pre-trained Language Models
Chinese pre-trained language models usually process text as a sequence o...
research
∙
04/09/2021
Noisy-Labeled NER with Confidence Estimation
Recent studies in deep learning have shown significant progress in named...
research
∙
03/14/2021
SemVLP: Vision-Language Pre-training by Aligning Semantics at Multiple Levels
Vision-language pre-training (VLP) on large-scale image-text pairs has r...
research
∙
02/10/2021
Biomedical Question Answering: A Comprehensive Review
Question Answering (QA) is a benchmark Natural Language Processing (NLP)...
research
∙
12/15/2020
Nested Named Entity Recognition with Partially-Observed TreeCRFs
Named entity recognition (NER) is a well-studied task in natural languag...
research
∙
10/30/2020
VECO: Variable Encoder-decoder Pre-training for Cross-lingual Understanding and Generation
Recent studies about learning multilingual representations have achieved...
research
∙
10/12/2020
Predicting Clinical Trial Results by Implicit Evidence Integration
Clinical trials provide essential guidance for practicing Evidence-Based...
research
∙
11/09/2018
Encoding Implicit Relation Requirements for Relation Extraction: A Joint Inference Approach
Relation extraction is the task of identifying predefined relationship b...
research
∙
05/15/2018
Marrying up Regular Expressions with Neural Networks: A Case Study for Spoken Language Understanding
The success of many natural language processing (NLP) tasks is bound by ...
research
∙
05/11/2017
Learning with Noise: Enhance Distantly Supervised Relation Extraction with Dynamic Transition Matrix
Distant supervision significantly reduces human efforts in building trai...
research
∙
03/03/2016
Question Answering on Freebase via Relation Extraction and Textual Evidence
Existing knowledge-based question answering systems often rely on small ...
research
∙
06/25/2015