ContrastNER: Contrastive-based Prompt Tuning for Few-shot NER

05/29/2023
by   Amirhossein Layegh, et al.
18

Prompt-based language models have produced encouraging results in numerous applications, including Named Entity Recognition (NER) tasks. NER aims to identify entities in a sentence and provide their types. However, the strong performance of most available NER approaches is heavily dependent on the design of discrete prompts and a verbalizer to map the model-predicted outputs to entity categories, which are complicated undertakings. To address these challenges, we present ContrastNER, a prompt-based NER framework that employs both discrete and continuous tokens in prompts and uses a contrastive learning approach to learn the continuous prompts and forecast entity types. The experimental results demonstrate that ContrastNER obtains competitive performance to the state-of-the-art NER methods in high-resource settings and outperforms the state-of-the-art models in low-resource circumstances without requiring extensive manual prompt engineering and verbalizer design.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/27/2023

A Prototypical Semantic Decoupling Method via Joint Contrastive Learning for Few-Shot Name Entity Recognition

Few-shot named entity recognition (NER) aims at identifying named entiti...
research
04/11/2022

A Comparative Study of Pre-trained Encoders for Low-Resource Named Entity Recognition

Pre-trained language models (PLM) are effective components of few-shot n...
research
10/16/2021

Good Examples Make A Faster Learner: Simple Demonstration-based Learning for Low-resource NER

Recent advances in prompt-based learning have shown impressive results o...
research
06/05/2020

DeepVar: An End-to-End Deep Learning Approach for Genomic Variant Recognition in Biomedical Literature

We consider the problem of Named Entity Recognition (NER) on biomedical ...
research
05/26/2023

PromptNER: Prompt Locating and Typing for Named Entity Recognition

Prompt learning is a new paradigm for utilizing pre-trained language mod...
research
08/30/2022

Optimizing Bi-Encoder for Named Entity Recognition via Contrastive Learning

We present an efficient bi-encoder framework for named entity recognitio...
research
10/08/2022

Distilling Causal Effect from Miscellaneous Other-Class for Continual Named Entity Recognition

Continual Learning for Named Entity Recognition (CL-NER) aims to learn a...

Please sign up or login with your details

Forgot password? Click here to reset