ASTRAL: Adversarial Trained LSTM-CNN for Named Entity Recognition

by   Jiuniu Wang, et al.

Named Entity Recognition (NER) is a challenging task that extracts named entities from unstructured text data, including news, articles, social comments, etc. The NER system has been studied for decades. Recently, the development of Deep Neural Networks and the progress of pre-trained word embedding have become a driving force for NER. Under such circumstances, how to make full use of the information extracted by word embedding requires more in-depth research. In this paper, we propose an Adversarial Trained LSTM-CNN (ASTRAL) system to improve the current NER method from both the model structure and the training process. In order to make use of the spatial information between adjacent words, Gated-CNN is introduced to fuse the information of adjacent words. Besides, a specific Adversarial training method is proposed to deal with the overfitting problem in NER. We add perturbation to variables in the network during the training process, making the variables more diverse, improving the generalization and robustness of the model. Our model is evaluated on three benchmarks, CoNLL-03, OntoNotes 5.0, and WNUT-17, achieving state-of-the-art results. Ablation study and case study also show that our system can converge faster and is less prone to overfitting.


Empirical Study of Named Entity Recognition Performance Using Distribution-aware Word Embedding

With the fast development of Deep Learning techniques, Named Entity Reco...

A Deep Learning approach for Hindi Named Entity Recognition

Named Entity Recognition is one of the most important text processing re...

CAN-NER: Convolutional Attention Network forChinese Named Entity Recognition

Named entity recognition (NER) in Chinese is essential but difficult bec...

Improving Vietnamese Named Entity Recognition from Speech Using Word Capitalization and Punctuation Recovery Models

Studies on the Named Entity Recognition (NER) task have shown outstandin...

Causal Interventions-based Few-Shot Named Entity Recognition

Few-shot named entity recognition (NER) systems aims at recognizing new ...

A reproducible experimental survey on biomedical sentence similarity: a string-based method sets the state of the art

This registered report introduces the largest, and for the first time, r...

Arabic Named Entity Recognition using Word Representations

Recent work has shown the effectiveness of the word representations feat...

Please sign up or login with your details

Forgot password? Click here to reset