Improving Distantly Supervised Relation Extraction with Self-Ensemble Noise Filtering

by   Tapas Nayak, et al.

Distantly supervised models are very popular for relation extraction since we can obtain a large amount of training data using the distant supervision method without human annotation. In distant supervision, a sentence is considered as a source of a tuple if the sentence contains both entities of the tuple. However, this condition is too permissive and does not guarantee the presence of relevant relation-specific information in the sentence. As such, distantly supervised training data contains much noise which adversely affects the performance of the models. In this paper, we propose a self-ensemble filtering mechanism to filter out the noisy samples during the training process. We evaluate our proposed framework on the New York Times dataset which is obtained via distant supervision. Our experiments with multiple state-of-the-art neural relation extraction models show that our proposed filtering mechanism improves the robustness of the models and increases their F1 scores.


page 1

page 2

page 3

page 4


Improving Distantly Supervised Relation Extraction using Word and Entity Based Attention

Relation extraction is the problem of classifying the relationship betwe...

Learning with Noise: Enhance Distantly Supervised Relation Extraction with Dynamic Transition Matrix

Distant supervision significantly reduces human efforts in building trai...

Improving Distantly Supervised Relation Extraction by Natural Language Inference

To reduce human annotations for relation extraction (RE) tasks, distantl...

Dual Supervision Framework for Relation Extraction with Distant Supervision and Human Annotation

Relation extraction (RE) has been extensively studied due to its importa...

Distantly-Supervised Neural Relation Extraction with Side Information using BERT

Relation extraction (RE) consists in categorizing the relationship betwe...

Distantly Supervised Relation Extraction in Federated Settings

This paper investigates distantly supervised relation extraction in fede...

DIAG-NRE: A Deep Pattern Diagnosis Framework for Distant Supervision Neural Relation Extraction

Modern neural network models have achieved the state-of-the-art performa...

Please sign up or login with your details

Forgot password? Click here to reset