Few-shot Relation Extraction via Bayesian Meta-learning on Relation Graphs

07/05/2020
by   Meng Qu, et al.
12

This paper studies few-shot relation extraction, which aims at predicting the relation for a pair of entities in a sentence by training with a few labeled examples in each relation. To more effectively generalize to new relations, in this paper we study the relationships between different relations and propose to leverage a global relation graph. We propose a novel Bayesian meta-learning approach to effectively learn the posterior distribution of the prototype vectors of relations, where the initial prior of the prototype vectors is parameterized with a graph neural network on the global relation graph. Moreover, to effectively optimize the posterior distribution of the prototype vectors, we propose to use the stochastic gradient Langevin dynamics, which is related to the MAML algorithm but is able to handle the uncertainty of the prototype vectors. The whole framework can be effectively and efficiently optimized in an end-to-end fashion. Experiments on two benchmark datasets prove the effectiveness of our proposed approach against competitive baselines in both the few-shot and zero-shot settings.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/15/2022

A Novel Few-Shot Relation Extraction Pipeline Based on Adaptive Prototype Fusion

Few-shot relation extraction (FSRE) aims at recognizing unseen relations...
research
03/23/2022

Pre-training to Match for Unified Low-shot Relation Extraction

Low-shot relation extraction (RE) aims to recognize novel relations with...
research
11/13/2020

Zero-shot Learning for Relation Extraction

Most existing supervised and few-shot learning relation extraction metho...
research
08/29/2019

Neural Snowball for Few-Shot Relation Learning

Knowledge graphs typically undergo open-ended growth of new relations. T...
research
09/12/2021

Exploring Task Difficulty for Few-Shot Relation Extraction

Few-shot relation extraction (FSRE) focuses on recognizing novel relatio...
research
10/24/2020

Effective Distant Supervision for Temporal Relation Extraction

A principal barrier to training temporal relation extraction models in n...
research
09/22/2021

Few-Shot Sound Source Distance Estimation Using Relation Networks

In this paper, we study the performance of few-shot learning, specifical...

Please sign up or login with your details

Forgot password? Click here to reset