Relation-Aware Network with Attention-Based Loss for Few-Shot Knowledge Graph Completion

by   Qiao Qiao, et al.
Iowa State University of Science and Technology

Few-shot knowledge graph completion (FKGC) task aims to predict unseen facts of a relation with few-shot reference entity pairs. Current approaches randomly select one negative sample for each reference entity pair to minimize a margin-based ranking loss, which easily leads to a zero-loss problem if the negative sample is far away from the positive sample and then out of the margin. Moreover, the entity should have a different representation under a different context. To tackle these issues, we propose a novel Relation-Aware Network with Attention-Based Loss (RANA) framework. Specifically, to better utilize the plentiful negative samples and alleviate the zero-loss issue, we strategically select relevant negative samples and design an attention-based loss function to further differentiate the importance of each negative sample. The intuition is that negative samples more similar to positive samples will contribute more to the model. Further, we design a dynamic relation-aware entity encoder for learning a context-dependent entity representation. Experiments demonstrate that RANA outperforms the state-of-the-art models on two benchmark datasets.


page 1

page 2

page 3

page 4


Few-Shot Knowledge Graph Completion

Knowledge graphs (KGs) serve as useful resources for various natural lan...

Adaptive Attentional Network for Few-Shot Knowledge Graph Completion

Few-shot Knowledge Graph (KG) completion is a focus of current research,...

Entity Aware Negative Sampling with Auxiliary Loss of False Negative Prediction for Knowledge Graph Embedding

Knowledge graph (KG) embedding is widely used in many downstream applica...

Learning Relation-Specific Representations for Few-shot Knowledge Graph Completion

Recent years have witnessed increasing interest in few-shot knowledge gr...

KBGAN: Adversarial Learning for Knowledge Graph Embeddings

We introduce an adversarial learning framework, which we named KBGAN, to...

On the Knowledge Graph Completion Using Translation Based Embedding: The Loss Is as Important as the Score

Knowledge graphs (KGs) represent world's facts in structured forms. KG c...

Exploring Entity Interactions for Few-Shot Relation Learning (Student Abstract)

Few-shot relation learning refers to infer facts for relations with a li...

Please sign up or login with your details

Forgot password? Click here to reset