Learning Attention-based Representations from Multiple Patterns for Relation Prediction in Knowledge Graphs

by   Vítor Lourenço, et al.

Knowledge bases, and their representations in the form of knowledge graphs (KGs), are naturally incomplete. Since scientific and industrial applications have extensively adopted them, there is a high demand for solutions that complete their information. Several recent works tackle this challenge by learning embeddings for entities and relations, then employing them to predict new relations among the entities. Despite their aggrandizement, most of those methods focus only on the local neighbors of a relation to learn the embeddings. As a result, they may fail to capture the KGs' context information by neglecting long-term dependencies and the propagation of entities' semantics. In this manuscript, we propose ÆMP (Attention-based Embeddings from Multiple Patterns), a novel model for learning contextualized representations by: (i) acquiring entities' context information through an attention-enhanced message-passing scheme, which captures the entities' local semantics while focusing on different aspects of their neighborhood; and (ii) capturing the semantic context, by leveraging the paths and their relationships between entities. Our empirical findings draw insights into how attention mechanisms can improve entities' context representation and how combining entities and semantic path contexts improves the general representation of entities and the relation predictions. Experimental results on several large and small knowledge graph benchmarks show that ÆMP either outperforms or competes with state-of-the-art relation prediction methods.


page 1

page 2

page 3

page 4


Learning Relation-Specific Representations for Few-shot Knowledge Graph Completion

Recent years have witnessed increasing interest in few-shot knowledge gr...

Learning Attention-based Embeddings for Relation Prediction in Knowledge Graphs

The recent proliferation of knowledge graphs (KGs) coupled with incomple...

A Topological View of Rule Learning in Knowledge Graphs

Inductive relation prediction is an important learning task for knowledg...

Explainable Representations for Relation Prediction in Knowledge Graphs

Knowledge graphs represent real-world entities and their relations in a ...

Type-Constrained Representation Learning in Knowledge Graphs

Large knowledge graphs increasingly add value to various applications th...

An attention-based Bi-GRU-CapsNet model for hypernymy detection between compound entities

Named entities which composed of multiple continuous words frequently oc...

Exploration and Discovery of the COVID-19 Literature through Semantic Visualization

We are developing semantic visualization techniques in order to enhance ...

Please sign up or login with your details

Forgot password? Click here to reset