Exploring In-Context Learning Capabilities of Foundation Models for Generating Knowledge Graphs from Text

by   Hanieh Khorashadizadeh, et al.

Knowledge graphs can represent information about the real-world using entities and their relations in a structured and semantically rich manner and they enable a variety of downstream applications such as question-answering, recommendation systems, semantic search, and advanced analytics. However, at the moment, building a knowledge graph involves a lot of manual effort and thus hinders their application in some situations and the automation of this process might benefit especially for small organizations. Automatically generating structured knowledge graphs from a large volume of natural language is still a challenging task and the research on sub-tasks such as named entity extraction, relation extraction, entity and relation linking, and knowledge graph construction aims to improve the state of the art of automatic construction and completion of knowledge graphs from text. The recent advancement of foundation models with billions of parameters trained in a self-supervised manner with large volumes of training data that can be adapted to a variety of downstream tasks has helped to demonstrate high performance on a large range of Natural Language Processing (NLP) tasks. In this context, one emerging paradigm is in-context learning where a language model is used as it is with a prompt that provides instructions and some examples to perform a task without changing the parameters of the model using traditional approaches such as fine-tuning. This way, no computing resources are needed for re-training/fine-tuning the models and the engineering effort is minimal. Thus, it would be beneficial to utilize such capabilities for generating knowledge graphs from text.


page 1

page 2

page 3

page 4


Comprehensive Event Representations using Event Knowledge Graphs and Natural Language Processing

Recent work has utilised knowledge-aware approaches to natural language ...

Language Models sounds the Death Knell of Knowledge Graphs

Healthcare domain generates a lot of unstructured and semi-structured te...

Enhancing Knowledge Graph Construction Using Large Language Models

The growing trend of Large Language Models (LLM) development has attract...

Common-Knowledge Concept Recognition for SEVA

We build a common-knowledge concept recognition system for a Systems Eng...

Knowledge Graph Completion Models are Few-shot Learners: An Empirical Study of Relation Labeling in E-commerce with LLMs

Knowledge Graphs (KGs) play a crucial role in enhancing e-commerce syste...

Can ChatGPT's Responses Boost Traditional Natural Language Processing?

The employment of foundation models is steadily expanding, especially wi...

Towards Combinational Relation Linking over Knowledge Graphs

Given a natural language phrase, relation linking aims to find a relatio...

Please sign up or login with your details

Forgot password? Click here to reset