Leveraging Semantic Representations Combined with Contextual Word Representations for Recognizing Textual Entailment in Vietnamese

01/01/2023
by   Quoc-Loc Duong, et al.
0

RTE is a significant problem and is a reasonably active research community. The proposed research works on the approach to this problem are pretty diverse with many different directions. For Vietnamese, the RTE problem is moderately new, but this problem plays a vital role in natural language understanding systems. Currently, methods to solve this problem based on contextual word representation learning models have given outstanding results. However, Vietnamese is a semantically rich language. Therefore, in this paper, we want to present an experiment combining semantic word representation through the SRL task with context representation of BERT relative models for the RTE problem. The experimental results give conclusions about the influence and role of semantic representation on Vietnamese in understanding natural language. The experimental results show that the semantic-aware contextual representation model has about 1 semantic representation. In addition, the effects on the data domain in Vietnamese are also higher than those in English. This result also shows the positive influence of SRL on RTE problem in Vietnamese.

READ FULL TEXT

page 1

page 5

research
09/05/2019

Semantics-aware BERT for Language Understanding

The latest work on language representations carefully integrates context...
research
02/26/2019

Polyglot Contextual Representations Improve Crosslingual Transfer

We introduce a method to produce multilingual contextual word representa...
research
01/22/2019

Enhancing Semantic Word Representations by Embedding Deeper Word Relationships

Word representations are created using analogy context-based statistics ...
research
04/13/2021

Semantic maps and metrics for science Semantic maps and metrics for science using deep transformer encoders

The growing deluge of scientific publications demands text analysis tool...
research
05/31/2019

Representing and Using Knowledge with the Contextual Evaluation Model

This paper introduces the Contextual Evaluation Model (CEM), a novel met...
research
03/22/2021

Extracting the Unknown from Long Math Problems

In problem solving, understanding the problem that one seeks to solve is...
research
04/21/2020

Experience Grounds Language

Successful linguistic communication relies on a shared experience of the...

Please sign up or login with your details

Forgot password? Click here to reset