Self-Consistent Narrative Prompts on Abductive Natural Language Inference

09/15/2023
by   Chunkit Chan, et al.
0

Abduction has long been seen as crucial for narrative comprehension and reasoning about everyday situations. The abductive natural language inference (αNLI) task has been proposed, and this narrative text-based task aims to infer the most plausible hypothesis from the candidates given two observations. However, the inter-sentential coherence and the model consistency have not been well exploited in the previous works on this task. In this work, we propose a prompt tuning model α-PACE, which takes self-consistency and inter-sentential coherence into consideration. Besides, we propose a general self-consistent framework that considers various narrative sequences (e.g., linear narrative and reverse chronology) for guiding the pre-trained language model in understanding the narrative context of input. We conduct extensive experiments and thorough ablation studies to illustrate the necessity and effectiveness of α-PACE. The performance of our method shows significant improvement against extensive competitive baselines.

READ FULL TEXT

page 3

page 8

page 16

research
04/28/2020

Semantics-Aware Inferential Network for Natural Language Understanding

For natural language understanding tasks, either machine reading compreh...
research
10/20/2022

Large Language Models Can Self-Improve

Large Language Models (LLMs) have achieved excellent performances in var...
research
09/22/2022

Learning to Write with Coherence From Negative Examples

Coherence is one of the critical factors that determine the quality of w...
research
11/01/2018

A bird's-eye view on coherence, and a worm's-eye view on cohesion

Generating coherent and cohesive long-form texts is a challenging proble...
research
05/19/2023

Examining the Inter-Consistency of Large Language Models: An In-depth Analysis via Debate

Large Language Models (LLMs) have demonstrated human-like intelligence a...
research
12/01/2021

Interactive Model with Structural Loss for Language-based Abductive Reasoning

The abductive natural language inference task (αNLI) is proposed to infe...

Please sign up or login with your details

Forgot password? Click here to reset