Utterance Rewriting with Contrastive Learning in Multi-turn Dialogue

03/22/2022
by   Zhihao Wang, et al.
2

Context modeling plays a significant role in building multi-turn dialogue systems. In order to make full use of context information, systems can use Incomplete Utterance Rewriting(IUR) methods to simplify the multi-turn dialogue into single-turn by merging current utterance and context information into a self-contained utterance. However, previous approaches ignore the intent consistency between the original query and rewritten query. The detection of omitted or coreferred locations in the original query can be further improved. In this paper, we introduce contrastive learning and multi-task learning to jointly model the problem. Our method benefits from carefully designed self-supervised objectives, which act as auxiliary tasks to capture semantics at both sentence-level and token-level. The experiments show that our proposed model achieves state-of-the-art performance on several public datasets.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/09/2021

Conversational Query Rewriting with Self-supervised Learning

Context modeling plays a critical role in building multi-turn dialogue s...
research
05/23/2023

TaDSE: Template-aware Dialogue Sentence Embeddings

Learning high quality sentence embeddings from dialogues has drawn incre...
research
06/22/2022

Hierarchical Context Tagging for Utterance Rewriting

Utterance rewriting aims to recover coreferences and omitted information...
research
05/05/2023

Out-of-Domain Intent Detection Considering Multi-turn Dialogue Contexts

Out-of-Domain (OOD) intent detection is vital for practical dialogue sys...
research
07/08/2023

Incomplete Utterance Rewriting as Sequential Greedy Tagging

The task of incomplete utterance rewriting has recently gotten much atte...
research
10/27/2022

Conversation Disentanglement with Bi-Level Contrastive Learning

Conversation disentanglement aims to group utterances into detached sess...
research
08/02/2021

User-Initiated Repetition-Based Recovery in Multi-Utterance Dialogue Systems

Recognition errors are common in human communication. Similar errors oft...

Please sign up or login with your details

Forgot password? Click here to reset