A Unified Framework for Multi-intent Spoken Language Understanding with prompting

by   Feifan Song, et al.

Multi-intent Spoken Language Understanding has great potential for widespread implementation. Jointly modeling Intent Detection and Slot Filling in it provides a channel to exploit the correlation between intents and slots. However, current approaches are apt to formulate these two sub-tasks differently, which leads to two issues: 1) It hinders models from effective extraction of shared features. 2) Pretty complicated structures are involved to enhance expression ability while causing damage to the interpretability of frameworks. In this work, we describe a Prompt-based Spoken Language Understanding (PromptSLU) framework, to intuitively unify two sub-tasks into the same form by offering a common pre-trained Seq2Seq model. In detail, ID and SF are completed by concisely filling the utterance into task-specific prompt templates as input, and sharing output formats of key-value pairs sequence. Furthermore, variable intents are predicted first, then naturally embedded into prompts to guide slot-value pairs inference from a semantic perspective. Finally, we are inspired by prevalent multi-task learning to introduce an auxiliary sub-task, which helps to learn relationships among provided labels. Experiment results show that our framework outperforms several state-of-the-art baselines on two public datasets.


page 1

page 2

page 3

page 4


SLIM: Explicit Slot-Intent Mapping with BERT for Joint Multi-Intent Detection and Slot Filling

Utterance-level intent detection and token-level slot filling are two ke...

Joint Online Spoken Language Understanding and Language Modeling with Recurrent Neural Networks

Speaker intent detection and semantic slot filling are two critical task...

OneNet: Joint Domain, Intent, Slot Prediction for Spoken Language Understanding

In practice, most spoken language understanding systems process user inp...

Enriched Pre-trained Transformers for Joint Slot Filling and Intent Detection

Detecting the user's intent and finding the corresponding slots among th...

CM-Net: A Novel Collaborative Memory Network for Spoken Language Understanding

Spoken Language Understanding (SLU) mainly involves two tasks, intent de...

PIN: A Novel Parallel Interactive Network for Spoken Language Understanding

Spoken Language Understanding (SLU) is an essential part of the spoken d...

Data balancing for boosting performance of low-frequency classes in Spoken Language Understanding

Despite the fact that data imbalance is becoming more and more common in...

Please sign up or login with your details

Forgot password? Click here to reset