A neural document language modeling framework for spoken document retrieval

10/31/2019
by   Li-Phen Yen, et al.
0

Recent developments in deep learning have led to a significant innovation in various classic and practical subjects, including speech recognition, computer vision, question answering, information retrieval and so on. In the context of natural language processing (NLP), language representations have shown giant successes in many downstream tasks, so the school of studies have become a major stream of research recently. Because the immenseness of multimedia data along with speech have spread around the world in our daily life, spoken document retrieval (SDR) has become an important research subject in the past decades. Targeting on enhancing the SDR performance, the paper concentrates on proposing a neural retrieval framework, which assembles the merits of using language modeling (LM) mechanism in SDR and leveraging the abstractive information learned by the language representation models. Consequently, to our knowledge, this is a pioneer study on supervised training of a neural LM-based SDR framework, especially combined with the pretrained language representation methods.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/01/2023

How Generative Spoken Language Modeling Encodes Noisy Speech: Investigation from Phonetics to Syntactics

We examine the speech modeling potential of generative spoken language m...
research
04/19/2023

BRENT: Bidirectional Retrieval Enhanced Norwegian Transformer

Retrieval-based language models are increasingly employed in question-an...
research
11/22/2016

Learning to Distill: The Essence Vector Modeling Framework

In the context of natural language processing, representation learning h...
research
04/25/2023

Modeling Spoken Information Queries for Virtual Assistants: Open Problems, Challenges and Opportunities

Virtual assistants are becoming increasingly important speech-driven Inf...
research
11/03/2019

MRNN: A Multi-Resolution Neural Network with Duplex Attention for Document Retrieval in the Context of Question Answering

The primary goal of ad-hoc retrieval (document retrieval in the context ...
research
08/18/2023

Differentiable Retrieval Augmentation via Generative Language Modeling for E-commerce Query Intent Classification

Retrieval augmentation, which enhances downstream models by a knowledge ...
research
06/23/2023

Long-range Language Modeling with Self-retrieval

Retrieval-augmented language models (LMs) have received much attention r...

Please sign up or login with your details

Forgot password? Click here to reset