Disfluency Detection using a Noisy Channel Model and a Deep Neural Language Model

08/28/2018
by   Paria Jamshid Lou, et al.
0

This paper presents a model for disfluency detection in spontaneous speech transcripts called LSTM Noisy Channel Model. The model uses a Noisy Channel Model (NCM) to generate n-best candidate disfluency analyses and a Long Short-Term Memory (LSTM) language model to score the underlying fluent sentences of each analysis. The LSTM language model scores, along with other features, are used in a MaxEnt reranker to identify the most plausible analysis. We show that using an LSTM language model in the reranking process of noisy channel disfluency model improves the state-of-the-art in disfluency detection.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/31/2016

LSTM based Conversation Models

In this paper, we present a conversational model that incorporates both ...
research
11/11/2015

Larger-Context Language Modelling

In this work, we propose a novel method to incorporate corpus-level disc...
research
12/11/2017

A Novel Way of Identifying Cyber Predators

Recurrent Neural Networks with Long Short-Term Memory cell (LSTM-RNN) ha...
research
04/28/2016

Word Ordering Without Syntax

Recent work on word ordering has argued that syntactic structure is impo...
research
07/31/2020

A Study on Effects of Implicit and Explicit Language Model Information for DBLSTM-CTC Based Handwriting Recognition

Deep Bidirectional Long Short-Term Memory (D-BLSTM) with a Connectionist...
research
11/06/2022

Noisy Channel for Automatic Text Simplification

In this paper we present a simple re-ranking method for Automatic Senten...
research
07/16/2017

Do Neural Nets Learn Statistical Laws behind Natural Language?

The performance of deep learning in natural language processing has been...

Please sign up or login with your details

Forgot password? Click here to reset