research
∙
09/19/2023
FoleyGen: Visually-Guided Audio Generation
Recent advancements in audio generation have been spurred by the evoluti...
share
research
∙
09/15/2023
Stack-and-Delay: a new codebook pattern for music generation
In language modeling based music generation, a generated waveform is rep...
research
∙
08/25/2023
DISGO: Automatic End-to-End Evaluation for Scene Text OCR
This paper discusses the challenges of optical character recognition (OC...
research
∙
07/01/2023
Revisiting Sample Size Determination in Natural Language Understanding
Knowing exactly how many data points need to be labeled to achieve a cer...
research
∙
06/02/2023
Binary and Ternary Natural Language Generation
Ternary and binary neural networks enable multiplication-free computatio...
research
∙
05/29/2023
LLM-QAT: Data-Free Quantization Aware Training for Large Language Models
Several post-training quantization methods have been applied to large la...
research
∙
05/21/2023
Multi-Head State Space Model for Speech Recognition
State space models (SSMs) have recently shown promising results on small...
research
∙
11/09/2022
LiCo-Net: Linearized Convolution Network for Hardware-efficient Keyword Spotting
This paper proposes a hardware-efficient architecture, Linearized Convol...
research
∙
11/04/2022
Biased Self-supervised learning for ASR
Self-supervised learning via masked prediction pre-training (MPPT) has s...
research
∙
07/25/2022
Learning a Dual-Mode Speech Recognition Model via Self-Pruning
There is growing interest in unifying the streaming and full-context aut...
research
∙
03/29/2022
Streaming parallel transducer beam search with fast-slow cascaded encoders
Streaming ASR with strict latency constraints is required in many speech...
research
∙
10/28/2021
TorchAudio: Building Blocks for Audio and Speech Processing
This document describes version 0.10 of torchaudio: building blocks for ...
research
∙
10/07/2021
Streaming Transformer Transducer Based Speech Recognition Using Non-Causal Convolution
This paper improves the streaming transformer transducer for speech reco...
research
∙
10/07/2021
Transferring Voice Knowledge for Acoustic Event Detection: An Empirical Study
Detection of common events and scenes from audio is useful for extractin...
research
∙
07/09/2021
On lattice-free boosted MMI training of HMM and CTC-based full-context ASR models
Hybrid automatic speech recognition (ASR) models are typically sequentia...
research
∙
06/16/2021
Collaborative Training of Acoustic Encoders for Speech Recognition
On-device speech recognition requires training models of different sizes...
research
∙
04/06/2021
Flexi-Transducer: Optimizing Latency, Accuracy and Compute forMulti-Domain On-Device Scenarios
Often, the storage and computational constraints of embeddeddevices dema...
research
∙
04/06/2021
Dissecting User-Perceived Latency of On-Device E2E Speech Recognition
As speech-enabled devices such as smartphones and smart speakers become ...
research
∙
04/05/2021
Contextualized Streaming End-to-End Speech Recognition with Trie-Based Deep Biasing and Shallow Fusion
How to leverage dynamic contextual information in end-to-end speech reco...
research
∙
04/05/2021
Dynamic Encoder Transducer: A Flexible Solution For Trading Off Accuracy For Latency
We propose a dynamic encoder transducer (DET) for on-device speech recog...
research
∙
01/27/2021
A multiple-relaxation-time collision model by Hermite expansion
The Bhatnagar-Gross-Krook (BGK) single-relaxation-time collision model f...
research
∙
11/03/2020
Streaming Attention-Based Models with Augmented Memory for End-to-End Speech Recognition
Attention-based models have been gaining popularity recently for their s...
research
∙
10/27/2020
Transformer in action: a comparative study of transformer-based acoustic models for large scale speech recognition applications
In this paper, we summarize the application of transformer and its strea...
research
∙
10/21/2020
Emformer: Efficient Memory Transformer Based Acoustic Model For Low Latency Streaming Speech Recognition
This paper proposes an efficient memory transformer Emformer for low lat...
research
∙
05/18/2020
Weak-Attention Suppression For Transformer Based Speech Recognition
Transformers, originally proposed for natural language processing (NLP) ...
research
∙
05/16/2020
Streaming Transformer-based Acoustic Models Using Self-attention with Augmented Memory
Transformer-based acoustic modeling has achieved great suc-cess for both...
research
∙
04/08/2019
Knowledge Distillation For Recurrent Neural Network Language Modeling With Trust Regularization
Recurrent Neural Networks (RNNs) have dominated language modeling becaus...
research
∙
03/12/2019