research
∙
09/18/2023
Dynamic-SUPERB: Towards A Dynamic, Collaborative, and Comprehensive Instruction-Tuning Benchmark for Speech
Text language models have shown remarkable zero-shot capability in gener...
share
research
∙
05/30/2023
MiniSUPERB: Lightweight Benchmark for Self-supervised Speech Models
Self-supervised learning (SSL) is a popular research topic in speech pro...
research
∙
02/24/2023
Ensemble knowledge distillation of self-supervised speech models
Distilled self-supervised models have shown competitive performance and ...
research
∙
11/17/2022
Compressing Transformer-based self-supervised models for speech processing
Despite the success of Transformers in self-supervised learning with app...
research
∙
11/17/2022
MelHuBERT: A simplified HuBERT on Mel spectrogram
Self-supervised models have had great success in learning speech represe...
research
∙
11/02/2022
M-SpeechCLIP: Leveraging Large-Scale, Pre-Trained Models for Multilingual Speech to Image Retrieval
This work investigates the use of large-scale, pre-trained models (CLIP ...
research
∙
10/13/2022
On the Utility of Self-supervised Models for Prosody-related Tasks
Self-Supervised Learning (SSL) from speech data has produced models that...
research
∙
10/06/2022
How Far Are We from Real Synonym Substitution Attacks?
In this paper, we explore the following question: how far are we from re...
research
∙
10/03/2022
SpeechCLIP: Integrating Speech with Pre-Trained Vision and Language Model
Data-driven speech processing models usually perform well with a large a...
research
∙
09/26/2022
The Ability of Self-Supervised Speech Models for Audio Representations
Self-supervised learning (SSL) speech models have achieved unprecedented...
research
∙
03/14/2022
SUPERB-SG: Enhanced Speech processing Universal PERformance Benchmark for Semantic and Generative Capabilities
Transfer learning has proven to be crucial in advancing the state of spe...
research
∙
04/06/2021
Non-autoregressive Mandarin-English Code-switching Speech Recognition with Pinyin Mask-CTC and Word Embedding Regularization
Mandarin-English code-switching (CS) is frequently used among East and S...
research
∙
10/31/2020
AGAIN-VC: A One-shot Voice Conversion using Activation Guidance and Adaptive Instance Normalization
Recently, voice conversion (VC) has been widely studied. Many VC systems...
research
∙
06/09/2020
Hand-crafted Attention is All You Need? A Study of Attention on Self-supervised Audio Transformer
In this paper, we seek to reduce the computation complexity of transform...
research
∙
12/05/2019
Towards Robust Neural Vocoding for Speech Generation: A Survey
Recently, neural vocoders have been widely used in speech synthesis task...
research
∙
11/15/2019
Deep Long Audio Inpainting
Long (> 200 ms) audio inpainting, to recover a long missing part in an a...
research
∙
10/25/2019
SpeechBERT: Cross-Modal Pre-trained Language Model for End-to-end Spoken Question Answering
While end-to-end models for spoken language understanding tasks have bee...
research
∙
09/14/2019
Tree Transformer: Integrating Tree Structures into Self-Attention
Pre-training Transformer from large-scale raw texts and fine-tuning on t...
research
∙
09/07/2019
LAMAL: LAnguage Modeling Is All You Need for Lifelong Language Learning
Most research on lifelong learning (LLL) applies to images or games, but...
research
∙
11/06/2018
Code-switching Sentence Generation by Generative Adversarial Networks and its Application to Data Augmentation
Code-switching is about dealing with alternative languages in speech or ...
research
∙
08/16/2017
