Simultaneous Speech-to-Speech Translation System with Neural Incremental ASR, MT, and TTS

11/10/2020

∙

by   Katsuhito Sudoh, et al.

∙

0

∙

share

This paper presents a newly developed, simultaneous neural speech-to-speech translation system and its evaluation. The system consists of three fully-incremental neural processing modules for automatic speech recognition (ASR), machine translation (MT), and text-to-speech synthesis (TTS). We investigated its overall latency in the system's Ear-Voice Span and speaking latency along with module-level performance.