research
∙
01/11/2023
NarrowBERT: Accelerating Masked Language Model Pretraining and Inference
Large-scale language model pretraining is a very successful form of self...
share
research
∙
11/30/2022
Domain Mismatch Doesn't Always Prevent Cross-Lingual Transfer Learning
Cross-lingual transfer learning without labeled target language data or ...
research
∙
10/15/2020
Unsupervised Bitext Mining and Translation via Self-trained Contextual Embeddings
We describe an unsupervised method to create pseudo-parallel corpora for...
research
∙
10/06/2020
The Multilingual Amazon Reviews Corpus
We present the Multilingual Amazon Reviews Corpus (MARC), a large-scale ...
research
∙
05/02/2020
Improving Non-autoregressive Neural Machine Translation with Monolingual Data
Non-autoregressive (NAR) neural machine translation is usually done via ...
research
∙
04/30/2020
On the Evaluation of Contextual Embeddings for Zero-Shot Cross-Lingual Transfer Learning
Pre-trained multilingual contextual embeddings have demonstrated state-o...
research
∙
02/12/2020
Attentional Speech Recognition Models Misbehave on Out-of-domain Utterances
We discuss the problem of echographic transcription in autoregressive se...
research
∙
08/31/2019
Adversarial Learning with Contextual Embeddings for Zero-resource Cross-lingual Classification and NER
Contextual word embeddings (e.g. GPT, BERT, ELMo, etc.) have demonstrate...
research
∙
04/23/2018
A neural interlingua for multilingual machine translation
We incorporate an explicit neural interlingua into a multilingual encode...
research
∙
03/28/2017