research
∙
07/18/2023
Llama 2: Open Foundation and Fine-Tuned Chat Models
In this work, we develop and release Llama 2, a collection of pretrained...
share
research
∙
07/11/2022
No Language Left Behind: Scaling Human-Centered Machine Translation
Driven by the goal of eradicating language barriers on a global scale, m...
research
∙
06/07/2022
LegoNN: Building Modular Encoder-Decoder Models
State-of-the-art encoder-decoder models (e.g. for machine translation (M...
research
∙
08/06/2021
Facebook AI WMT21 News Translation Task Submission
We describe Facebook's multilingual model submission to the WMT2021 shar...
research
∙
01/26/2021
A Comparison of Approaches to Document-level Machine Translation
Document-level machine translation conditions on surrounding sentences t...
research
∙
11/13/2020
Language Models not just for Pre-training: Fast Online Neural Noisy Channel Modeling
Pre-training models on vast quantities of unlabeled data has emerged as ...
research
∙
10/21/2020
Beyond English-Centric Multilingual Machine Translation
Existing work in translation demonstrated the potential of massively mul...
research
∙
05/16/2020
Large scale weakly and semi-supervised learning for low-resource video ASR
Many semi- and weakly-supervised approaches have been investigated for o...
research
∙
04/10/2020
Dense Passage Retrieval for Open-Domain Question Answering
Open-domain question answering relies on efficient passage retrieval to ...
research
∙
01/22/2020
Multilingual Denoising Pre-training for Neural Machine Translation
This paper demonstrates that multilingual denoising pre-training produce...
research
∙
11/10/2019
CCMatrix: Mining Billions of High-Quality Parallel Sentences on the WEB
We show that margin-based bitext mining in a multilingual sentence space...
research
∙
10/27/2019
Training ASR models by Generation of Contextual Information
Supervised ASR models have reached unprecedented levels of accuracy, tha...
research
∙
08/14/2019
On The Evaluation of Machine Translation Systems Trained With Back-Translation
Back-translation is a widely used data augmentation technique which leve...
research
∙
07/15/2019
Facebook FAIR's WMT19 News Translation Task Submission
This paper describes Facebook FAIR's submission to the WMT19 shared news...
research
∙
06/06/2019
Playing the lottery with rewards and multiple languages: lottery tickets in RL and NLP
The lottery ticket hypothesis proposes that over-parameterization of dee...
research
∙
04/01/2019
fairseq: A Fast, Extensible Toolkit for Sequence Modeling
fairseq is an open-source sequence modeling toolkit that allows research...
research
∙
03/22/2019
Pre-trained Language Model Representations for Language Generation
Pre-trained language model representations have been successful in a wid...
research
∙
03/19/2019
Cloze-driven Pretraining of Self-attention Networks
We present a new approach for pretraining a bi-directional transformer m...
research
∙
08/28/2018
Understanding Back-Translation at Scale
An effective method to improve neural machine translation with monolingu...
research
∙
06/01/2018
Scaling Neural Machine Translation
Sequence to sequence learning models still require several days to reach...
research
∙
11/14/2017