research
∙
07/20/2023
Long-Tail Theory under Gaussian Mixtures
We suggest a simple Gaussian mixture model for data generation that comp...
share
research
∙
12/19/2022
Memory-efficient NLLB-200: Language-specific Expert Pruning of a Massively Multilingual Machine Translation Model
Compared to conventional bilingual translation systems, massively multil...
research
∙
12/19/2022
BLOOM+1: Adding Language Support to BLOOM for Zero-Shot Prompting
The BLOOM model is a large open-source multilingual language model capab...
research
∙
10/20/2022
SMaLL-100: Introducing Shallow Multilingual Machine Translation Model for Low-Resource Languages
In recent years, multilingual machine translation models have achieved p...
research
∙
05/22/2022
What Do Compressed Multilingual Machine Translation Models Forget?
Recently, very large pre-trained models achieve state-of-the-art results...
research
∙
04/20/2022
DaLC: Domain Adaptation Learning Curve Prediction for Neural Machine Translation
Domain Adaptation (DA) of Neural Machine Translation (NMT) model often r...
research
∙
04/11/2022
Adapting BigScience Multilingual Model to Unseen Languages
We benchmark different strategies of adding new languages (German and Ko...
research
∙
01/09/2022
Zero-Shot and Few-Shot Classification of Biomedical Articles in Context of the COVID-19 Pandemic
MeSH (Medical Subject Headings) is a large thesaurus created by the Nati...
research
∙
11/12/2021
Speeding Up Entmax
Softmax is the de facto standard in modern neural networks for language ...
research
∙
10/18/2021
Multilingual Domain Adaptation for NMT: Decoupling Language and Domain Information with Adapters
Adapter layers are lightweight, learnable units inserted between transfo...
research
∙
09/14/2021
Efficient Inference for Multilingual Neural Machine Translation
Multilingual NMT has become an attractive solution for MT deployment in ...
research
∙
06/22/2021
On the Evaluation of Machine Translation for Terminology Consistency
As neural machine translation (NMT) systems become an important part of ...
research
∙
05/31/2021
Do Multilingual Neural Machine Translation Models Contain Language Pair Specific Attention Heads?
Recent studies on the analysis of the multilingual representations focus...
research
∙
03/02/2021
The Rediscovery Hypothesis: Language Models Need to Meet Linguistics
There is an ongoing debate in the NLP community whether modern language ...
research
∙
08/06/2020
A Multilingual Neural Machine Translation Model for Biomedical Data
We release a multilingual neural machine translation model, which can be...
research
∙
10/31/2019
Machine Translation of Restaurant Reviews: New Corpus for Domain Adaptation and Robustness
We share a French-English parallel corpus of Foursquare restaurant revie...
research
∙
09/27/2019