research
∙
05/26/2023
MixCE: Training Autoregressive Language Models by Mixing Forward and Reverse Cross-Entropies
Autoregressive language models are trained by minimizing the cross-entro...
share
research
∙
05/25/2023
Overcoming Catastrophic Forgetting in Massively Multilingual Continual Learning
Real-life multilingual systems should be able to efficiently incorporate...
research
∙
03/30/2023
BloombergGPT: A Large Language Model for Finance
The use of NLP in the realm of financial technology is broad and complex...
research
∙
10/10/2022
BoundaryFace: A mining framework with noise label self-correction for Face Recognition
Face recognition has made tremendous progress in recent years due to the...
research
∙
07/12/2022
How Do Multilingual Encoders Learn Cross-lingual Representation?
NLP systems typically require support for more than one language. As dif...
research
∙
07/12/2022
Zero-shot Cross-lingual Transfer is Under-specified Optimization
Pretrained multilingual encoders enable zero-shot cross-lingual transfer...
research
∙
09/14/2021
Everything Is All It Takes: A Multipronged Strategy for Zero-Shot Cross-Lingual Information Extraction
Zero-shot cross-lingual information extraction (IE) describes the constr...
research
∙
02/10/2021
Differentiable Generative Phonology
The goal of generative phonology, as formulated by Chomsky and Halle (19...
research
∙
10/06/2020
Do Explicit Alignments Robustly Improve Multilingual Encoders?
Multilingual BERT (mBERT), XLM-RoBERTa (XLMR) and other unsupervised mul...
research
∙
10/02/2020
Which *BERT? A Survey Organizing Contextualized Encoders
Pretrained contextualized text encoders are now a staple of the NLP comm...
research
∙
06/20/2020
SIGMORPHON 2020 Shared Task 0: Typologically Diverse Morphological Inflection
A broad goal in natural language processing (NLP) is to develop a system...
research
∙
05/20/2020
Applying the Transformer to Character-level Transduction
The transformer has been shown to outperform recurrent neural network-ba...
research
∙
05/18/2020
Are All Languages Created Equal in Multilingual BERT?
Multilingual BERT (mBERT) trained on 104 languages has shown surprisingl...
research
∙
05/04/2020
The Paradigm Discovery Problem
This work treats the paradigm discovery problem (PDP), the task of learn...
research
∙
11/04/2019
Emerging Cross-lingual Structure in Pretrained Language Models
We study the problem of multilingual masked language modeling, i.e. the ...
research
∙
10/25/2019
The SIGMORPHON 2019 Shared Task: Morphological Analysis in Context and Cross-Lingual Transfer for Inflection
The SIGMORPHON 2019 shared task on cross-lingual transfer and contextual...
research
∙
06/27/2019
Morphological Irregularity Correlates with Frequency
We present a study of morphological irregularity. Following recent work,...
research
∙
05/15/2019
Exact Hard Monotonic Attention for Character-Level Transduction
Many common character-level, string-to-string transduction tasks, e.g., ...
research
∙
04/19/2019
Beto, Bentz, Becas: The Surprising Cross-Lingual Effectiveness of BERT
Pretrained contextual representation models (Peters et al., 2018; Devlin...
research
∙
04/04/2019
A Simple Joint Model for Improved Contextual Neural Lemmatization
English verbs have multiple forms. For instance, talk may also appear as...
research
∙
08/29/2018