research
∙
05/24/2023
BUFFET: Benchmarking Large Language Models for Few-shot Cross-lingual Transfer
Despite remarkable advancements in few-shot generalization in natural la...
share
research
∙
02/15/2023
Dictionary-based Phrase-level Prompting of Large Language Models for Machine Translation
Large language models (LLMs) demonstrate remarkable machine translation ...
research
∙
01/25/2023
XLM-V: Overcoming the Vocabulary Bottleneck in Multilingual Masked Language Models
Large multilingual language models typically rely on a single vocabulary...
research
∙
12/20/2022
Toward Human Readable Prompt Tuning: Kubrick's The Shining is a good movie, and a good prompt too?
Large language models can perform new tasks in a zero-shot fashion, give...
research
∙
12/08/2022
Demystifying Prompts in Language Models via Perplexity Estimation
Language models can be prompted to perform a wide variety of zero- and f...
research
∙
11/15/2022
Prompting Language Models for Linguistic Structure
Although pretrained language models (PLMs) can be prompted to perform a ...
research
∙
05/24/2022
Analyzing the Mono- and Cross-Lingual Pretraining Dynamics of Multilingual Language Models
The emergent cross-lingual transfer seen in multilingual pretrained mode...
research
∙
04/20/2022
Analyzing Gender Representation in Multilingual Models
Multilingual language models were shown to allow for nontrivial transfer...
research
∙
12/28/2021
Simple, Interpretable and Stable Method for Detecting Words with Usage Change across Corpora
The problem of comparing two bodies of text and searching for words that...
research
∙
04/20/2021
Identifying Helpful Sentences in Product Reviews
In recent years online shopping has gained momentum and became an import...
research
∙
10/31/2020
Pick a Fight or Bite your Tongue: Investigation of Gender Differences in Idiomatic Language Usage
A large body of research on gender-linked language has established found...
research
∙
10/16/2020
It's not Greek to mBERT: Inducing Word-Level Translations from Multilingual BERT
Recent works have demonstrated that multilingual BERT (mBERT) learns ric...
research
∙
04/29/2020
Automatically Identifying Gender Issues in Machine Translation using Perturbations
The successful application of neural methods to machine translation has ...
research
∙
04/16/2020
Null It Out: Guarding Protected Attributes by Iterative Nullspace Projection
The ability to control for the kinds of information encoded in neural re...
research
∙
10/30/2019
How does Grammatical Gender Affect Noun Representations in Gender-Marking Languages?
Many natural languages assign grammatical gender also to inanimate nouns...
research
∙
09/02/2019
It's All in the Name: Mitigating Gender Bias with Name-Based Counterfactual Data Substitution
This paper treats gender bias latent in word embeddings. Previous mitiga...
research
∙
03/09/2019
Lipstick on a Pig: Debiasing Methods Cover up Systematic Gender Biases in Word Embeddings But do not Remove Them
Word embeddings are widely used in NLP for a vast range of tasks. It was...
research
∙
10/28/2018
Language Modeling for Code-Switching: Evaluation, Integration of Monolingual Data, and Discriminative Training
We focus on the problem of language modeling for code-switched language,...
research
∙
11/27/2016