b'Graham Neubig'

research

∙ 09/14/2023

ChatGPT MT: Competitive for High- (but not Low-) Resource Languages

Large language models (LLMs) implicitly learn to perform a range of lang...

0 Nathaniel R. Robinson, et al. ∙

research

∙ 08/23/2023

Prompt2Model: Generating Deployable Models from Natural Language Instructions

Large language models (LLMs) enable system builders today to create comp...

0 Vijay Viswanathan, et al. ∙

research

∙ 08/14/2023

The Devil is in the Errors: Leveraging Large Language Models for Fine-grained Machine Translation Evaluation

Automatic evaluation of machine translation (MT) is a critical tool driv...

0 Patrick Fernandes, et al. ∙

research

∙ 07/25/2023

FacTool: Factuality Detection in Generative AI – A Tool Augmented Framework for Multi-Task and Multi-Domain Scenarios

The emergence of generative pre-trained models has facilitated the synth...

0 I-Chun Chern, et al. ∙

research

∙ 07/10/2023

Improving Factuality of Abstractive Summarization via Contrastive Reward Learning

Modern abstractive summarization models often generate summaries that co...

0 I-Chun Chern, et al. ∙

research

∙ 07/02/2023

Large Language Models Enable Few-Shot Clustering

Unlike traditional unsupervised clustering, semi-supervised clustering a...

0 Vijay Viswanathan, et al. ∙

research

∙ 06/11/2023

Neural Machine Translation for the Indigenous Languages of the Americas: An Introduction

Neural models have drastically advanced state of the art for machine tra...

0 Manuel Mager, et al. ∙

research

∙ 06/01/2023

Multi-Dimensional Evaluation of Text Summarization with In-Context Learning

Evaluation of natural language generation (NLG) is complex and multi-dim...

0 Sameer Jain, et al. ∙

research

∙ 05/29/2023

Syntax and Semantics Meet in the "Middle": Probing the Syntax-Semantics Interface of LMs Through Agentivity

Recent advances in large language models have prompted researchers to ex...

0 Lindia Tjuatja, et al. ∙

research

∙ 05/26/2023

DataFinder: Scientific Dataset Recommendation from Natural Language Descriptions

Modern machine learning relies on datasets to develop and validate resea...

10 Vijay Viswanathan, et al. ∙

research

∙ 05/25/2023

Multi-lingual and Multi-cultural Figurative Language Understanding

Figurative language permeates human communication, but at the same time ...

5 Anubha Kabra, et al. ∙

research

∙ 05/24/2023

GlobalBench: A Benchmark for Global Progress in Natural Language Processing

Despite the major advances in NLP, significant disparities in NLP system...

0 Yueqi Song, et al. ∙

research

∙ 05/19/2023

Solving NLP Problems through Human-System Collaboration: A Discussion-based Approach

Humans work together to solve common problems by having discussions, exp...

0 Masahiro Kaneko, et al. ∙

research

∙ 05/11/2023

Active Retrieval Augmented Generation

Despite the remarkable ability of large language models (LMs) to compreh...

0 Zhengbao Jiang, et al. ∙

research

∙ 05/02/2023

Unlimiformer: Long-Range Transformers with Unlimited Length Input

Transformer-based models typically have a predefined bound to their inpu...

0 Amanda Bertsch, et al. ∙

research

∙ 05/01/2023

Bridging the Gap: A Survey on Integrating (Human) Feedback for Natural Language Generation

Many recent advances in natural language generation have been fueled by ...

7 Patrick Fernandes, et al. ∙

research

∙ 03/23/2023

A Gold Standard Dataset for the Reviewer Assignment Problem

Many peer-review venues are either using or looking to use algorithms to...

0 Ivan Stelmakh, et al. ∙

research

∙ 02/26/2023

User-Centric Evaluation of OCR Systems for Kwak'wala

There has been recent interest in improving optical character recognitio...

0 Shruti Rijhwani, et al. ∙

research

∙ 02/15/2023

Learning Performance-Improving Code Edits

The waning of Moore's Law has shifted the focus of the tech industry tow...

2 Aman Madaan, et al. ∙

research

∙ 02/11/2023

Cross-Modal Fine-Tuning: Align then Refine

Fine-tuning large-scale pretrained models has led to tremendous progress...

0 Junhong Shen, et al. ∙

research

∙ 02/10/2023

CodeBERTScore: Evaluating Code Generation with Pretrained Models of Code

Since the rise of neural models of code that can generate long expressio...

0 Shuyan Zhou, et al. ∙

research

∙ 01/07/2023

Why do Nearest Neighbor Language Models Work?

Language models (LMs) compute the probability of a text by sequentially ...

0 Frank F. Xu, et al. ∙

research

∙ 12/21/2022

Beyond Contrastive Learning: A Variational Generative Model for Multilingual Retrieval

Contrastive learning has been successfully used for retrieval of semanti...

0 John Wieting, et al. ∙

research

∙ 12/20/2022

Execution-Based Evaluation for Open-Domain Code Generation

To extend the scope of coding queries to more realistic settings, we pro...

0 Zhiruo Wang, et al. ∙

research

∙ 12/19/2022

NusaCrowd: Open Source Initiative for Indonesian NLP Resources

We present NusaCrowd, a collaborative initiative to collect and unite ex...

0 Samuel Cahyawijaya, et al. ∙

research

∙ 12/12/2022

Searching for Effective Multilingual Fine-Tuning Methods: A Case Study in Summarization

Recently, a large number of tuning strategies have been proposed to adap...

0 Yiwei Qin, et al. ∙

research

∙ 12/12/2022

T5Score: Discriminative Fine-tuning of Generative Evaluation Metrics

Modern embedding-based metrics for evaluation of generated text generall...

0 Yiwei Qin, et al. ∙

research

∙ 12/05/2022

Retrieval as Attention: End-to-end Learning of Retrieval and Reading within a Single Transformer

Systems for knowledge-intensive tasks such as open-domain question answe...

0 Zhengbao Jiang, et al. ∙

research

∙ 11/18/2022

PAL: Program-aided Language Models

Large language models (LLMs) have recently demonstrated an impressive ab...

0 Luyu Gao, et al. ∙

research

∙ 11/11/2022

English Contrastive Learning Can Learn Universal Cross-lingual Sentence Embeddings

Universal cross-lingual sentence embeddings map semantically similar cro...

0 Yau-Shian Wang, et al. ∙

research

∙ 10/30/2022

DiffusER: Discrete Diffusion via Edit-based Reconstruction

In text generation, models that generate text from scratch one token at ...

0 Machel Reid, et al. ∙

research

∙ 10/27/2022

He Said, She Said: Style Transfer for Shifting the Perspective of Dialogues

In this work, we define a new style transfer task: perspective shift, wh...

0 Amanda Bertsch, et al. ∙

research

∙ 10/13/2022

Language Models of Code are Few-Shot Commonsense Learners

We address the general task of structured commonsense reasoning: given a...

0 Aman Madaan, et al. ∙

research

∙ 10/13/2022

A Multi-dimensional Evaluation of Tokenizer-free Multilingual Pretrained Models

Recent work on tokenizer-free multilingual pretrained models show promis...

0 Jimin Sun, et al. ∙

research

∙ 10/11/2022

CTC Alignments Improve Autoregressive Translation

Connectionist Temporal Classification (CTC) is a widely used approach fo...

0 Brian Yan, et al. ∙

research

∙ 10/09/2022

Understanding and Improving Zero-shot Multi-hop Reasoning in Generative Question Answering

Generative question answering (QA) models generate answers to questions ...

0 Zhengbao Jiang, et al. ∙

research

∙ 10/07/2022

Are Representations Built from the Ground Up? An Empirical Examination of Local Composition in Language Models

Compositionality, the phenomenon where the meaning of a phrase can be de...

6 Emmy Liu, et al. ∙

research

∙ 09/21/2022

Mega: Moving Average Equipped Gated Attention

The design choices in the Transformer attention mechanism, including wea...

2 Xuezhe Ma, et al. ∙

research

∙ 08/23/2022

KGxBoard: Explainable and Interactive Leaderboard for Evaluation of Knowledge Graph Completion Models

Knowledge Graphs (KGs) store information in the form of (head, predicate...

0 Haris Widjaja, et al. ∙

research

∙ 07/13/2022

DocCoder: Generating Code by Retrieving and Reading Docs

Natural-language-to-code models learn to generate a code snippet given a...

0 Shuyan Zhou, et al. ∙

research

∙ 07/08/2022

OmniTab: Pretraining with Natural and Synthetic Data for Few-shot Table-based Question Answering

The information in tables can be an important complement to text, making...

0 Zhengbao Jiang, et al. ∙

research

∙ 07/01/2022

Building African Voices

Modern speech synthesis techniques can produce natural-sounding speech g...

10 Perez Ogayo, et al. ∙

research

∙ 06/10/2022

Teacher Perception of Automatically Extracted Grammar Concepts for L2 Language Learning

One of the challenges of language teaching is how to organize the rules ...

0 Aditi Chaudhary, et al. ∙

research

∙ 05/27/2022

AANG: Automating Auxiliary Learning

When faced with data-starved or highly complex end-tasks, it is commonpl...

0 Lucio M. Dery, et al. ∙

research

∙ 05/24/2022

Learning to Model Editing Processes

Most existing sequence generation models produce outputs in one pass, us...

0 Machel Reid, et al. ∙

research

∙ 05/19/2022

Table Retrieval May Not Necessitate Table-specific Model Design

Tables are an important form of structured data for both human and machi...

0 Zhiruo Wang, et al. ∙

research

∙ 05/02/2022

Quality-Aware Decoding for Neural Machine Translation

Despite the progress in machine translation quality estimation and evalu...

5 Patrick Fernandes, et al. ∙

research

∙ 04/29/2022

Prompt Consistency for Zero-Shot Task Generalization

One of the most impressive results of recent NLP history is the ability ...

0 Chunting Zhou, et al. ∙

research

∙ 04/26/2022

Testing the Ability of Language Models to Interpret Figurative Language

Figurative and metaphorical language are commonplace in discourse, and f...

6 Emmy Liu, et al. ∙

research

∙ 04/22/2022

Learning to Scaffold: Optimizing Model Explanations for Teaching

Modern machine learning models are opaque, and as a result there is a bu...

0 Patrick Fernandes, et al. ∙

Graham Neubig

Featured Co-authors