research
∙
07/06/2023
Lost in the Middle: How Language Models Use Long Contexts
While recent language models have the ability to take long contexts as i...
share
research
∙
02/20/2023
Can discrete information extraction prompts generalize across language models?
We study whether automatically-induced prompts that effectively extract ...
research
∙
09/27/2022
EditEval: An Instruction-Based Benchmark for Text Improvements
Evaluation of text generation to date has primarily focused on content c...
research
∙
09/13/2022
Entity Tagging: Extracting Entities in Text Without Mention Supervision
Detection and disambiguation of all entities in text is a crucial task f...
research
∙
08/24/2022
PEER: A Collaborative Language Model
Textual content is often the output of a collaborative writing process: ...
research
∙
08/05/2022
Few-shot Learning with Retrieval Augmented Language Models
Large language models have shown impressive few-shot results on a wide r...
research
∙
07/08/2022
Improving Wikipedia Verifiability with AI
Verifiability is a core content policy of Wikipedia: claims that are lik...
research
∙
05/25/2022
EDIN: An End-to-end Benchmark and Pipeline for Unknown Entity Discovery and Indexing
Existing work on Entity Linking mostly assumes that the reference knowle...
research
∙
05/12/2022
Open Vocabulary Extreme Classification Using Generative Models
The extreme multi-label classification (XMC) task aims at tagging conten...
research
∙
04/22/2022
Autoregressive Search Engines: Generating Substrings as Document Identifiers
Knowledge-intensive language tasks require NLP systems to both provide t...
research
∙
01/26/2022
Learning To Recognize Procedural Activities with Distant Supervision
In this paper we consider the problem of classifying fine-grained, multi...
research
∙
12/18/2021
The Web Is Your Oyster – Knowledge-Intensive NLP against a Very Large Web Corpus
In order to address the increasing demands of real-world applications, t...
research
∙
12/14/2021
Boosted Dense Retriever
We propose DrBoost, a dense retrieval ensemble inspired by boosting. DrB...
research
∙
09/27/2021
MiniHack the Planet: A Sandbox for Open-Ended Reinforcement Learning Research
The progress in deep reinforcement learning (RL) is heavily driven by th...
research
∙
06/24/2021
Cutting Down on Prompts and Parameters: Simple Few-Shot Learning with Language Models
Prompting language models (LMs) with training examples and task descript...
research
∙
04/01/2021
CycleDRUMS: Automatic Drum Arrangement For Bass Lines Using CycleGAN
The two main research threads in computer-based music generation are: th...
research
∙
03/23/2021
Multilingual Autoregressive Entity Linking
We present mGENRE, a sequence-to-sequence system for the Multilingual En...
research
∙
01/01/2021
NeurIPS 2020 EfficientQA Competition: Systems, Analyses and Lessons Learned
We review the EfficientQA competition from NeurIPS 2020. The competition...
research
∙
01/01/2021
Multi-task Retrieval for Knowledge-Intensive Tasks
Retrieving relevant contexts from a large corpus is a crucial step for t...
research
∙
12/30/2020
A Memory Efficient Baseline for Open Domain Question Answering
Recently, retrieval systems based on dense representations have led to i...
research
∙
11/10/2020
Generating Fact Checking Briefs
Fact checking at scale is difficult – while the number of active fact ch...
research
∙
10/02/2020
Autoregressive Entity Retrieval
Entities are at the center of how we represent and aggregate knowledge. ...
research
∙
09/04/2020
KILT: a Benchmark for Knowledge Intensive Language Tasks
Challenging problems such as open-domain question answering, fact checki...
research
∙
06/12/2020
Video Understanding as Machine Translation
With the advent of large-scale multimodal video datasets, especially seq...
research
∙
06/01/2020
Concept Matching for Low-Resource Classification
We propose a model to tackle classification tasks in the presence of ver...
research
∙
05/22/2020
Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks
Large pre-trained language models have been shown to store factual knowl...
research
∙
05/10/2020
How Context Affects Language Models' Factual Predictions
When pre-trained on large unsupervised textual corpora, language models ...
research
∙
11/10/2019
Zero-shot Entity Linking with Dense Entity Retrieval
We consider the zero-shot entity-linking challenge where each entity is ...
research
∙
11/09/2019
How Decoding Strategies Affect the Verifiability of Generated Text
Language models are of considerable importance. They are used for pretra...
research
∙
09/03/2019
Language Models as Knowledge Bases?
Recent progress in pretraining language models on large textual corpora ...
research
∙
11/13/2018
SAFE: Self-Attentive Function Embeddings for Binary Similarity
The binary similarity problem consists in determining if two functions a...
research
∙
10/23/2018