research
∙
01/19/2022
CM3: A Causal Masked Multimodal Model of the Internet
We introduce CM3, a family of causally masked generative models trained ...
share
research
∙
12/18/2021
The Web Is Your Oyster – Knowledge-Intensive NLP against a Very Large Web Corpus
In order to address the increasing demands of real-world applications, t...
research
∙
12/10/2021
Discourse-Aware Prompt Design for Text Generation
Current efficient fine-tuning methods (e.g., adapters, prefix-tuning, et...
research
∙
07/28/2021
Domain-matched Pre-training Tasks for Dense Retrieval
Pre-training on larger datasets with ever increasing model size is now a...
research
∙
01/01/2021
NeurIPS 2020 EfficientQA Competition: Systems, Analyses and Lessons Learned
We review the EfficientQA competition from NeurIPS 2020. The competition...
research
∙
01/01/2021
Multi-task Retrieval for Knowledge-Intensive Tasks
Retrieving relevant contexts from a large corpus is a crucial step for t...
research
∙
12/30/2020
Joint Verification and Reranking for Open Fact Checking Over Tables
Structured information is an important knowledge source for automatic ve...
research
∙
12/29/2020
Unified Open-Domain Question Answering with Structured and Unstructured Knowledge
We study open-domain question answering (ODQA) with structured, unstruct...
research
∙
05/22/2020
Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks
Large pre-trained language models have been shown to store factual knowl...
research
∙
04/10/2020
Dense Passage Retrieval for Open-Domain Question Answering
Open-domain question answering relies on efficient passage retrieval to ...
research
∙
04/03/2020
Aligned Cross Entropy for Non-Autoregressive Machine Translation
Non-autoregressive machine translation models significantly speed up dec...
research
∙
02/05/2019