research
∙
08/28/2023
MEMORY-VQ: Compression for Tractable Internet-Scale Memory
Retrieval augmentation is a powerful but expensive method to make langua...
share
research
∙
06/17/2023
GLIMMER: generalized late-interaction memory reranker
Memory-augmentation is a powerful approach for efficiently incorporating...
research
∙
05/22/2023
GQA: Training Generalized Multi-Query Transformer Models from Multi-Head Checkpoints
Multi-query attention (MQA), which only uses a single key-value head, dr...
research
∙
03/17/2023
CoLT5: Faster Long-Range Transformers with Conditional Computation
Many natural language processing tasks benefit from long inputs, but pro...
research
∙
01/25/2023
Pre-computed memory or on-the-fly encoding? A hybrid approach to retrieval augmentation makes the most of your compute
Retrieval-augmented language models such as Fusion-in-Decoder are powerf...
research
∙
12/21/2022
ImPaKT: A Dataset for Open-Schema Knowledge Base Construction
Large language models have ushered in a golden age of semantic parsing. ...
research
∙
12/15/2022
FiDO: Fusion-in-Decoder optimized for stronger performance and faster inference
Fusion-in-Decoder (FiD) is a powerful retrieval-augmented language model...
research
∙
10/18/2022
Arithmetic Sampling: Parallel Diverse Decoding for Large Language Models
Decoding methods for large language models often trade-off between diver...
research
∙
09/29/2022
Generate-and-Retrieve: use your predictions to improve retrieval for semantic parsing
A common recent approach to semantic parsing augments sequence-to-sequen...
research
∙
09/02/2021
ShopTalk: A System for Conversational Faceted Search
We present ShopTalk, a multi-turn conversational faceted search system f...
research
∙
04/17/2020