research
∙
06/01/2023
Reimagining Retrieval Augmented Language Models for Answering Queries
We present a reality check on large language models and inspect the prom...
share
research
∙
05/23/2023
Towards A Unified View of Sparse Feed-Forward Network in Pretraining Large Language Model
Large and sparse feed-forward networks (S-FFN) such as Mixture-of-Expert...
research
∙
02/16/2023
LEVER: Learning to Verify Language-to-Code Generation with Execution
The advent of large language models trained on code (code LLMs) has led ...
research
∙
12/22/2022
OPT-IML: Scaling Language Model Instruction Meta Learning through the Lens of Generalization
Recent work has shown that fine-tuning large pre-trained language models...
research
∙
12/19/2022
Training Trajectories of Language Models Across Scales
Scaling up language models has led to unprecedented performance gains, b...
research
∙
05/12/2022
Lifting the Curse of Multilinguality by Pre-training Modular Transformers
Multilingual pre-trained models are known to suffer from the curse of mu...
research
∙
05/02/2022
OPT: Open Pre-trained Transformer Language Models
Large language models, which are often trained for hundreds of thousands...
research
∙
12/28/2021
Pretty Princess vs. Successful Leader: Gender Roles in Greeting Card Messages
People write personalized greeting cards on various occasions. While pri...
research
∙
12/20/2021
Efficient Large Scale Language Modeling with Mixtures of Experts
Mixture of Experts layers (MoEs) enable efficient scaling of language mo...
research
∙
12/20/2021
Few-shot Learning with Multilingual Language Models
Large-scale autoregressive language models such as GPT-3 are few-shot le...
research
∙
04/12/2021
Learning to Synthesize Data for Semantic Parsing
Synthesizing data for semantic parsing has gained increasing attention r...
research
∙
03/03/2021
NeurIPS 2020 NLC2CMD Competition: Translating Natural Language to Bash Commands
The NLC2CMD Competition hosted at NeurIPS 2020 aimed to bring the power ...
research
∙
12/23/2020
Bridging Textual and Tabular Data for Cross-Domain Text-to-SQL Semantic Parsing
We present BRIDGE, a powerful sequential architecture for modeling depen...
research
∙
10/19/2020
ColloQL: Robust Cross-Domain Text-to-SQL Over Search Queries
Translating natural language utterances to executable queries is a helpf...
research
∙
09/29/2020
GraPPa: Grammar-Augmented Pre-Training for Table Semantic Parsing
We present GraPPa, an effective pre-training approach for table semantic...
research
∙
07/30/2020
Photon: A Robust Cross-Domain Text-to-SQL System
Natural language interfaces to databases (NLIDB) democratize end user ac...
research
∙
07/06/2020
DART: Open-Domain Structured Data Record to Text Generation
We introduce DART, a large dataset for open-domain structured data recor...
research
∙
05/03/2020
Double-Hard Debias: Tailoring Word Embeddings for Gender Bias Mitigation
Word embeddings derived from human-generated corpora inherit strong gend...
research
∙
09/11/2019
CoSQL: A Conversational Text-to-SQL Challenge Towards Cross-Domain Natural Language Interfaces to Databases
We present CoSQL, a corpus for building cross-domain, general-purpose da...
research
∙
09/02/2019
Editing-Based SQL Query Generation for Cross-Domain Context-Dependent Questions
We focus on the cross-domain context-dependent text-to-SQL generation ta...
research
∙
06/05/2019
SParC: Cross-Domain Semantic Parsing in Context
We present SParC, a dataset for cross-domainSemanticParsing inContext th...
research
∙
08/31/2018
Multi-Hop Knowledge Graph Reasoning with Reward Shaping
Multi-hop reasoning is an effective approach for query answering (QA) ov...
research
∙
02/25/2018