research
∙
05/24/2023
Flan-MoE: Scaling Instruction-Finetuned Language Models with Sparse Mixture of Experts
The explosive growth of language models and their applications have led ...
share
research
∙
03/14/2023
Simfluence: Modeling the Influence of Individual Training Examples by Simulating Training Runs
Training data attribution (TDA) methods offer to trace a model's predict...
research
∙
03/07/2023
Larger language models do in-context learning differently
We study how in-context learning (ICL) in language models is affected by...
research
∙
01/31/2023
The Flan Collection: Designing Data and Methods for Effective Instruction Tuning
We study the design decisions of publicly available instruction tuning m...
research
∙
01/17/2023
Are Language Models Worse than Humans at Following Prompts? It's Complicated
Prompts have been the center of progress in advancing language models' z...
research
∙
11/03/2022
Crosslingual Generalization through Multitask Finetuning
Multitask prompted finetuning (MTF) has been shown to help large languag...
research
∙
08/16/2022
Interactive and Visual Prompt Engineering for Ad-hoc Task Adaptation with Large Language Models
State-of-the-art neural language models can now be used to solve ad-hoc ...
research
∙
02/02/2022
PromptSource: An Integrated Development Environment and Repository for Natural Language Prompts
PromptSource is a system for creating, sharing, and using natural langua...
research
∙
10/15/2021
Multitask Prompted Training Enables Zero-Shot Task Generalization
Large language models have recently been shown to attain reasonable zero...
research
∙
09/02/2021
Do Prompt-Based Models Really Understand the Meaning of their Prompts?
Recently, a boom of papers have shown extraordinary progress in few-shot...
research
∙
10/06/2020