research
∙
05/23/2023
Two Failures of Self-Consistency in the Multi-Step Reasoning of LLMs
Large language models (LLMs) have achieved widespread success on a varie...
share
research
∙
04/02/2023
Eight Things to Know about Large Language Models
The widespread public deployment of large language models (LLMs) in rece...
research
∙
02/15/2023
The Capacity for Moral Self-Correction in Large Language Models
We test the hypothesis that language models trained with reinforcement l...
research
∙
12/15/2022
Constitutional AI: Harmlessness from AI Feedback
As AI systems become more capable, we would like to enlist their help to...
research
∙
04/11/2022
Single-Turn Debate Does Not Help Humans Answer Hard Reading-Comprehension Questions
Current QA systems can generate reasonable-sounding yet false answers wi...
research
∙
10/15/2021
BBQ: A Hand-Built Bias Benchmark for Question Answering
It is well documented that NLP models learn social biases present in the...
research
∙
09/14/2021
NOPE: A Corpus of Naturally-Occurring Presuppositions in English
Understanding language requires grasping not only the overtly stated con...
research
∙
09/30/2020
CrowS-Pairs: A Challenge Dataset for Measuring Social Biases in Masked Language Models
Pretrained language models, especially masked language models (MLMs) hav...
research
∙
05/02/2019
SuperGLUE: A Stickier Benchmark for General-Purpose Language Understanding Systems
In the last year, new models and methods for pretraining and transfer le...
research
∙
01/11/2019
Grammatical Analysis of Pretrained Sentence Encoders with Acceptability Judgments
Recent pretrained sentence encoders achieve state of the art results on ...
research
∙
11/02/2018
