research
∙
06/28/2023
Towards Language Models That Can See: Computer Vision Through the LENS of Natural Language
We propose LENS, a modular approach for tackling computer vision problem...
share
research
∙
03/07/2023
The BigScience ROOTS Corpus: A 1.6TB Composite Multilingual Dataset
As language models grow ever larger, the need for large-scale high-quali...
research
∙
12/09/2022
Measuring Data
We identify the task of measuring data to quantitatively characterize th...
research
∙
07/20/2022
DataPerf: Benchmarks for Data-Centric AI Development
Machine learning (ML) research has generally focused on models, while th...
research
∙
04/07/2022
Winoground: Probing Vision and Language Models for Visio-Linguistic Compositionality
We present a novel task and dataset for evaluating the ability of vision...
research
∙
04/05/2022
Dynatask: A Framework for Creating Dynamic AI Benchmark Tasks
We introduce Dynatask: an open source system for setting up custom NLP t...
research
∙
12/16/2021
Models in the Loop: Aiding Crowdworkers with Generative Annotation Assistants
In Dynamic Adversarial Data Collection (DADC), human annotators are task...
research
∙
08/12/2021
Hatemoji: A Test Suite and Adversarially-Generated Dataset for Benchmarking and Detecting Emoji-based Hate
Detecting online hate is a complex task, and low-performing models have ...
research
∙
04/18/2021
Improving Question Answering Model Robustness with Synthetic Adversarial Data Generation
Despite the availability of very large datasets and pretrained models, s...
research
∙
03/05/2021
Rover Relocalization for Mars Sample Return by Virtual Template Synthesis and Matching
We consider the problem of rover relocalization in the context of the no...
research
∙
12/31/2020
Learning from the Worst: Dynamically Generated Datasets to Improve Online Hate Detection
We present a first-of-its-kind large synthetic training dataset for onli...
research
∙
11/04/2020
Investigating Novel Verb Learning in BERT: Selectional Preference Classes and Alternation-Based Syntactic Generalization
Previous studies investigating the syntactic abilities of deep learning ...
research
∙
10/24/2020
ANLIzing the Adversarial Natural Language Inference Dataset
We perform an in-depth error analysis of Adversarial NLI (ANLI), a recen...
research
∙
02/06/2020