research
∙
09/08/2023
When Less is More: Investigating Data Pruning for Pretraining LLMs at Scale
Large volumes of text data have contributed significantly to the develop...
share
research
∙
08/09/2023
JEN-1: Text-Guided Universal Music Generation with Omnidirectional Diffusion Models
Music generation has attracted growing interest with the advancement of ...
research
∙
08/26/2022
What Do NLP Researchers Believe? Results of the NLP Community Metasurvey
We present the results of the NLP Community Metasurvey. Run from May to ...
research
∙
05/23/2022
SQuALITY: Building a Long-Document Summarization Dataset the Hard Way
Summarization datasets are often assembled either by scraping naturally ...
research
∙
04/12/2022
Benchmarking Active Learning Strategies for Materials Optimization and Discovery
Autonomous physical science is revolutionizing materials science. In the...
research
∙
04/08/2022
A Low-Cost Robot Science Kit for Education with Symbolic Regression for Hypothesis Discovery and Validation
The next generation of physical science involves robot scientists - auto...
research
∙
03/23/2021
SAFEval: Summarization Asks for Fact-based Evaluation
Summarization evaluation remains an open research problem: current metri...
research
∙
04/08/2020
Asking and Answering Questions to Evaluate the Factual Consistency of Summaries
Practical applications of abstractive summarization models are limited b...
research
∙
03/04/2020
jiant: A Software Toolkit for Research on General-Purpose Text Understanding Models
We introduce jiant, an open source toolkit for conducting multitask and ...
research
∙
02/08/2020
Fast Detection of Maximum Common Subgraph via Deep Q-Learning
Detecting the Maximum Common Subgraph (MCS) between two input graphs is ...
research
∙
05/29/2019
A Generalized Framework of Sequence Generation with Application to Undirected Sequence Models
Undirected neural sequence models such as BERT have received renewed int...
research
∙
05/15/2019
What do you learn from context? Probing for sentence structure in contextualized word representations
Contextualized representation models such as ELMo (Peters et al., 2018a)...
research
∙
05/02/2019
SuperGLUE: A Stickier Benchmark for General-Purpose Language Understanding Systems
In the last year, new models and methods for pretraining and transfer le...
research
∙
04/25/2019
Probing What Different NLP Tasks Teach Machines about Function Word Comprehension
We introduce a set of nine challenge tasks that test for the understandi...
research
∙
03/25/2019
On Measuring Social Biases in Sentence Encoders
The Word Embedding Association Test shows that GloVe and word2vec word e...
research
∙
02/11/2019
BERT has a Mouth, and It Must Speak: BERT as a Markov Random Field Language Model
We show that BERT (Devlin et al., 2018) is a Markov random field languag...
research
∙
12/28/2018
Looking for ELMo's friends: Sentence-Level Pretraining Beyond Language Modeling
Work on the problem of contextualized word representation -- the develop...
research
∙
07/30/2018
Geo-Supervised Visual Depth Prediction
We propose using global orientation from inertial measurements, and the ...
research
∙
04/20/2018
GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding
For natural language understanding (NLU) technology to be maximally usef...
research
∙
12/04/2017
Clustering Stable Instances of Euclidean k-means
The Euclidean k-means problem is arguably the most widely-studied cluste...
research
∙
04/22/2011