research
∙
08/14/2023
Mind your Language (Model): Fact-Checking LLMs and their Role in NLP Research and Practice
Much of the recent discourse within the NLP research community has been ...
share
research
∙
06/05/2023
Using Sequences of Life-events to Predict Human Lives
Over the past decade, machine learning has revolutionized computers' abi...
research
∙
03/07/2023
The BigScience ROOTS Corpus: A 1.6TB Composite Multilingual Dataset
As language models grow ever larger, the need for large-scale high-quali...
research
∙
02/27/2023
The ROOTS Search Tool: Data Transparency for LLMs
ROOTS is a 1.6TB multilingual text corpus developed for the training of ...
research
∙
09/15/2022
Machine Reading, Fast and Slow: When Do Models "Understand" Language?
Two of the most fundamental challenges in Natural Language Understanding...
research
∙
05/23/2022
Outliers Dimensions that Disrupt Transformers Are Driven by Frequency
Transformer-based language models are known to display anisotropic behav...
research
∙
05/04/2022
Data Governance in the Age of Large-Scale Data-Driven Language Technology
The recent emergence and adoption of Machine Learning technology, and sp...
research
∙
05/02/2022
What Factors Should Paper-Reviewer Assignments Rely On? Community Perspectives on Issues and Ideals in Conference Peer-Review
Both scientific progress and individual researcher careers depend on the...
research
∙
10/04/2021
Generalization in NLI: Ways (Not) To Go Beyond Simple Heuristics
Much of recent progress in NLU was shown to be due to models' learning d...
research
∙
09/14/2021
Just What do You Think You're Doing, Dave?' A Checklist for Responsible Data Use in NLP
A key part of the NLP ethics movement is responsible use of data, but ex...
research
∙
07/27/2021
QA Dataset Explosion: A Taxonomy of NLP Resources for Question Answering and Reading Comprehension
Alongside huge volumes of research on deep learning models in NLP in the...
research
∙
06/29/2021
On the Interaction of Belief Bias and Explanations
A myriad of explainability methods have been proposed in recent years, b...
research
∙
05/28/2021
Changing the World by Changing the Data
NLP community is currently investing a lot more research and resources i...
research
∙
05/14/2021
BERT Busters: Outlier LayerNorm Dimensions that Disrupt BERT
Multiple studies have shown that BERT is remarkably robust to pruning, y...
research
∙
10/08/2020
What Can We Do to Improve Peer Review in NLP?
Peer review is our best tool for judging the quality of conference submi...
research
∙
05/01/2020
When BERT Plays the Lottery, All Tickets Are Winning
Much of the recent success in NLP is due to the large Transformer-based ...
research
∙
02/27/2020
A Primer in BERTology: What we know about how BERT works
Transformer-based models are now widely used in NLP, but we still do not...
research
∙
08/29/2019
NarrativeTime: Dense High-Speed Temporal Annotation on a Timeline
We present NarrativeTime, a new timeline-based annotation scheme for tem...
research
∙
08/21/2019
Revealing the Dark Secrets of BERT
BERT-based architectures currently give state-of-the-art performance on ...
research
∙
08/27/2018