Transforming Question Answering Datasets Into Natural Language Inference Datasets

09/09/2018
by   Dorottya Demszky, et al.
0

Existing datasets for natural language inference (NLI) have propelled research on language understanding. We propose a new method for automatically deriving NLI datasets from the growing abundance of large-scale question answering datasets. Our approach hinges on learning a sentence transformation model which converts question-answer pairs into their declarative forms. Despite being primarily trained on a single QA dataset, we show that it can be successfully applied to a variety of other QA resources. Using this system, we automatically derive a new freely available dataset of over 500k NLI examples (QA-NLI), and show that it exhibits a wide range of inference phenomena rarely seen in previous NLI datasets.

READ FULL TEXT
research
03/06/2023

AmQA: Amharic Question Answering Dataset

Question Answering (QA) returns concise answers or answer lists from nat...
research
06/06/2019

ActivityNet-QA: A Dataset for Understanding Complex Web Videos via Question Answering

Recent developments in modeling language and vision have been successful...
research
05/11/2023

Think Twice: Measuring the Efficiency of Eliminating Prediction Shortcuts of Question Answering Models

While the Large Language Models (LLMs) dominate a majority of language u...
research
04/23/2018

Towards a Unified Natural Language Inference Framework to Evaluate Sentence Representations

We present a large scale unified natural language inference (NLI) datase...
research
09/08/2021

ArchivalQA: A Large-scale Benchmark Dataset for Open Domain Question Answering over Archival News Collections

In the last few years, open-domain question answering (ODQA) has advance...
research
09/06/2021

General-Purpose Question-Answering with Macaw

Despite the successes of pretrained language models, there are still few...
research
03/02/2022

Video Question Answering: Datasets, Algorithms and Challenges

Video Question Answering (VideoQA) aims to answer natural language quest...

Please sign up or login with your details

Forgot password? Click here to reset