A Data-centric Framework for Improving Domain-specific Machine Reading Comprehension Datasets

by   Iva Bojic, et al.

Low-quality data can cause downstream problems in high-stakes applications. Data-centric approach emphasizes on improving dataset quality to enhance model performance. High-quality datasets are needed for general-purpose Large Language Models (LLMs) training, as well as for domain-specific models, which are usually small in size as it is costly to engage a large number of domain experts for their creation. Thus, it is vital to ensure high-quality domain-specific training data. In this paper, we propose a framework for enhancing the data quality of original datasets. We applied the proposed framework to four biomedical datasets and showed relative improvement of up to 33 using back translation to enhance the original dataset quality.


page 4

page 5

page 14

page 15


MediaGPT : A Large Language Model For Chinese Media

Large language models (LLMs) have shown remarkable capabilities in gener...

BioADAPT-MRC: Adversarial Learning-based Domain Adaptation Improves Biomedical Machine Reading Comprehension Task

Motivation: Biomedical machine reading comprehension (biomedical-MRC) ai...

Adapting Large Language Models via Reading Comprehension

We explore how continued pre-training on domain-specific corpora influen...

A domain specific language for data-centric infographics: technical report

The production process of data-centric infographics entails problems rel...

A Vision-Centric Approach for Static Map Element Annotation

The recent development of online static map element (a.k.a. HD Map) cons...

Made of Steel? Learning Plausible Materials for Components in the Vehicle Repair Domain

We propose a novel approach to learn domain-specific plausible materials...

Please sign up or login with your details

Forgot password? Click here to reset