PeerDA: Data Augmentation via Modeling Peer Relation for Span Identification Tasks

by   Weiwen Xu, et al.

Span Identification (SpanID) is a family of NLP tasks that aims to detect and classify text spans. Different from previous works that merely leverage Subordinate (Sub) relation about if a span is an instance of a certain category to train SpanID models, we explore Peer (Pr) relation, which indicates that the two spans are two different instances from the same category sharing similar features, and propose a novel Peer Data Augmentation (PeerDA) approach to treat span-span pairs with the Pr relation as a kind of augmented training data. PeerDA has two unique advantages: (1) There are a large number of span-span pairs with the Pr relation for augmenting the training data. (2) The augmented data can prevent over-fitting to the superficial span-category mapping by pushing SpanID models to leverage more on spans' semantics. Experimental results on ten datasets over four diverse SpanID tasks across seven domains demonstrate the effectiveness of PeerDA. Notably, seven of them achieve state-of-the-art results.


page 1

page 2

page 3

page 4


Relation Extraction as Two-way Span-Prediction

The current supervised relation classification (RC) task uses a single e...

Dealing with negative samples with multi-task learning on span-based joint entity-relation extraction

Recent span-based joint extraction models have demonstrated significant ...

Dissecting Span Identification Tasks with Performance Prediction

Span identification (in short, span ID) tasks such as chunking, NER, or ...

A General Framework for Information Extraction using Dynamic Span Graphs

We introduce a general framework for several information extraction task...

Transductive Data Augmentation with Relational Path Rule Mining for Knowledge Graph Embedding

For knowledge graph completion, two major types of prediction models exi...

FSUIE: A Novel Fuzzy Span Mechanism for Universal Information Extraction

Universal Information Extraction (UIE) has been introduced as a unified ...

Linear Span Network for Object Skeleton Detection

Robust object skeleton detection requires to explore rich representative...

Please sign up or login with your details

Forgot password? Click here to reset