Transformers Are Better Than Humans at Identifying Generated Text

09/28/2020

∙

by   Antonis Maronikolakis, et al.

∙

0

∙

share

Fake information spread via the internet and social media influences public opinion and user activity. Generative models enable fake content to be generated faster and more cheaply than had previously been possible. This paper examines the problem of identifying fake content generated by lightweight deep learning models. A dataset containing human and machine-generated headlines was created and a user study indicated that humans were only able to identify the fake headlines in 45.3 approach, transformers, achieved an accuracy of 94 generated from language models can be filtered out accurately.