To ChatGPT, or not to ChatGPT: That is the question!

by   Alessandro Pegoraro, et al.

ChatGPT has become a global sensation. As ChatGPT and other Large Language Models (LLMs) emerge, concerns of misusing them in various ways increase, such as disseminating fake news, plagiarism, manipulating public opinion, cheating, and fraud. Hence, distinguishing AI-generated from human-generated becomes increasingly essential. Researchers have proposed various detection methodologies, ranging from basic binary classifiers to more complex deep-learning models. Some detection techniques rely on statistical characteristics or syntactic patterns, while others incorporate semantic or contextual information to improve accuracy. The primary objective of this study is to provide a comprehensive and contemporary assessment of the most recent techniques in ChatGPT detection. Additionally, we evaluated other AI-generated text detection tools that do not specifically claim to detect ChatGPT-generated content to assess their performance in detecting ChatGPT-generated content. For our evaluation, we have curated a benchmark dataset consisting of prompts from ChatGPT and humans, including diverse questions from medical, open Q A, and finance domains and user-generated responses from popular social networking platforms. The dataset serves as a reference to assess the performance of various techniques in detecting ChatGPT-generated content. Our evaluation results demonstrate that none of the existing methods can effectively detect ChatGPT-generated content.


page 1

page 2

page 3

page 4


Transformers Are Better Than Humans at Identifying Generated Text

Fake information spread via the internet and social media influences pub...

How Close is ChatGPT to Human Experts? Comparison Corpus, Evaluation, and Detection

The introduction of ChatGPT has garnered widespread attention in both ac...

Implementing BERT and fine-tuned RobertA to detect AI generated news by ChatGPT

The abundance of information on social media has increased the necessity...

Integrating Human-in-the-loop into Swarm Learning for Decentralized Fake News Detection

Social media has become an effective platform to generate and spread fak...

Evade ChatGPT Detectors via A Single Space

ChatGPT brings revolutionary social value but also raises concerns about...

GLTR: Statistical Detection and Visualization of Generated Text

The rapid improvement of language models has raised the specter of abuse...

Paraphrase Detection: Human vs. Machine Content

The growing prominence of large language models, such as GPT-4 and ChatG...

Please sign up or login with your details

Forgot password? Click here to reset