Detecting Bot-Generated Text by Characterizing Linguistic Accommodation in Human-Bot Interactions

06/02/2021
by   Paras Bhatt, et al.
0

Language generation models' democratization benefits many domains, from answering health-related questions to enhancing education by providing AI-driven tutoring services. However, language generation models' democratization also makes it easier to generate human-like text at-scale for nefarious activities, from spreading misinformation to targeting specific groups with hate speech. Thus, it is essential to understand how people interact with bots and develop methods to detect bot-generated text. This paper shows that bot-generated text detection methods are more robust across datasets and models if we use information about how people respond to it rather than using the bot's text directly. We also analyze linguistic alignment, providing insight into differences between human-human and human-bot conversations.

READ FULL TEXT

page 4

page 6

page 7

page 9

page 10

page 11

page 12

page 13

research
11/02/2019

Human and Automatic Detection of Generated Text

With the advent of generative models with a billion parameters or more, ...
research
09/14/2023

Detecting ChatGPT: A Survey of the State of Detecting ChatGPT-Generated Text

While recent advancements in the capabilities and widespread accessibili...
research
06/10/2019

GLTR: Statistical Detection and Visualization of Generated Text

The rapid improvement of language models has raised the specter of abuse...
research
06/07/2023

Long-form analogies generated by chatGPT lack human-like psycholinguistic properties

Psycholinguistic analyses provide a means of evaluating large language m...
research
06/30/2023

Provable Robust Watermarking for AI-Generated Text

As AI-generated text increasingly resembles human-written content, the a...
research
01/30/2023

ChatGPT or Human? Detect and Explain. Explaining Decisions of Machine Learning Model for Detecting Short ChatGPT-generated Text

ChatGPT has the ability to generate grammatically flawless and seemingly...
research
01/03/2020

"Love is as Complex as Math": Metaphor Generation System for Social Chatbot

As the wide adoption of intelligent chatbot in human daily life, user de...

Please sign up or login with your details

Forgot password? Click here to reset