ChatGPT is fun, but it is not funny! Humor is still challenging Large Language Models

by   Sophie Jentzsch, et al.

Humor is a central aspect of human communication that has not been solved for artificial agents so far. Large language models (LLMs) are increasingly able to capture implicit and contextual information. Especially, OpenAI's ChatGPT recently gained immense public attention. The GPT3-based model almost seems to communicate on a human level and can even tell jokes. Humor is an essential component of human communication. But is ChatGPT really funny? We put ChatGPT's sense of humor to the test. In a series of exploratory experiments around jokes, i.e., generation, explanation, and detection, we seek to understand ChatGPT's capability to grasp and reproduce human humor. Since the model itself is not accessible, we applied prompt-based experiments. Our empirical evidence indicates that jokes are not hard-coded but mostly also not newly generated by the model. Over 90 accurately explains valid jokes but also comes up with fictional explanations for invalid jokes. Joke-typical characteristics can mislead ChatGPT in the classification of jokes. ChatGPT has not solved computational humor yet but it can be a big leap toward "funny" machines.


TopEx: Topic-based Explanations for Model Comparison

Meaningfully comparing language models is challenging with current expla...

Evaluating large language models' ability to understand metaphor and sarcasm using a screening test for Asperger syndrome

Metaphors and sarcasm are precious fruits of our highly-evolved social c...

Do Language Embeddings Capture Scales?

Pretrained Language Models (LMs) have been shown to possess significant ...

Towards More Human-like AI Communication: A Review of Emergent Communication Research

In the recent shift towards human-centric AI, the need for machines to a...

Theory of Mind May Have Spontaneously Emerged in Large Language Models

Theory of mind (ToM), or the ability to impute unobservable mental state...

Personality Traits in Large Language Models

The advent of large language models (LLMs) has revolutionized natural la...

Please sign up or login with your details

Forgot password? Click here to reset