Toward a Human-Level Video Understanding Intelligence

10/08/2021
by   Yu-Jung Heo, et al.
36

We aim to develop an AI agent that can watch video clips and have a conversation with human about the video story. Developing video understanding intelligence is a significantly challenging task, and evaluation methods for adequately measuring and analyzing the progress of AI agent are lacking as well. In this paper, we propose the Video Turing Test to provide effective and practical assessments of video understanding intelligence as well as human-likeness evaluation of AI agents. We define a general format and procedure of the Video Turing Test and present a case study to confirm the effectiveness and usefulness of the proposed test.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/02/2023

Navigates Like Me: Understanding How People Evaluate Human-Like AI in Video Games

We aim to understand how people assess human likeness in navigation prod...
research
04/01/2019

Constructing Hierarchical Q A Datasets for Video Story Understanding

Video understanding is emerging as a new paradigm for studying human-lik...
research
03/29/2023

ChatGPT believes it is conscious

The development of advanced generative chat models, such as ChatGPT, has...
research
10/22/2014

The Lovelace 2.0 Test of Artificial Creativity and Intelligence

Observing that the creation of certain types of artistic artifacts neces...
research
05/20/2021

Navigation Turing Test (NTT): Learning to Evaluate Human-Like Navigation

A key challenge on the path to developing agents that learn complex huma...
research
05/19/2023

Testing System Intelligence

We discuss the adequacy of tests for intelligent systems and practical p...
research
07/21/2021

CogME: A Novel Evaluation Metric for Video Understanding Intelligence

Developing video understanding intelligence is quite challenging because...

Please sign up or login with your details

Forgot password? Click here to reset