A Survey on Machine Learning Approaches for Modelling Intuitive Physics

by   Jiafei Duan, et al.

Research in cognitive science has provided extensive evidence on human cognitive ability in performing physical reasoning of objects from noisy perceptual inputs. Such a cognitive ability is commonly known as intuitive physics. With the advancements in deep learning, there is an increasing interest in building intelligent systems that are capable of performing physical reasoning from a given scene for the purpose of advancing fluid and building safer AI systems. As a result, many of the contemporary approaches in modelling intuitive physics for machine cognition have been inspired by literature from cognitive science. Despite the wide range of work in physical reasoning for machine cognition, there is a scarcity of reviews that organize and group these deep learning approaches. Especially at the intersection of intuitive physics and artificial intelligence, there is a need to make sense of the diverse range of ideas and approaches. Therefore, this paper presents a comprehensive survey of recent advances and techniques in intuitive physics-inspired deep learning approaches for physical reasoning. The survey will first categorize existing deep learning approaches into three facets of physical reasoning before organizing them into three general technical approaches and propose six categorical tasks of the field. Finally, we highlight the challenges of the current field and present some future research directions.


A Survey of Deep Learning for Mathematical Reasoning

Mathematical reasoning is a fundamental aspect of human intelligence and...

X-VoE: Measuring eXplanatory Violation of Expectation in Physical Events

Intuitive physics is pivotal for human understanding of the physical wor...

Probing Physics Knowledge Using Tools from Developmental Psychology

In order to build agents with a rich understanding of their environment,...

Towards Lifelong Self-Supervision: A Deep Learning Direction for Robotics

Despite outstanding success in vision amongst other domains, many of the...

The Scope and Limits of Simulation in Cognitive Models

It has been proposed that human physical reasoning consists largely of r...

IntPhys: A Framework and Benchmark for Visual Intuitive Physics Reasoning

In order to reach human performance on complex visual tasks, artificial ...

The Role of General Intelligence in Mathematical Reasoning

Objects are a centerpiece of the mathematical realm and our interaction ...

Please sign up or login with your details

Forgot password? Click here to reset