A Robot that Counts Like a Child – a Developmental Model of Counting and Pointing

08/05/2020
by   Leszek Pecyna, et al.
0

In this paper, a novel neuro-robotics model capable of counting real items is introduced. The model allows us to investigate the interaction between embodiment and numerical cognition. This is composed of a deep neural network capable of image processing and sequential tasks performance, and a robotic platform providing the embodiment - the iCub humanoid robot. The network is trained using images from the robot's cameras and proprioceptive signals from its joints. The trained model is able to count a set of items and at the same time points to them. We investigate the influence of pointing on the counting process and compare our results with those from studies with children. Several training approaches are presented in this paper all of them uses pre-training routine allowing the network to gain the ability of pointing and number recitation (from 1 to 10) prior to counting training. The impact of the counted set size and distance to the objects are investigated. The obtained results on counting performance show similarities with those from human studies.

READ FULL TEXT
research
07/09/2019

Influence of Pointing on Learning to Count: A Neuro-Robotics Model

In this paper a neuro-robotics model capable of counting using gestures ...
research
07/09/2019

A Deep Neural Network for Finger Counting and Numerosity Estimation

In this paper, we present neuro-robotics models with a deep artificial n...
research
05/21/2021

Modelling the development of counting with memory-augmented neural networks

Learning to count is an important example of the broader human capacity ...
research
02/23/2021

Weakly-supervised multi-class object localization using only object counts as labels

We demonstrate the use of an extensive deep neural network to localize i...
research
02/10/2023

GCNet: Probing Self-Similarity Learning for Generalized Counting Network

The class-agnostic counting (CAC) problem has caught increasing attentio...
research
01/05/2021

Understanding the Ability of Deep Neural Networks to Count Connected Components in Images

Humans can count very fast by subitizing, but slow substantially as the ...
research
05/27/2020

Efficient Pig Counting in Crowds with Keypoints Tracking and Spatial-aware Temporal Response Filtering

Pig counting is a crucial task for large-scale pig farming, which is usu...

Please sign up or login with your details

Forgot password? Click here to reset