Detection, localisation and tracking of pallets using machine learning techniques and 2D range data

03/29/2018
by   Ihab S. Mohamed, et al.
0

The problem of autonomous transportation in industrial scenarios is receiving a renewed interest due to the way it can revolutionise internal logistics, especially in unstructured environments. This paper presents a novel architecture allowing a robot to detect, localise, and track multiple pallets using machine learning techniques based on an on-board 2D laser rangefinder. The architecture is composed of two main components: the first stage is a pallet detector employing a Faster Region-based Convolutional Neural Network (Faster R-CNN) detector cascaded with a CNN-based classifier; the second stage is a Kalman filter for localising and tracking detected pallets, which we also use to defer commitment to a pallet detected in the first step until sufficient confidence has been acquired via a sequential data acquisition process. For fine-tuning the CNNs, the architecture has been systematically evaluated using a real-world dataset containing 340 labeled 2D scans, which have been made freely available in an online repository. Detection performance has been assessed on the basis of the average accuracy over k-fold cross-validation, and it scored 99.58 experiments have been performed in a scenario where the robot is approaching the pallet to fork. Although data have been originally acquired by considering only one pallet, artificial data have been generated as well to mimic the presence of multiple targets in the robot workspace. Our experimental results confirm that the system is capable of identifying, localising and tracking pallets with a high success rate while being robust to false positives.

READ FULL TEXT
research
05/22/2018

A 2D laser rangefinder scans dataset of standard EUR pallets

In the past few years, the technology of automated guided vehicles (AGVs...
research
12/17/2020

Efficient Golf Ball Detection and Tracking Based on Convolutional Neural Networks and Kalman Filter

This paper focuses on the problem of online golf ball detection and trac...
research
03/08/2016

DROW: Real-Time Deep Learning based Wheelchair Detection in 2D Range Data

We introduce the DROW detector, a deep learning based detector for 2D ra...
research
01/25/2010

Multi-camera Realtime 3D Tracking of Multiple Flying Animals

Automated tracking of animal movement allows analyses that would not oth...
research
07/28/2019

Real-time Tracking-by-Detection of Human Motion in RGB-D Camera Networks

This paper presents a novel real-time tracking system capable of improvi...
research
12/12/2022

An adaptive human-in-the-loop approach to emission detection of Additive Manufacturing processes and active learning with computer vision

Recent developments in in-situ monitoring and process control in Additiv...
research
03/15/2023

Transfer Learning Based Diagnosis and Analysis of Lung Sound Aberrations

With the development of computer -systems that can collect and analyze e...

Please sign up or login with your details

Forgot password? Click here to reset