BAMF-SLAM: Bundle Adjusted Multi-Fisheye Visual-Inertial SLAM Using Recurrent Field Transforms

by   Wei Zhang, et al.

In this paper, we present BAMF-SLAM, a novel multi-fisheye visual-inertial SLAM system that utilizes Bundle Adjustment (BA) and recurrent field transforms (RFT) to achieve accurate and robust state estimation in challenging scenarios. First, our system directly operates on raw fisheye images, enabling us to fully exploit the wide Field-of-View (FoV) of fisheye cameras. Second, to overcome the low-texture challenge, we explore the tightly-coupled integration of multi-camera inputs and complementary inertial measurements via a unified factor graph and jointly optimize the poses and dense depth maps. Third, for global consistency, the wide FoV of the fisheye camera allows the system to find more potential loop closures, and powered by the broad convergence basin of RFT, our system can perform very wide baseline loop closing with little overlap. Furthermore, we introduce a semi-pose-graph BA method to avoid the expensive full global BA. By combining relative pose factors with loop closure factors, the global states can be adjusted efficiently with modest memory footprint while maintaining high accuracy. Evaluations on TUM-VI, Hilti-Oxford and Newer College datasets show the superior performance of the proposed system over prior works. In the Hilti SLAM Challenge 2022, our VIO version achieves second place. In a subsequent submission, our complete system, including the global BA backend, outperforms the winning approach.


page 1

page 4


MAVIS: Multi-Camera Augmented Visual-Inertial SLAM using SE2(3) Based Exact IMU Pre-integration

We present a novel optimization-based Visual-Inertial SLAM system design...

Dense RGB-D-Inertial SLAM with Map Deformations

While dense visual SLAM methods are capable of estimating dense reconstr...

VIRAL SLAM: Tightly Coupled Camera-IMU-UWB-Lidar SLAM

In this paper, we propose a tightly-coupled, multi-modal simultaneous lo...

GNSS-stereo-inertial SLAM for arable farming

The accelerating pace in the automation of agricultural tasks demands hi...

Visual-Inertial SLAM with Tightly-Coupled Dropout-Tolerant GPS Fusion

Robotic applications are continuously striving towards higher levels of ...

Optimization-Based Visual-Inertial SLAM Tightly Coupled with Raw GNSS Measurements

Fusing vision, Inertial Measurement Unit (IMU) and Global Navigation Sat...

Stereo Visual Inertial Pose Estimation Based on Feedforward-Feedback Loops

In this paper, we present a novel stereo visual inertial pose estimation...

Please sign up or login with your details

Forgot password? Click here to reset