Reactive Motion Generation on Learned Riemannian Manifolds

by   Hadi Beik-Mohammadi, et al.

In recent decades, advancements in motion learning have enabled robots to acquire new skills and adapt to unseen conditions in both structured and unstructured environments. In practice, motion learning methods capture relevant patterns and adjust them to new conditions such as dynamic obstacle avoidance or variable targets. In this paper, we investigate the robot motion learning paradigm from a Riemannian manifold perspective. We argue that Riemannian manifolds may be learned via human demonstrations in which geodesics are natural motion skills. The geodesics are generated using a learned Riemannian metric produced by our novel variational autoencoder (VAE), which is especially intended to recover full-pose end-effector states and joint space configurations. In addition, we propose a technique for facilitating on-the-fly end-effector/multiple-limb obstacle avoidance by reshaping the learned manifold using an obstacle-aware ambient metric. The motion generated using these geodesics may naturally result in multiple-solution tasks that have not been explicitly demonstrated previously. We extensively tested our approach in task space and joint space scenarios using a 7-DoF robotic manipulator. We demonstrate that our method is capable of learning and generating motion skills based on complicated motion patterns demonstrated by a human operator. Additionally, we assess several obstacle avoidance strategies and generate trajectories in multiple-mode settings.


page 2

page 8

page 10

page 12

page 13

page 14

page 15

page 16


Learning Riemannian Manifolds for Geodesic Motion Skills

For robots to work alongside humans and perform in unstructured environm...

On the Design of Region-Avoiding Metrics for Collision-Safe Motion Generation on Riemannian Manifolds

The generation of energy-efficient and dynamic-aware robot motions that ...

Learning Vision-based Reactive Policies for Obstacle Avoidance

In this paper, we address the problem of vision-based obstacle avoidance...

Obstacle avoidance using raycasting and Riemannian Motion Policies at kHz rates for MAVs

In this paper, we present a novel method for using Riemannian Motion Pol...

Sampling-free obstacle gradients and reactive planning in Neural Radiance Fields (NeRF)

This work investigates the use of Neural implicit representations, speci...

Dynamically Avoiding Amorphous Obstacles with Topological Manifold Learning and Deep Autoencoding

To achieve conflict-free human-machine collaborations, robotic agents ne...

Geometric Fabrics for the Acceleration-based Design of Robotic Motion

This paper describes the pragmatic design and construction of geometric ...

Please sign up or login with your details

Forgot password? Click here to reset