Non-invasive Cognitive-level Human Interfacing for the Robotic Restoration of Reaching Grasping

by   Ali Shafti, et al.

Assistive and Wearable Robotics have the potential to support humans with different types of motor impairments to become independent and fulfil their activities of daily living successfully. The success of these robot systems, however, relies on the ability to meaningfully decode human action intentions and carry them out appropriately. Neural interfaces have been explored for use in such system with several successes, however, they tend to be invasive and require training periods in the order of months. We present a robotic system for human augmentation, capable of actuating the user's arm and fingers for them, effectively restoring the capability of reaching, grasping and manipulating objects; controlled solely through the user's eye movements. We combine wearable eye tracking, the visual context of the environment and the structural grammar of human actions to create a cognitive-level assistive robotic setup that enables the users in fulfilling activities of daily living, while conserving interpretability, and the agency of the user. The interface is worn, calibrated and ready to use within 5 minutes. Users learn to control and make successful use of the system with an additional 5 minutes of interaction. The system is tested with 5 healthy participants, showing an average success rate of 96.6% on first attempt across 6 tasks.


TELESIM: A Modular and Plug-and-Play Framework for Robotic Arm Teleoperation using a Digital Twin

We present TELESIM, a modular and plug-and-play framework for direct tel...

Gaze-based, Context-aware Robotic System for Assisted Reaching and Grasping

Assistive robotic systems endeavour to support those with movement disab...

The Supernumerary Robotic 3rd Thumb for Skilled Music Tasks

Wearable robotics bring the opportunity to augment human capability and ...

Assistive arm and hand manipulation: How does current research intersect with actual healthcare needs?

Human assistive robotics have the potential to help the elderly and indi...

What You See is What You Grasp: User-Friendly Grasping Guided by Near-eye-tracking

This work presents a next-generation human-robot interface that can infe...

A Scooter-Mounted Robot Arm to Assist with Activities of Daily Life

Many people with motor disabilities struggle with activities of daily li...

Free-View, 3D Gaze-Guided, Assistive Robotic System for Activities of Daily Living

Patients suffering from quadriplegia have limited body motion which prev...

Please sign up or login with your details

Forgot password? Click here to reset