Human-Robot Interaction via a Joint-Initiative Supervised Autonomy (JISA) Framework

by   Abbas Sidaoui, et al.

In this paper, we propose and validate a Joint-Initiative Supervised Autonomy (JISA) framework for Human-Robot Interaction (HRI), in which a robot maintains a measure of its self-confidence (SC) while performing a task, and only prompts the human supervisor for help when its SC drops. At the same time, during task execution, a human supervisor can intervene in the task being performed, based on his/her Situation Awareness (SA). To evaluate the applicability and utility of JISA, it is implemented on two different HRI tasks: grid-based collaborative simultaneous localization and mapping (SLAM) and automated jigsaw puzzle reconstruction. Augmented Reality (AR) (for SLAM) and two-dimensional graphical user interfaces (GUI) (for puzzle reconstruction) are custom-designed to enhance human SA and allow intuitive interaction between the human and the agent. The superiority of the JISA framework is demonstrated in experiments. In SLAM, the superior maps produced by JISA preclude the need for post processing of any SLAM stock maps; furthermore, JISA reduces the required mapping time by approximately 50 percent versus traditional approaches. In automated puzzle reconstruction, the JISA framework outperforms both fully autonomous solutions, as well as those resulting from on-demand human intervention prompted by the agent.


page 1

page 2

page 6

page 8

page 9

page 11

page 12

page 14


Human-Robot Interaction in a Shared Augmented Reality Workspace

We design and develop a new shared Augmented Reality (AR) workspace for ...

Enhancing Human-robot Collaboration by Exploring Intuitive Augmented Reality Design Representations

As the use of Augmented Reality (AR) to enhance interactions between hum...

Enabling Intuitive Human-Robot Teaming Using Augmented Reality and Gesture Control

Human-robot teaming offers great potential because of the opportunities ...

Concepts for End-to-end Augmented Reality based Human-Robot Interaction Systems

The field of Augmented Reality (AR) based Human Robot Interaction (HRI) ...

Collaborative Dense SLAM

In this paper, we present a new system for live collaborative dense surf...

Collaborative Augmented Reality on Smartphones via Life-long City-scale Maps

In this paper we present the first published end-to-end production compu...

A Computer Vision System for Attention Mapping in SLAM based 3D Models

The study of human factors in the frame of interaction studies has been ...

Please sign up or login with your details

Forgot password? Click here to reset