Fingerprinting Robot Movements via Acoustic Side Channel

09/21/2022
by   Ryan Shah, et al.
0

In this paper, we present an acoustic side channel attack which makes use of smartphone microphones recording a robot in operation to exploit acoustic properties of the sound to fingerprint a robot's movements. In this work we consider the possibility of an insider adversary who is within physical proximity of a robotic system (such as a technician or robot operator), equipped with only their smartphone microphone. Through the acoustic side-channel, we demonstrate that it is indeed possible to fingerprint not only individual robot movements within 3D space, but also patterns of movements which could lead to inferring the purpose of the movements (i.e. surgical procedures which a surgical robot is undertaking) and hence, resulting in potential privacy violations. Upon evaluation, we find that individual robot movements can be fingerprinted with around 75 with more fine-grained movement meta-data such as distance and speed. Furthermore, workflows could be reconstructed with around 62 whole, with more complex movements such as pick-and-place or packing reconstructed with near perfect accuracy. As well as this, in some environments such as surgical settings, audio may be recorded and transmitted over VoIP, such as for education/teaching purposes or in remote telemedicine. The question here is, can the same attack be successful even when VoIP communication is employed, and how does packet loss impact the captured audio and the success of the attack? Using the same characteristics of acoustic sound for plain audio captured by the smartphone, the attack was 90 samples on average, 15 employed. This opens up new research questions regarding anonymous communications to protect robotic systems from acoustic side channel attacks via VoIP communication networks.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/21/2022

Reconstructing Robot Operations via Radio-Frequency Side-Channel

Connected teleoperated robotic systems play a key role in ensuring opera...
research
09/07/2018

Synesthesia: Detecting Screen Content via Remote Acoustic Side Channels

We show that subtle acoustic noises emanating from within computer scree...
research
03/26/2019

Hearing your touch: A new acoustic side channel on smartphones

We present the first acoustic side-channel attack that recovers what use...
research
08/02/2023

A Practical Deep Learning-Based Acoustic Side Channel Attack on Keyboards

With recent developments in deep learning, the ubiquity of micro-phones ...
research
12/30/2017

Multichannel Robot Speech Recognition Database: MChRSR

In real human robot interaction (HRI) scenarios, speech recognition repr...
research
10/16/2017

What Can Spatiotemporal Characteristics of Movements in RAMIS Tell Us?

Quantitative characterization of surgical movements can improve the qual...
research
05/17/2022

Can You Still See Me?: Reconstructing Robot Operations Over End-to-End Encrypted Channels

Connected robots play a key role in Industry 4.0, providing automation a...

Please sign up or login with your details

Forgot password? Click here to reset