Adversarial Training of Self-supervised Monocular Depth Estimation against Physical-World Attacks

01/31/2023
by   Zhiyuan Cheng, et al.
1

Monocular Depth Estimation (MDE) is a critical component in applications such as autonomous driving. There are various attacks against MDE networks. These attacks, especially the physical ones, pose a great threat to the security of such systems. Traditional adversarial training method requires ground-truth labels hence cannot be directly applied to self-supervised MDE that does not have ground-truth depth. Some self-supervised model hardening techniques (e.g., contrastive learning) ignore the domain knowledge of MDE and can hardly achieve optimal performance. In this work, we propose a novel adversarial training method for self-supervised MDE models based on view synthesis without using ground-truth depth. We improve adversarial robustness against physical-world attacks using L0-norm-bounded perturbation in training. We compare our method with supervised learning based and contrastive learning based methods that are tailored for MDE. Results on two representative MDE networks show that we achieve better robustness against various adversarial attacks with nearly no benign performance degradation.

READ FULL TEXT

page 2

page 15

page 16

page 17

page 18

page 22

page 23

page 24

research
10/05/2022

Image Masking for Robust Self-Supervised Monocular Depth Estimation

Self-supervised monocular depth estimation is a salient task for 3D scen...
research
02/07/2022

Transformers in Self-Supervised Monocular Depth Estimation with Unknown Camera Intrinsics

The advent of autonomous driving and advanced driver assistance systems ...
research
09/17/2019

Spherical View Synthesis for Self-Supervised 360 Depth Estimation

Learning based approaches for depth perception are limited by the availa...
research
11/16/2022

Self-supervised Egomotion and Depth Learning via Bi-directional Coarse-to-Fine Scale Recovery

Self-supervised learning of egomotion and depth has recently attracted g...
research
08/21/2023

LightDepth: Single-View Depth Self-Supervision from Illumination Decline

Single-view depth estimation can be remarkably effective if there is eno...
research
08/30/2021

Sample Efficient Detection and Classification of Adversarial Attacks via Self-Supervised Embeddings

Adversarial robustness of deep models is pivotal in ensuring safe deploy...
research
10/06/2022

Self-Supervised Monocular Depth Underwater

Depth estimation is critical for any robotic system. In the past years e...

Please sign up or login with your details

Forgot password? Click here to reset