Neural Network Verification through Replication

by   Mauro J. Sanchirico III, et al.

A system identification based approach to neural network model replication is presented and the application of model replication to verification of fundamental, single hidden layer, neural network systems is demonstrated. The presented approach serves as a means to partially address the problem of verifying that a neural network implementation meets a provided specification given only grey-box access to the implemented network. The procedure developed involves stimulating a neural network with a chosen signal, extracting a replicated model from the response, and systematically checking that the replicated model is output-equivalent to a specified model in order to verify that the grey-box system under test is implemented to specification without direct access to its hidden parameters. The replication step is introduced to provide an inherent guarantee that the stimulus signals employed yield sufficient test coverage. This method is investigated as a neural network focused nonlinear counterpart to the traditional verification of circuits through system identification. A strategy for choosing the stimulus is provided and an algorithm for verifying that the resulting response is indicative of a specification-compliant neural network system under test is derived. We find that the method can reliably detect defects in small neural networks or in small sub-circuits within larger neural networks.


page 7

page 8

page 9


Specification-Driven Neural Network Reduction for Scalable Formal Verification

Formal verification of neural networks is essential before their deploym...

VPN: Verification of Poisoning in Neural Networks

Neural networks are successfully used in a variety of applications, many...

An SMT-Based Approach for Verifying Binarized Neural Networks

Deep learning has emerged as an effective approach for creating modern s...

Towards Safety Verification of Direct Perception Neural Networks

We study the problem of safety verification of direct perception neural ...

SOCRATES: Towards a Unified Platform for Neural Network Verification

Studies show that neural networks, not unlike traditional programs, are ...

Verifying Aircraft Collision Avoidance Neural Networks Through Linear Approximations of Safe Regions

The next generation of aircraft collision avoidance systems frame the pr...

Please sign up or login with your details

Forgot password? Click here to reset