Certifiable Robustness for Nearest Neighbor Classifiers

by   Austen Z. Fan, et al.

ML models are typically trained using large datasets of high quality. However, training datasets often contain inconsistent or incomplete data. To tackle this issue, one solution is to develop algorithms that can check whether a prediction of a model is certifiably robust. Given a learning algorithm that produces a classifier and given an example at test time, a classification outcome is certifiably robust if it is predicted by every model trained across all possible worlds (repairs) of the uncertain (inconsistent) dataset. This notion of robustness falls naturally under the framework of certain answers. In this paper, we study the complexity of certifying robustness for a simple but widely deployed classification algorithm, k-Nearest Neighbors (k-NN). Our main focus is on inconsistent datasets when the integrity constraints are functional dependencies (FDs). For this setting, we establish a dichotomy in the complexity of certifying robustness w.r.t. the set of FDs: the problem either admits a polynomial time algorithm, or it is coNP-hard. Additionally, we exhibit a similar dichotomy for the counting version of the problem, where the goal is to count the number of possible worlds that predict a certain label. As a byproduct of our study, we also establish the complexity of a problem related to finding an optimal subset repair that may be of independent interest.


page 1

page 3

page 7

page 9

page 15

page 17


Nearest Neighbor Classifiers over Incomplete Information: From Certain Answers to Certain Predictions

Machine learning (ML) applications have been thriving recently, largely ...

Certifiable Robustness for Naive Bayes Classifiers

Data cleaning is crucial but often laborious in most machine learning (M...

Computing Optimal Repairs for Functional Dependencies

We investigate the complexity of computing an optimal repair of an incon...

Q-learning with Nearest Neighbors

We consider the problem of model-free reinforcement learning for infinit...

Geometric Algorithms for k-NN Poisoning

We propose a label poisoning attack on geometric data sets against k-nea...

One-Class Model for Fabric Defect Detection

An automated and accurate fabric defect inspection system is in high dem...

Improve3C: Data Cleaning on Consistency and Completeness with Currency

Data quality plays a key role in big data management today. With the exp...

Please sign up or login with your details

Forgot password? Click here to reset