Deceptive Alignment Monitoring

by   Andres Carranza, et al.

As the capabilities of large machine learning models continue to grow, and as the autonomy afforded to such models continues to expand, the spectre of a new adversary looms: the models themselves. The threat that a model might behave in a seemingly reasonable manner, while secretly and subtly modifying its behavior for ulterior reasons is often referred to as deceptive alignment in the AI Safety Alignment communities. Consequently, we call this new direction Deceptive Alignment Monitoring. In this work, we identify emerging directions in diverse machine learning subfields that we believe will become increasingly important and intertwined in the near future for deceptive alignment monitoring, and we argue that advances in these fields present both long-term challenges and new research opportunities. We conclude by advocating for greater involvement by the adversarial machine learning community in these emerging directions.


page 1

page 2

page 3

page 4


Unsolved Problems in ML Safety

Machine learning (ML) systems are rapidly increasing in size, are acquir...

Safety without alignment

Currently, the dominant paradigm in AI safety is alignment with human va...

A Marauder's Map of Security and Privacy in Machine Learning

There is growing recognition that machine learning (ML) exposes new secu...

Vision-and-Language Navigation: A Survey of Tasks, Methods, and Future Directions

A long-term goal of AI research is to build intelligent agents that can ...

Confidential Machine Learning on Untrusted Platforms: A Survey

With ever-growing data and the need for developing powerful machine lear...

Data-Driven Prediction Model of Components Shift during Reflow Process in Surface Mount Technology

In surface mount technology (SMT), mounted components on soldered pads a...

Intellectual Property Evaluation Utilizing Machine Learning

Intellectual properties is increasingly important in the economic develo...

Please sign up or login with your details

Forgot password? Click here to reset