Self-Validation: Early Stopping for Single-Instance Deep Generative Priors

by   Taihui Li, et al.

Recent works have shown the surprising effectiveness of deep generative models in solving numerous image reconstruction (IR) tasks, even without training data. We call these models, such as deep image prior and deep decoder, collectively as single-instance deep generative priors (SIDGPs). The successes, however, often hinge on appropriate early stopping (ES), which by far has largely been handled in an ad-hoc manner. In this paper, we propose the first principled method for ES when applying SIDGPs to IR, taking advantage of the typical bell trend of the reconstruction quality. In particular, our method is based on collaborative training and self-validation: the primal reconstruction process is monitored by a deep autoencoder, which is trained online with the historic reconstructed images and used to validate the reconstruction quality constantly. Experimentally, on several IR problems and different SIDGPs, our self-validation method is able to reliably detect near-peak performance and signal good ES points. Our code is available at


page 2

page 8

page 17

page 21


Phase Retrieval using Single-Instance Deep Generative Prior

Several deep learning methods for phase retrieval exist, but most of the...

Early Stopping for Deep Image Prior

Deep image prior (DIP) and its variants have showed remarkable potential...

K-space and Image Domain Collaborative Energy based Model for Parallel MRI Reconstruction

Decreasing magnetic resonance (MR) image acquisition times can potential...

Bayesian Image Reconstruction using Deep Generative Models

Machine learning models are commonly trained end-to-end and in a supervi...

Downscaled Representation Matters: Improving Image Rescaling with Collaborative Downscaled Images

Deep networks have achieved great success in image rescaling (IR) task t...

Robust Compressed Sensing MRI with Deep Generative Priors

The CSGM framework (Bora-Jalal-Price-Dimakis'17) has shown that deep gen...

Learning to See by Looking at Noise

Current vision systems are trained on huge datasets, and these datasets ...

Please sign up or login with your details

Forgot password? Click here to reset