Learning multiple regularization parameters for generalized Tikhonov regularization using multiple data sets without true data

12/23/2021
by   Michael J. Byrne, et al.
0

During the inversion of discrete linear systems, noise in data can be amplified and result in meaningless solutions. To combat this effect, characteristics of solutions that are considered desirable are mathematically implemented during inversion, which is a process called regularization. The influence of provided prior information is controlled by non-negative regularization parameter(s). There are a number of methods used to select appropriate regularization parameters, as well as a number of methods used for inversion. In this paper, we consider the unbiased risk estimator, generalized cross validation, and the discrepancy principle as the means of selecting regularization parameters. When multiple data sets describing the same physical phenomena are available, the use of multiple regularization parameters can enhance results. Here we demonstrate that it is possible to learn multiple parameter regularization parameters using regularization parameter estimators that are modified to handle multiple parameters and multiple data. The results demonstrate that these modified methods, which do not require the use of true data for learning regularization parameters, are effective and efficient, and perform comparably to methods based on true data for learning the relevant parameters.

READ FULL TEXT

page 28

page 29

page 33

page 37

research
10/06/2021

Efficient learning methods for large-scale optimal inversion design

In this work, we investigate various approaches that use learning from t...
research
07/15/2019

An efficient estimator of the parameters of the Generalized Lambda Distribution

Estimation of the four generalized lambda distribution parameters is not...
research
09/17/2021

Unbiased Bregman-Risk Estimators: Application to Regularization Parameter Selection in Tomographic Image Reconstruction

Unbiased estimators are introduced for averaged Bregman divergences whic...
research
06/12/2020

Analysis, Design, and Generalization of Electrochemical Impedance Spectroscopy (EIS) Inversion Algorithms

We introduce a framework for analyzing and designing EIS inversion algor...
research
12/30/2019

A Parameter Choice Rule for Tikhonov Regularization Based on Predictive Risk

In this work, we propose a new criterion for choosing the regularization...
research
03/13/2013

Estimation Stability with Cross Validation (ESCV)

Cross-validation (CV) is often used to select the regularization paramet...
research
08/25/2015

OCReP: An Optimally Conditioned Regularization for Pseudoinversion Based Neural Training

In this paper we consider the training of single hidden layer neural net...

Please sign up or login with your details

Forgot password? Click here to reset