# A Weighted Randomized Kaczmarz Method for Solving Linear Systems

The Kaczmarz method for solving a linear system Ax = b interprets such a system as a collection of equations ⟨ a_i, x⟩ = b_i, where a_i is the i-th row of A, then picks such an equation and corrects x_k+1 = x_k + λ a_i where λ is chosen so that the i-th equation is satisfied. Convergence rates are difficult to establish. Assuming the rows to be normalized, a_i_ℓ^2=1, Strohmer & Vershynin established that if the order of equations is chosen at random, 𝔼 x_k - x_ℓ^2 converges exponentially. We prove that if the i-th row is selected with likelihood proportional to |⟨ a_i, x_k ⟩ - b_i|^p, where 0<p<∞, then 𝔼 x_k - x_ℓ^2 converges faster than the purely random method. As p →∞, the method de-randomizes and explains, among other things, why the maximal correction method works well. We empirically observe that the method computes approximations of small singular vectors of A as a byproduct.

research
05/03/2022

### Restarted randomized surrounding methods for solving large linear equations

A class of restarted randomized surrounding methods are presented to acc...
research
06/12/2023

### A Weighted Randomized Sparse Kaczmarz Method for Solving Linear Systems

The randomized sparse Kaczmarz method, designed for seeking the sparse s...
research
04/11/2019

### A Kaczmarz Algorithm for Solving Tree Based Distributed Systems of Equations

The Kaczmarz algorithm is an iterative method for solving systems of lin...
research
10/07/2022

### On the extended randomized multiple row method for solving linear least-squares problems

The randomized row method is a popular representative of the iterative a...
research
10/16/2021

### Greedy and Random Broyden's Methods with Explicit Superlinear Convergence Rates in Nonlinear Equations

In this paper, we propose the greedy and random Broyden's method for sol...
research
07/12/2021

### Quantile-Based Random Kaczmarz for corrupted linear systems of equations

We consider linear systems Ax = b where A ∈ℝ^m × n consists of normalize...
research
10/26/2017

### A Fast Algorithm for Solving Henderson's Mixed Model Equation

This article investigates a fast and stable method to solve Henderson's ...