Approximation capability of two hidden layer feedforward neural networks with fixed weights

01/22/2020
by   Namig J. Guliyev, et al.
0

We algorithmically construct a two hidden layer feedforward neural network (TLFN) model with the weights fixed as the unit coordinate vectors of the d-dimensional Euclidean space and having 3d+2 number of hidden neurons in total, which can approximate any continuous d-variable function with an arbitrary precision. This result, in particular, shows an advantage of the TLFN model over the single hidden layer feedforward neural network (SLFN) model, since SLFNs with fixed weights do not have the capability of approximating multivariate functions.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/21/2017

On the approximation by single hidden layer feedforward neural networks with fixed weights

Feedforward neural networks have wide applicability in various disciplin...
research
02/07/2022

Approximation error of single hidden layer neural networks with fixed weights

This paper provides an explicit formula for the approximation error of s...
research
12/31/2015

A single hidden layer feedforward network with only one neuron in the hidden layer can approximate any univariate function

The possibility of approximating a continuous function on a compact subs...
research
02/10/2019

An Algorithm for Approximating Continuous Functions on Compact Subsets with a Neural Network with one Hidden Layer

George Cybenko's landmark 1989 paper showed that there exists a feedforw...
research
10/28/2019

On approximating ∇ f with neural networks

Consider a feedforward neural network ψ: R^d→R^d such that ψ≈∇ f, where ...
research
03/14/2023

Sequential three-way decisions with a single hidden layer feedforward neural network

The three-way decisions strategy has been employed to construct network ...
research
08/25/2022

A Feedforward Unitary Equivariant Neural Network

We devise a new type of feedforward neural network. It is equivariant wi...

Please sign up or login with your details

Forgot password? Click here to reset