On Interference of Signals and Generalization in Feedforward Neural Networks

10/06/2003
by   Artur Rataj, et al.
0

This paper studies how the generalization ability of neurons can be affected by mutual processing of different signals. This study is done on the basis of a feedforward artificial neural network. The mutual processing of signals can possibly be a good model of patterns in a set generalized by a neural network and in effect may improve generalization. In this paper it is discussed that the interference may also cause a highly random generalization. Adaptive activation functions are discussed as a way of reducing that type of generalization. A test of a feedforward neural network is performed that shows the discussed random generalization.

READ FULL TEXT
research
05/10/2005

Distant generalization by feedforward neural networks

This paper discusses the notion of generalization of training samples ov...
research
06/29/2018

Bounds on the Approximation Power of Feedforward Neural Networks

The approximation power of general feedforward neural networks with piec...
research
08/15/2019

Improving Randomized Learning of Feedforward Neural Networks by Appropriate Generation of Random Parameters

In this work, a method of random parameters generation for randomized le...
research
11/03/2020

Geometry Perspective Of Estimating Learning Capability Of Neural Networks

The paper uses statistical and differential geometric motivation to acqu...
research
02/17/2023

Highly connected dynamic artificial neural networks

An object-oriented approach to implementing artificial neural networks i...
research
11/26/2022

Why Neural Networks Work

We argue that many properties of fully-connected feedforward neural netw...
research
03/13/2020

Interference and Generalization in Temporal Difference Learning

We study the link between generalization and interference in temporal-di...

Please sign up or login with your details

Forgot password? Click here to reset