An Incremental Algorithm for Parallel Training of the Size and the Weights in a Feedforward Neural Network.

An Incremental Algorithm for Parallel Training of the Size and the Weights in a Feedforward Neural Network.

Abstract

An algorithm of incremental approximation of functions in a normed linearspace by feedforward neural networks is presented. The concept of variationof a function with respect to a set is used to estimate the approximationerror together with the weight decay method, for optimizing the size andweights of a network in each iteration step of the algorithm. Two alternatives, recursively incremental and generally incremental, are proposed. In the generally incremental case, the algorithm optimizes parameters of all units in the hidden layer at each step. In the recursively incremental case, the algorithm optimizes the parameterscorresponding to only one unit in the hidden layer at each step. In thiscase, an optimization problem with a smaller number of parameters is beingsolved at each step.

Grafik Top
Authors
  • Schindlerova, Katerina
  • Fischer, Manfred M.
Grafik Top
Shortfacts
Category
Journal Paper
Divisions
Data Mining
Subjects
Kuenstliche Intelligenz
Journal or Publication Title
Neural Processing Letters
ISSN
1370-4621
Publisher
Kluwer
Place of Publication
Netherlands
Page Range
pp. 131-138
Volume
11
Date
2000
Export
Grafik Top