University of Surrey

Test tubes in the lab Research in the ATI Dance Research

Information theory and neural network learning algorithms

Plumbley, MD (1993) Information theory and neural network learning algorithms In: Neural Computing Research and Applications, Proceedings of the Second Irish Neural Networks Conference, Queen's University, Belfast, Northern Ireland, 25-26 June 1992, ? - ?.

Full text not available from this repository.

Abstract

There have been a number of recent papers on information theory and neural networks, especially in a perceptual system such as vision.� Some of these approaches are examined, and their implications for neural network learning algorithms are considered.� Existing supervised learning algorithms such as Back Propagation to minimize mean squared error can be viewed as attempting to minimize an upper bound on information loss.� By making an assumption of noise either at the input or the output to the system, unsupervised learning algorithms such as those based on Hebbian (principal component analysing) or anti-Hebbian (decorrelating) approaches can also be viewed in a similar light.� The optimization of information by the use of interneurons to decorrelate output units suggests a role for inhibitory interneurons and cortical loops in biological sensory systems.

Item Type: Conference or Workshop Item (UNSPECIFIED)
Authors :
NameEmailORCID
Plumbley, MDm.plumbley@surrey.ac.ukUNSPECIFIED
Date : 1993
Contributors :
ContributionNameEmailORCID
UNSPECIFIEDOrchard, GUNSPECIFIEDUNSPECIFIED
publisherInstitute of Physics Publishing, UNSPECIFIEDUNSPECIFIED
Depositing User : Symplectic Elements
Date Deposited : 17 May 2017 13:36
Last Modified : 17 May 2017 15:11
URI: http://epubs.surrey.ac.uk/id/eprint/839799

Actions (login required)

View Item View Item

Downloads

Downloads per month over past year


Information about this web site

© The University of Surrey, Guildford, Surrey, GU2 7XH, United Kingdom.
+44 (0)1483 300800