Neural Networks

advertisement
05020208-05020090
Applications of Neural Networks
Introduction:
There are two basic kinds of neural networks that exist in society today:
1. Biological neural network.
Biological neural networks refer to the arrangement of the biological neurons
within the human/animal nervous system, which primarily consists of the brain
and the spinal cord. These neurons work in harmony to carry out specific
functions of the body, including learning, problem solving and task functioning.
2. Artificial neural network
Artificial neural networks try to mimic the biological neural networks, both in
functioning and architecture, so as to bring the same kind of learning capabilities
to the machine, as is available to the humans/animals. ANN (artificial neural
network) use a number of highly connected neurons which work on the same task
to come to a result. Mostly the ANNs, like people, learn by example and involve
the manipulation of the connections between neurons to adjust the result.
Applications:
The different types of networks in ANNs involve different architecture which are of use
in different applications. These are highlighted below:
1. ADALINE Network: The ADALINE network is primarily useful in pattern
recognition tasks. It is essentially a single layer back propagation network. For an
example consisting of classifying digits from 0-9, when trained on this pattern
recognition task, the aim is to classify a bitmap representation of the digits 0-9
into the corresponding classes. Adaline is limited in its capabilities for the
network only recognizes the exact training patterns. However better fault
tolerance can be achieved using multi layers in the back propagation network.
2. BPN Network: BPN stands for back propagation network. It is exceptionally
useful in time series forecasting, e.g. predicting the annual number of sunspots.
This kind of network implements the multi-layer back propagation network with
bias terms and momentum. It is used to detect structure in time-series, which is
presented to the network using a simple tapped delay-line memory. The program
learns to predict future activity from historical data. To avoid over training, the
learning procedure is terminated by the stop training method.
3. HOPFIELD Network: The Hopfield network is useful in Auto associative
memory tasks. The network is used as an auto associative memory and stores and
recalls a set of bitmap images. Images are stored by calculating the result from a
corresponding weight matrix. Thereafter, the memory will settle on exactly the
stored image which is nearest to the starting configuration by means of Hamming
distance. Thus the recall on an incomplete or corrupted image is also very much
appreciable.
05020208-05020090
4. BAM Network: BAM stands for Bi directional associative memory. Its role in
ANNs is found in the Hetero Associative memory tasks like associations of name
with their corresponding phone numbers. The BAM is a generalization of the
Hopfield model so that a hetero associative memory can be implemented. After
saving a set of examples, the memory returns the associative item on entering the
other associative item. The memory even shows a limited degree of faulttolerance in case of corrupted input patterns.
5. BOLTZMAN Network: The Boltzman model is basically used in optimization
tasks for e.g. the traveling salesman problem. It is basically a stochastic model of
the HOPFIELD model. The network dynamics incorporate a random component
in correspondence with a given finite temperature. It starts with a high
temperature and gradually cools down to a lower stable temperature which turns
out to be the global minimum. This process is called simulated annealing. The
network is then used to solve well-known optimization problems.
6. CPN Network: CPN stands for Counter propagation network. This kind of
network works well with vision applications. It is a competitive network and
functions as a self-programming lookup table with the additional ability to
interpolate between entries. The performance of the network is a little limited due
to the low resolution of the images presented.
7. SOM network: SOM stands for Self organizing maps. These kinds of networks
are mostly used in control applications e.g. a pole balancing problem. It is able to
form a topological mapping between its inputs and outputs and then uses the
modifications of the weights of the neurons to get to the best mapping between
the two.
8. ART1 Network: ART stands for Adaptive Resonance Theory. This kind of
networks work best for Brain modeling tasks. It is able to adapt to new patterns
while remaining stable at previously seen patterns.
In practice ANNs are used in the following places:
 Sales forecasting
 Industrial process control
 Customer research
 Data validation
 Risk management
 Target marketing
 Bio medical systems
 Modeling and diagnosing the cardiovascular system
 Electronic noses
 Credit evaluations
 Marketing
Download