Learning Methods

The first chapter of part II of this book introduces various common learning algorithms. The aim of chapter 6 is to acquaint the readers with the present-day knowledge in learning paradigms. Filters may be employed in implementation of learning algorithms, and vice versa. As such, the first few sections introduce Adaptive Linear Neuron (ADALINE) and recursive Least-Square (RLS) algorithms. Artificial intelligent systems may possess functional characteristics of living biological brain. The multi-agent network and neuromorphic network introduced in subsequent sections are examples of ANN systems with functional characteristics of living biological brain. The ability of the brain to process data is unparalleled; the human research efforts have however been able to discover a close match in Bayesian networks such that more than half of this chapter is devoted to presenting various types of probability-density-based learning algorithms. This is followed, in conclusion, by a hybrid neuro-fuzzy neural network section. By reading this chapter, one may fully understand the common ANN systems, and thus easily implement an ANN if required.

Keywords: Adaptive Linear Neuron (ADALINE), Adaptive Network-based Fuzzy Inference System (ANFIS), Agent, Capacitance, Efficacy, Expectation- Maximization (E-M) algorithm, Generative Topographic Mapping (GTM), Hodgkin-Huxley model, K-means, Knowledge base, Learning parameter, Membrane potential, Mixture models, Nodes, Radial Basis Function (RBF), Recursive Least-Square (RLS) algorithm, Sigmoid function, Sugeno-type Fuzzy system, Synaptic current, Weight matrix.