A projection based learning in Meta-cognitive Radial Basis Function Network for classification problems

In this paper, we propose a `Meta-cognitive Radial Basis Function Network (McRBFN)' and its `Projection Based Learning (PBL)' algorithm for classification problems. McRBFN emulates human-like meta-cognitive learning principles. As each sample is presented to the network, McRBFN uses the es...

Full description

Bibliographic Details
Main Authors: Sateesh Babu, Giduthuri, Suresh, Sundaram, Savitha, R.
Other Authors: School of Computer Engineering
Format: Conference Paper
Language:English
Published: 2013
Subjects:
Online Access:https://hdl.handle.net/10356/98312
http://hdl.handle.net/10220/12386
_version_ 1811686582817652736
author Sateesh Babu, Giduthuri
Suresh, Sundaram
Savitha, R.
author2 School of Computer Engineering
author_facet School of Computer Engineering
Sateesh Babu, Giduthuri
Suresh, Sundaram
Savitha, R.
author_sort Sateesh Babu, Giduthuri
collection NTU
description In this paper, we propose a `Meta-cognitive Radial Basis Function Network (McRBFN)' and its `Projection Based Learning (PBL)' algorithm for classification problems. McRBFN emulates human-like meta-cognitive learning principles. As each sample is presented to the network, McRBFN uses the estimated class label, the maximum hinge error and class-wise significance to address the self-regulating principles of what-to-learn, when-to-learn and how-to-learn in a meta-cognitive framework. McRBFN addresses the what-to-learn by choosing samples to participate in the learning process, also deleting samples with information similar to that already learnt by the network. A few samples that satisfy neither of these criteria are pushed to the rear end of the training data stack to be used in future, thereby satisfying the when-to-learn. The how-to-learn component of meta-cognition is addressed by using the participating samples to either add a neuron or update the output weights. Initially, McRBFN begins with zero hidden neurons and adds required number of neurons to approximate the decision surface. When a neuron is added, its parameters are initialized based on the sample overlapping conditions. The output weights are updated using a PBL algorithm such that the network finds the minimum point of an energy function defined by the hinge-loss error. The use of human meta-cognitive principles ensures efficient learning. Moreover, as samples with similar information are deleted, overtraining is avoided. The PBL algorithm helps to reduce the computational effort used in training. The performance of the PBL-McRBFN classifier is evaluated using a set of benchmark classification problems from the UCI machine learning repository. The performance evaluation study on these problems clearly indicates the superior performance of PBL-McRBFN classifier over results reported in the literature.
first_indexed 2024-10-01T05:02:43Z
format Conference Paper
id ntu-10356/98312
institution Nanyang Technological University
language English
last_indexed 2024-10-01T05:02:43Z
publishDate 2013
record_format dspace
spelling ntu-10356/983122020-05-28T07:18:33Z A projection based learning in Meta-cognitive Radial Basis Function Network for classification problems Sateesh Babu, Giduthuri Suresh, Sundaram Savitha, R. School of Computer Engineering International Joint Conference on Neural Networks (2012 : Brisbane, Australia) DRNTU::Engineering::Computer science and engineering In this paper, we propose a `Meta-cognitive Radial Basis Function Network (McRBFN)' and its `Projection Based Learning (PBL)' algorithm for classification problems. McRBFN emulates human-like meta-cognitive learning principles. As each sample is presented to the network, McRBFN uses the estimated class label, the maximum hinge error and class-wise significance to address the self-regulating principles of what-to-learn, when-to-learn and how-to-learn in a meta-cognitive framework. McRBFN addresses the what-to-learn by choosing samples to participate in the learning process, also deleting samples with information similar to that already learnt by the network. A few samples that satisfy neither of these criteria are pushed to the rear end of the training data stack to be used in future, thereby satisfying the when-to-learn. The how-to-learn component of meta-cognition is addressed by using the participating samples to either add a neuron or update the output weights. Initially, McRBFN begins with zero hidden neurons and adds required number of neurons to approximate the decision surface. When a neuron is added, its parameters are initialized based on the sample overlapping conditions. The output weights are updated using a PBL algorithm such that the network finds the minimum point of an energy function defined by the hinge-loss error. The use of human meta-cognitive principles ensures efficient learning. Moreover, as samples with similar information are deleted, overtraining is avoided. The PBL algorithm helps to reduce the computational effort used in training. The performance of the PBL-McRBFN classifier is evaluated using a set of benchmark classification problems from the UCI machine learning repository. The performance evaluation study on these problems clearly indicates the superior performance of PBL-McRBFN classifier over results reported in the literature. 2013-07-26T06:22:37Z 2019-12-06T19:53:26Z 2013-07-26T06:22:37Z 2019-12-06T19:53:26Z 2012 2012 Conference Paper Sateesh Babu, G., Savitha, R., & Suresh, S. (2012). A projection based learning in Meta-cognitive Radial Basis Function Network for classification problems. The 2012 International Joint Conference on Neural Networks (IJCNN). https://hdl.handle.net/10356/98312 http://hdl.handle.net/10220/12386 10.1109/IJCNN.2012.6252769 en © 2012 IEEE.
spellingShingle DRNTU::Engineering::Computer science and engineering
Sateesh Babu, Giduthuri
Suresh, Sundaram
Savitha, R.
A projection based learning in Meta-cognitive Radial Basis Function Network for classification problems
title A projection based learning in Meta-cognitive Radial Basis Function Network for classification problems
title_full A projection based learning in Meta-cognitive Radial Basis Function Network for classification problems
title_fullStr A projection based learning in Meta-cognitive Radial Basis Function Network for classification problems
title_full_unstemmed A projection based learning in Meta-cognitive Radial Basis Function Network for classification problems
title_short A projection based learning in Meta-cognitive Radial Basis Function Network for classification problems
title_sort projection based learning in meta cognitive radial basis function network for classification problems
topic DRNTU::Engineering::Computer science and engineering
url https://hdl.handle.net/10356/98312
http://hdl.handle.net/10220/12386
work_keys_str_mv AT sateeshbabugiduthuri aprojectionbasedlearninginmetacognitiveradialbasisfunctionnetworkforclassificationproblems
AT sureshsundaram aprojectionbasedlearninginmetacognitiveradialbasisfunctionnetworkforclassificationproblems
AT savithar aprojectionbasedlearninginmetacognitiveradialbasisfunctionnetworkforclassificationproblems
AT sateeshbabugiduthuri projectionbasedlearninginmetacognitiveradialbasisfunctionnetworkforclassificationproblems
AT sureshsundaram projectionbasedlearninginmetacognitiveradialbasisfunctionnetworkforclassificationproblems
AT savithar projectionbasedlearninginmetacognitiveradialbasisfunctionnetworkforclassificationproblems