Multiple-Instance Learning Approach via Bayesian Extreme Learning Machine

Multiple-instance learning (MIL) can solve supervised learning tasks, where only a bag of multiple instances is labeled, instead of a single instance. It is considerably important to develop effective and efficient MIL algorithms, because real-world datasets usually contain large instances. Known fo...

Full description

Bibliographic Details
Main Authors: Peipei Wang, Xinqi Zheng, Junhua Ku, Chunning Wang
Format: Article
Language:English
Published: IEEE 2020-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/9050729/
_version_ 1819276445309992960
author Peipei Wang
Xinqi Zheng
Junhua Ku
Chunning Wang
author_facet Peipei Wang
Xinqi Zheng
Junhua Ku
Chunning Wang
author_sort Peipei Wang
collection DOAJ
description Multiple-instance learning (MIL) can solve supervised learning tasks, where only a bag of multiple instances is labeled, instead of a single instance. It is considerably important to develop effective and efficient MIL algorithms, because real-world datasets usually contain large instances. Known for its good generalization performance, MIL based on extreme learning machines (ELM-MIL) has proven to be more efficient than several typical MIL classification methods. ELM-MIL selects the most qualified instances from each bag through a single hidden layer feedforward network (SLFN) and trains modified ELM models to update the output weights. This learning approach often performs susceptible to the number of hidden nodes and can easily suffer from over-fitting problem. Using Bayesian inferences, this study introduces a Bayesian ELM (BELM)-based MIL algorithm (BELM-MIL) to address MIL classification problems. First, weight self-learning method based on a Bayesian network is applied to determine the weights of instance features. The most qualified instances are then selected from each bag to represent the bag. Second, BELM can improve the classification model via regularization of automatic estimations to reduce possible over-fitting during the calibration process. Experiments and comparisons are conducted with several competing algorithms on Musk datasets, images datasets, and inductive logic programming datasets. Superior classification accuracy and performance are demonstrated by BELM-MIL.
first_indexed 2024-12-23T23:40:20Z
format Article
id doaj.art-5b3fe4e2d7d049cba8f8f118fa57148b
institution Directory Open Access Journal
issn 2169-3536
language English
last_indexed 2024-12-23T23:40:20Z
publishDate 2020-01-01
publisher IEEE
record_format Article
series IEEE Access
spelling doaj.art-5b3fe4e2d7d049cba8f8f118fa57148b2022-12-21T17:25:42ZengIEEEIEEE Access2169-35362020-01-018624586247010.1109/ACCESS.2020.29842719050729Multiple-Instance Learning Approach via Bayesian Extreme Learning MachinePeipei Wang0https://orcid.org/0000-0003-0154-7457Xinqi Zheng1https://orcid.org/0000-0002-1236-2821Junhua Ku2Chunning Wang3School of Information Engineering, China University of Geosciences, Beijing, ChinaSchool of Information Engineering, China University of Geosciences, Beijing, ChinaSchool of Mathematics, Yibin University, Yibin, ChinaNational Geological Library of China, Beijing, ChinaMultiple-instance learning (MIL) can solve supervised learning tasks, where only a bag of multiple instances is labeled, instead of a single instance. It is considerably important to develop effective and efficient MIL algorithms, because real-world datasets usually contain large instances. Known for its good generalization performance, MIL based on extreme learning machines (ELM-MIL) has proven to be more efficient than several typical MIL classification methods. ELM-MIL selects the most qualified instances from each bag through a single hidden layer feedforward network (SLFN) and trains modified ELM models to update the output weights. This learning approach often performs susceptible to the number of hidden nodes and can easily suffer from over-fitting problem. Using Bayesian inferences, this study introduces a Bayesian ELM (BELM)-based MIL algorithm (BELM-MIL) to address MIL classification problems. First, weight self-learning method based on a Bayesian network is applied to determine the weights of instance features. The most qualified instances are then selected from each bag to represent the bag. Second, BELM can improve the classification model via regularization of automatic estimations to reduce possible over-fitting during the calibration process. Experiments and comparisons are conducted with several competing algorithms on Musk datasets, images datasets, and inductive logic programming datasets. Superior classification accuracy and performance are demonstrated by BELM-MIL.https://ieeexplore.ieee.org/document/9050729/Multiple-instance learningBayesian extreme learning machineinstance selectionclassification
spellingShingle Peipei Wang
Xinqi Zheng
Junhua Ku
Chunning Wang
Multiple-Instance Learning Approach via Bayesian Extreme Learning Machine
IEEE Access
Multiple-instance learning
Bayesian extreme learning machine
instance selection
classification
title Multiple-Instance Learning Approach via Bayesian Extreme Learning Machine
title_full Multiple-Instance Learning Approach via Bayesian Extreme Learning Machine
title_fullStr Multiple-Instance Learning Approach via Bayesian Extreme Learning Machine
title_full_unstemmed Multiple-Instance Learning Approach via Bayesian Extreme Learning Machine
title_short Multiple-Instance Learning Approach via Bayesian Extreme Learning Machine
title_sort multiple instance learning approach via bayesian extreme learning machine
topic Multiple-instance learning
Bayesian extreme learning machine
instance selection
classification
url https://ieeexplore.ieee.org/document/9050729/
work_keys_str_mv AT peipeiwang multipleinstancelearningapproachviabayesianextremelearningmachine
AT xinqizheng multipleinstancelearningapproachviabayesianextremelearningmachine
AT junhuaku multipleinstancelearningapproachviabayesianextremelearningmachine
AT chunningwang multipleinstancelearningapproachviabayesianextremelearningmachine