Multiple-Instance Learning Approach via Bayesian Extreme Learning Machine
Multiple-instance learning (MIL) can solve supervised learning tasks, where only a bag of multiple instances is labeled, instead of a single instance. It is considerably important to develop effective and efficient MIL algorithms, because real-world datasets usually contain large instances. Known fo...
Main Authors: | , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
IEEE
2020-01-01
|
Series: | IEEE Access |
Subjects: | |
Online Access: | https://ieeexplore.ieee.org/document/9050729/ |
_version_ | 1819276445309992960 |
---|---|
author | Peipei Wang Xinqi Zheng Junhua Ku Chunning Wang |
author_facet | Peipei Wang Xinqi Zheng Junhua Ku Chunning Wang |
author_sort | Peipei Wang |
collection | DOAJ |
description | Multiple-instance learning (MIL) can solve supervised learning tasks, where only a bag of multiple instances is labeled, instead of a single instance. It is considerably important to develop effective and efficient MIL algorithms, because real-world datasets usually contain large instances. Known for its good generalization performance, MIL based on extreme learning machines (ELM-MIL) has proven to be more efficient than several typical MIL classification methods. ELM-MIL selects the most qualified instances from each bag through a single hidden layer feedforward network (SLFN) and trains modified ELM models to update the output weights. This learning approach often performs susceptible to the number of hidden nodes and can easily suffer from over-fitting problem. Using Bayesian inferences, this study introduces a Bayesian ELM (BELM)-based MIL algorithm (BELM-MIL) to address MIL classification problems. First, weight self-learning method based on a Bayesian network is applied to determine the weights of instance features. The most qualified instances are then selected from each bag to represent the bag. Second, BELM can improve the classification model via regularization of automatic estimations to reduce possible over-fitting during the calibration process. Experiments and comparisons are conducted with several competing algorithms on Musk datasets, images datasets, and inductive logic programming datasets. Superior classification accuracy and performance are demonstrated by BELM-MIL. |
first_indexed | 2024-12-23T23:40:20Z |
format | Article |
id | doaj.art-5b3fe4e2d7d049cba8f8f118fa57148b |
institution | Directory Open Access Journal |
issn | 2169-3536 |
language | English |
last_indexed | 2024-12-23T23:40:20Z |
publishDate | 2020-01-01 |
publisher | IEEE |
record_format | Article |
series | IEEE Access |
spelling | doaj.art-5b3fe4e2d7d049cba8f8f118fa57148b2022-12-21T17:25:42ZengIEEEIEEE Access2169-35362020-01-018624586247010.1109/ACCESS.2020.29842719050729Multiple-Instance Learning Approach via Bayesian Extreme Learning MachinePeipei Wang0https://orcid.org/0000-0003-0154-7457Xinqi Zheng1https://orcid.org/0000-0002-1236-2821Junhua Ku2Chunning Wang3School of Information Engineering, China University of Geosciences, Beijing, ChinaSchool of Information Engineering, China University of Geosciences, Beijing, ChinaSchool of Mathematics, Yibin University, Yibin, ChinaNational Geological Library of China, Beijing, ChinaMultiple-instance learning (MIL) can solve supervised learning tasks, where only a bag of multiple instances is labeled, instead of a single instance. It is considerably important to develop effective and efficient MIL algorithms, because real-world datasets usually contain large instances. Known for its good generalization performance, MIL based on extreme learning machines (ELM-MIL) has proven to be more efficient than several typical MIL classification methods. ELM-MIL selects the most qualified instances from each bag through a single hidden layer feedforward network (SLFN) and trains modified ELM models to update the output weights. This learning approach often performs susceptible to the number of hidden nodes and can easily suffer from over-fitting problem. Using Bayesian inferences, this study introduces a Bayesian ELM (BELM)-based MIL algorithm (BELM-MIL) to address MIL classification problems. First, weight self-learning method based on a Bayesian network is applied to determine the weights of instance features. The most qualified instances are then selected from each bag to represent the bag. Second, BELM can improve the classification model via regularization of automatic estimations to reduce possible over-fitting during the calibration process. Experiments and comparisons are conducted with several competing algorithms on Musk datasets, images datasets, and inductive logic programming datasets. Superior classification accuracy and performance are demonstrated by BELM-MIL.https://ieeexplore.ieee.org/document/9050729/Multiple-instance learningBayesian extreme learning machineinstance selectionclassification |
spellingShingle | Peipei Wang Xinqi Zheng Junhua Ku Chunning Wang Multiple-Instance Learning Approach via Bayesian Extreme Learning Machine IEEE Access Multiple-instance learning Bayesian extreme learning machine instance selection classification |
title | Multiple-Instance Learning Approach via Bayesian Extreme Learning Machine |
title_full | Multiple-Instance Learning Approach via Bayesian Extreme Learning Machine |
title_fullStr | Multiple-Instance Learning Approach via Bayesian Extreme Learning Machine |
title_full_unstemmed | Multiple-Instance Learning Approach via Bayesian Extreme Learning Machine |
title_short | Multiple-Instance Learning Approach via Bayesian Extreme Learning Machine |
title_sort | multiple instance learning approach via bayesian extreme learning machine |
topic | Multiple-instance learning Bayesian extreme learning machine instance selection classification |
url | https://ieeexplore.ieee.org/document/9050729/ |
work_keys_str_mv | AT peipeiwang multipleinstancelearningapproachviabayesianextremelearningmachine AT xinqizheng multipleinstancelearningapproachviabayesianextremelearningmachine AT junhuaku multipleinstancelearningapproachviabayesianextremelearningmachine AT chunningwang multipleinstancelearningapproachviabayesianextremelearningmachine |