Competitive Analysis of Online Kernel Selection in Unified Framework

Online kernel selection aims to find the optimal kernel for online kernel learning at each round. It is one of the fundamental and critical problems of online kernel learning. A problem of online kernel selection can be reduced to a problem of expert advice framework, where the set of experts corres...

Full description

Bibliographic Details
Main Author: LIAO Yun, ZHANG Xiao, LIAO Shizhong
Format: Article
Language:zho
Published: Journal of Computer Engineering and Applications Beijing Co., Ltd., Science Press 2020-07-01
Series:Jisuanji kexue yu tansuo
Subjects:
Online Access:http://fcst.ceaj.org/CN/abstract/abstract2261.shtml
_version_ 1818779029016150016
author LIAO Yun, ZHANG Xiao, LIAO Shizhong
author_facet LIAO Yun, ZHANG Xiao, LIAO Shizhong
author_sort LIAO Yun, ZHANG Xiao, LIAO Shizhong
collection DOAJ
description Online kernel selection aims to find the optimal kernel for online kernel learning at each round. It is one of the fundamental and critical problems of online kernel learning. A problem of online kernel selection can be reduced to a problem of expert advice framework, where the set of experts corresponds to the set of candidate kernels. Predictions are given according to the weights and advices of the set of experts, and the weights are updated at each round. Based on the reduction, while improving the regret bound, this paper proposes the concept of expected online kernel selection. Within the unified framework of expert advice framework and metric task system, this paper presents the regret bounds and competitive ratios of expected online kernel selection, and proves that the competitive ratio is stable in expanded loss ranges. Finally, this paper derives a competitive ratio combined with online kernel learning. The work of investigating online kernel selection within the unified framework guarantees not only a sublinear regret bound, but also a strong competitive ratio, comprehensively generalizing the concept of online kernel selection and paving the way for new online kernel selection research.
first_indexed 2024-12-18T11:54:07Z
format Article
id doaj.art-0e986202c6b942d98971ace0a1a8a6bd
institution Directory Open Access Journal
issn 1673-9418
language zho
last_indexed 2024-12-18T11:54:07Z
publishDate 2020-07-01
publisher Journal of Computer Engineering and Applications Beijing Co., Ltd., Science Press
record_format Article
series Jisuanji kexue yu tansuo
spelling doaj.art-0e986202c6b942d98971ace0a1a8a6bd2022-12-21T21:09:06ZzhoJournal of Computer Engineering and Applications Beijing Co., Ltd., Science PressJisuanji kexue yu tansuo1673-94182020-07-011471126113210.3778/j.issn.1673-9418.1905092Competitive Analysis of Online Kernel Selection in Unified FrameworkLIAO Yun, ZHANG Xiao, LIAO Shizhong0College of Intelligence and Computing, Tianjin University, Tianjin 300350, ChinaOnline kernel selection aims to find the optimal kernel for online kernel learning at each round. It is one of the fundamental and critical problems of online kernel learning. A problem of online kernel selection can be reduced to a problem of expert advice framework, where the set of experts corresponds to the set of candidate kernels. Predictions are given according to the weights and advices of the set of experts, and the weights are updated at each round. Based on the reduction, while improving the regret bound, this paper proposes the concept of expected online kernel selection. Within the unified framework of expert advice framework and metric task system, this paper presents the regret bounds and competitive ratios of expected online kernel selection, and proves that the competitive ratio is stable in expanded loss ranges. Finally, this paper derives a competitive ratio combined with online kernel learning. The work of investigating online kernel selection within the unified framework guarantees not only a sublinear regret bound, but also a strong competitive ratio, comprehensively generalizing the concept of online kernel selection and paving the way for new online kernel selection research.http://fcst.ceaj.org/CN/abstract/abstract2261.shtmlcompetitive analysisonline kernel selectionexpert advice frameworkmetrical task systemsunified framework
spellingShingle LIAO Yun, ZHANG Xiao, LIAO Shizhong
Competitive Analysis of Online Kernel Selection in Unified Framework
Jisuanji kexue yu tansuo
competitive analysis
online kernel selection
expert advice framework
metrical task systems
unified framework
title Competitive Analysis of Online Kernel Selection in Unified Framework
title_full Competitive Analysis of Online Kernel Selection in Unified Framework
title_fullStr Competitive Analysis of Online Kernel Selection in Unified Framework
title_full_unstemmed Competitive Analysis of Online Kernel Selection in Unified Framework
title_short Competitive Analysis of Online Kernel Selection in Unified Framework
title_sort competitive analysis of online kernel selection in unified framework
topic competitive analysis
online kernel selection
expert advice framework
metrical task systems
unified framework
url http://fcst.ceaj.org/CN/abstract/abstract2261.shtml
work_keys_str_mv AT liaoyunzhangxiaoliaoshizhong competitiveanalysisofonlinekernelselectioninunifiedframework