Online Decentralized Multi-Agents Meta-Learning With Byzantine Resiliency
Meta-learning is a learning-to-learn paradigm that leverages past learning experiences for quick adaptation to new learning tasks. It has a wide application, such as in few-shot learning, reinforcement learning, neural architecture search, federated learning, etc. It has been extended to the online...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2023-01-01
|
| Series: | IEEE Access |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/10171341/ |
| _version_ | 1797782805809201152 |
|---|---|
| author | Olusola T. Odeyomi Bassey Ude Kaushik Roy |
| author_facet | Olusola T. Odeyomi Bassey Ude Kaushik Roy |
| author_sort | Olusola T. Odeyomi |
| collection | DOAJ |
| description | Meta-learning is a learning-to-learn paradigm that leverages past learning experiences for quick adaptation to new learning tasks. It has a wide application, such as in few-shot learning, reinforcement learning, neural architecture search, federated learning, etc. It has been extended to the online learning setting where task data distribution arrives sequentially. This provides continuous lifelong learning. However, in the online meta-learning setting, a single agent has to learn many varieties of related tasks. Yet, a single agent is limited to its local task data and must collaborate with neighboring agents to improve its learning performance. Therefore, online decentralized meta-learning algorithms are designed to allow an agent to collaborate with neighboring agents in order to improve learning performance. Despite their advantages, online decentralized meta-learning algorithms are susceptible to Byzantine attacks caused by the diffusion of poisonous information from unidentifiable Byzantine agents in the network. This is a serious problem where normal agents are unable to learn and convergence to the global meta-initializer is thwarted. State-of-the-art algorithms, such as BRIDGE, designed to provide robustness against Byzantine attacks are slow and cannot work in online learning settings. Therefore, we propose an online decentralized meta-learning algorithm that works with two Byzantine-resilient aggregation techniques, which are modified coordinate-wise screening and centerpoint aggregation. The proposed algorithm provides faster convergence speed and guarantees both resiliency and continuous lifelong learning. Our simulation results show that the proposed algorithm performs better than state-of-the-art algorithms. |
| first_indexed | 2024-03-13T00:17:09Z |
| format | Article |
| id | doaj.art-2809530221a6471fa5cba3dc066feebe |
| institution | Directory Open Access Journal |
| issn | 2169-3536 |
| language | English |
| last_indexed | 2024-03-13T00:17:09Z |
| publishDate | 2023-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Access |
| spelling | doaj.art-2809530221a6471fa5cba3dc066feebe2023-07-11T23:00:52ZengIEEEIEEE Access2169-35362023-01-0111682866830010.1109/ACCESS.2023.329167710171341Online Decentralized Multi-Agents Meta-Learning With Byzantine ResiliencyOlusola T. Odeyomi0https://orcid.org/0000-0001-6569-6211Bassey Ude1https://orcid.org/0009-0007-0964-029XKaushik Roy2https://orcid.org/0000-0002-9026-5322Department of Computer Science, North Carolina Agricultural and Technical State University, Greensboro, NC, USADepartment of Computer Science, North Carolina Agricultural and Technical State University, Greensboro, NC, USADepartment of Computer Science, North Carolina Agricultural and Technical State University, Greensboro, NC, USAMeta-learning is a learning-to-learn paradigm that leverages past learning experiences for quick adaptation to new learning tasks. It has a wide application, such as in few-shot learning, reinforcement learning, neural architecture search, federated learning, etc. It has been extended to the online learning setting where task data distribution arrives sequentially. This provides continuous lifelong learning. However, in the online meta-learning setting, a single agent has to learn many varieties of related tasks. Yet, a single agent is limited to its local task data and must collaborate with neighboring agents to improve its learning performance. Therefore, online decentralized meta-learning algorithms are designed to allow an agent to collaborate with neighboring agents in order to improve learning performance. Despite their advantages, online decentralized meta-learning algorithms are susceptible to Byzantine attacks caused by the diffusion of poisonous information from unidentifiable Byzantine agents in the network. This is a serious problem where normal agents are unable to learn and convergence to the global meta-initializer is thwarted. State-of-the-art algorithms, such as BRIDGE, designed to provide robustness against Byzantine attacks are slow and cannot work in online learning settings. Therefore, we propose an online decentralized meta-learning algorithm that works with two Byzantine-resilient aggregation techniques, which are modified coordinate-wise screening and centerpoint aggregation. The proposed algorithm provides faster convergence speed and guarantees both resiliency and continuous lifelong learning. Our simulation results show that the proposed algorithm performs better than state-of-the-art algorithms.https://ieeexplore.ieee.org/document/10171341/Byzantine attacksdecentralized networksdiffusion learningmeta-learningonline learningregret |
| spellingShingle | Olusola T. Odeyomi Bassey Ude Kaushik Roy Online Decentralized Multi-Agents Meta-Learning With Byzantine Resiliency IEEE Access Byzantine attacks decentralized networks diffusion learning meta-learning online learning regret |
| title | Online Decentralized Multi-Agents Meta-Learning With Byzantine Resiliency |
| title_full | Online Decentralized Multi-Agents Meta-Learning With Byzantine Resiliency |
| title_fullStr | Online Decentralized Multi-Agents Meta-Learning With Byzantine Resiliency |
| title_full_unstemmed | Online Decentralized Multi-Agents Meta-Learning With Byzantine Resiliency |
| title_short | Online Decentralized Multi-Agents Meta-Learning With Byzantine Resiliency |
| title_sort | online decentralized multi agents meta learning with byzantine resiliency |
| topic | Byzantine attacks decentralized networks diffusion learning meta-learning online learning regret |
| url | https://ieeexplore.ieee.org/document/10171341/ |
| work_keys_str_mv | AT olusolatodeyomi onlinedecentralizedmultiagentsmetalearningwithbyzantineresiliency AT basseyude onlinedecentralizedmultiagentsmetalearningwithbyzantineresiliency AT kaushikroy onlinedecentralizedmultiagentsmetalearningwithbyzantineresiliency |