<italic>FedVision:</italic> Federated Video Analytics With Edge Computing

Widely deployed smart cameras are generating a large amount of video data and capable of processing frames on devices. Empowered by edge computing, the video data can also be offloaded to edge servers for processing. By leveraging the on-device processing and computation offloading, we propose a fed...

Full description

Bibliographic Details
Main Authors: Yang Deng, Tao Han, Nirwan Ansari
Format: Article
Language:English
Published: IEEE 2020-01-01
Series:IEEE Open Journal of the Computer Society
Subjects:
Online Access:https://ieeexplore.ieee.org/document/9097917/
_version_ 1818619318803365888
author Yang Deng
Tao Han
Nirwan Ansari
author_facet Yang Deng
Tao Han
Nirwan Ansari
author_sort Yang Deng
collection DOAJ
description Widely deployed smart cameras are generating a large amount of video data and capable of processing frames on devices. Empowered by edge computing, the video data can also be offloaded to edge servers for processing. By leveraging the on-device processing and computation offloading, we propose a federated video analytics system named FedVision to efficiently provision video analytics across devices and servers. The challenge of designing FedVision is to optimally use the computing and networking resources for video analytics. Since there is no closed-form expression of the system performance, black-box optimization is employed to optimize the system performance. However, using black-box optimization directly incurs excessive system queries that lead to very poor system performance. To solve this problem, we design a new optimization method that integrates black-box optimization with Neural Processes (NPs) as a system performance approximator. This method allows black-box optimizer to query NPs instead of the real system. We validate the performance of FedVision and the new optimization method using both numerical results and experiments with a testbed.
first_indexed 2024-12-16T17:35:35Z
format Article
id doaj.art-7d2d17ce78f14e1a9769cfa7fc7ad366
institution Directory Open Access Journal
issn 2644-1268
language English
last_indexed 2024-12-16T17:35:35Z
publishDate 2020-01-01
publisher IEEE
record_format Article
series IEEE Open Journal of the Computer Society
spelling doaj.art-7d2d17ce78f14e1a9769cfa7fc7ad3662022-12-21T22:22:47ZengIEEEIEEE Open Journal of the Computer Society2644-12682020-01-011627210.1109/OJCS.2020.29961849097917<italic>FedVision:</italic> Federated Video Analytics With Edge ComputingYang Deng0https://orcid.org/0000-0002-4077-409XTao Han1https://orcid.org/0000-0002-6626-1305Nirwan Ansari2https://orcid.org/0000-0001-8541-3565Department of Electrical and Computer Engineering, The University of North Carolina at Charlotte, Charlotte, NC, USADepartment of Electrical and Computer Engineering, The University of North Carolina at Charlotte, Charlotte, NC, USAHelen and John C. Hartmann Department of Electrical and Computer Engineering, New Jersey Institute of Technology, Newark, NJ, USAWidely deployed smart cameras are generating a large amount of video data and capable of processing frames on devices. Empowered by edge computing, the video data can also be offloaded to edge servers for processing. By leveraging the on-device processing and computation offloading, we propose a federated video analytics system named FedVision to efficiently provision video analytics across devices and servers. The challenge of designing FedVision is to optimally use the computing and networking resources for video analytics. Since there is no closed-form expression of the system performance, black-box optimization is employed to optimize the system performance. However, using black-box optimization directly incurs excessive system queries that lead to very poor system performance. To solve this problem, we design a new optimization method that integrates black-box optimization with Neural Processes (NPs) as a system performance approximator. This method allows black-box optimizer to query NPs instead of the real system. We validate the performance of FedVision and the new optimization method using both numerical results and experiments with a testbed.https://ieeexplore.ieee.org/document/9097917/Edge computingblack-box optimizationneural processmachine learningvideo analytics
spellingShingle Yang Deng
Tao Han
Nirwan Ansari
<italic>FedVision:</italic> Federated Video Analytics With Edge Computing
IEEE Open Journal of the Computer Society
Edge computing
black-box optimization
neural process
machine learning
video analytics
title <italic>FedVision:</italic> Federated Video Analytics With Edge Computing
title_full <italic>FedVision:</italic> Federated Video Analytics With Edge Computing
title_fullStr <italic>FedVision:</italic> Federated Video Analytics With Edge Computing
title_full_unstemmed <italic>FedVision:</italic> Federated Video Analytics With Edge Computing
title_short <italic>FedVision:</italic> Federated Video Analytics With Edge Computing
title_sort italic fedvision italic federated video analytics with edge computing
topic Edge computing
black-box optimization
neural process
machine learning
video analytics
url https://ieeexplore.ieee.org/document/9097917/
work_keys_str_mv AT yangdeng italicfedvisionitalicfederatedvideoanalyticswithedgecomputing
AT taohan italicfedvisionitalicfederatedvideoanalyticswithedgecomputing
AT nirwanansari italicfedvisionitalicfederatedvideoanalyticswithedgecomputing