Improved Secure Deep Neural Network Inference Offloading with Privacy-Preserving Scalar Product Evaluation for Edge Computing
Enabling deep learning inferences on resource-constrained devices is important for intelligent Internet of Things. Edge computing makes this feasible by outsourcing resource-consuming operations from IoT devices to edge devices. In such scenarios, sensitive data shall be protected while transmitted...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2022-09-01
|
| Series: | Applied Sciences |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2076-3417/12/18/9010 |
| _version_ | 1797491565997850624 |
|---|---|
| author | Jiarui Li Zhuosheng Zhang Shucheng Yu Jiawei Yuan |
| author_facet | Jiarui Li Zhuosheng Zhang Shucheng Yu Jiawei Yuan |
| author_sort | Jiarui Li |
| collection | DOAJ |
| description | Enabling deep learning inferences on resource-constrained devices is important for intelligent Internet of Things. Edge computing makes this feasible by outsourcing resource-consuming operations from IoT devices to edge devices. In such scenarios, sensitive data shall be protected while transmitted to the edge. To address this issue, one major challenge is to efficiently execute inference tasks without hampering the real-time operation of IoT applications. Existing techniques based on complex cryptographic primitives or differential privacy are limited to either efficiency or model accuracy. This paper addresses this challenge with a lightweight interactive protocol by utilizing low-latency IoT-to-edge communication links for computational efficiency. We achieve this with a new privacy-preserving scalar product evaluation technique that caters to the unique requirements of deep learning inference. As compared to the state-of-the-art, our solution offers improved trade-offs among privacy, efficiency, and utility. Experimental results on a Raspberry Pi 4 (Model B) show that our construction can achieve over 14× acceleration versus local execution for AlexNet inference over ImageNet. The proposed privacy-preserving scalar-product-evaluation technique can also be used as a general primitive in other applications. |
| first_indexed | 2024-03-10T00:51:07Z |
| format | Article |
| id | doaj.art-9bf6dc0093eb45c895dbde8d404db732 |
| institution | Directory Open Access Journal |
| issn | 2076-3417 |
| language | English |
| last_indexed | 2024-03-10T00:51:07Z |
| publishDate | 2022-09-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Applied Sciences |
| spelling | doaj.art-9bf6dc0093eb45c895dbde8d404db7322023-11-23T14:51:39ZengMDPI AGApplied Sciences2076-34172022-09-011218901010.3390/app12189010Improved Secure Deep Neural Network Inference Offloading with Privacy-Preserving Scalar Product Evaluation for Edge ComputingJiarui Li0Zhuosheng Zhang1Shucheng Yu2Jiawei Yuan3Department of Electrical and Computer Engineering, Stevens Institute of Technology, 1 Castle Point Terrace, Hoboken, NJ 07030, USADepartment of Electrical and Computer Engineering, Stevens Institute of Technology, 1 Castle Point Terrace, Hoboken, NJ 07030, USADepartment of Electrical and Computer Engineering, Stevens Institute of Technology, 1 Castle Point Terrace, Hoboken, NJ 07030, USADepartment of Computer & Information Science, University of Massachusetts Dartmouth, 285 Old Westport Road, Dartmouth, MA 02747, USAEnabling deep learning inferences on resource-constrained devices is important for intelligent Internet of Things. Edge computing makes this feasible by outsourcing resource-consuming operations from IoT devices to edge devices. In such scenarios, sensitive data shall be protected while transmitted to the edge. To address this issue, one major challenge is to efficiently execute inference tasks without hampering the real-time operation of IoT applications. Existing techniques based on complex cryptographic primitives or differential privacy are limited to either efficiency or model accuracy. This paper addresses this challenge with a lightweight interactive protocol by utilizing low-latency IoT-to-edge communication links for computational efficiency. We achieve this with a new privacy-preserving scalar product evaluation technique that caters to the unique requirements of deep learning inference. As compared to the state-of-the-art, our solution offers improved trade-offs among privacy, efficiency, and utility. Experimental results on a Raspberry Pi 4 (Model B) show that our construction can achieve over 14× acceleration versus local execution for AlexNet inference over ImageNet. The proposed privacy-preserving scalar-product-evaluation technique can also be used as a general primitive in other applications.https://www.mdpi.com/2076-3417/12/18/9010privacyInternet of Thingsconvolutional neural networksdeep learningcomputation outsourcingedge computing |
| spellingShingle | Jiarui Li Zhuosheng Zhang Shucheng Yu Jiawei Yuan Improved Secure Deep Neural Network Inference Offloading with Privacy-Preserving Scalar Product Evaluation for Edge Computing Applied Sciences privacy Internet of Things convolutional neural networks deep learning computation outsourcing edge computing |
| title | Improved Secure Deep Neural Network Inference Offloading with Privacy-Preserving Scalar Product Evaluation for Edge Computing |
| title_full | Improved Secure Deep Neural Network Inference Offloading with Privacy-Preserving Scalar Product Evaluation for Edge Computing |
| title_fullStr | Improved Secure Deep Neural Network Inference Offloading with Privacy-Preserving Scalar Product Evaluation for Edge Computing |
| title_full_unstemmed | Improved Secure Deep Neural Network Inference Offloading with Privacy-Preserving Scalar Product Evaluation for Edge Computing |
| title_short | Improved Secure Deep Neural Network Inference Offloading with Privacy-Preserving Scalar Product Evaluation for Edge Computing |
| title_sort | improved secure deep neural network inference offloading with privacy preserving scalar product evaluation for edge computing |
| topic | privacy Internet of Things convolutional neural networks deep learning computation outsourcing edge computing |
| url | https://www.mdpi.com/2076-3417/12/18/9010 |
| work_keys_str_mv | AT jiaruili improvedsecuredeepneuralnetworkinferenceoffloadingwithprivacypreservingscalarproductevaluationforedgecomputing AT zhuoshengzhang improvedsecuredeepneuralnetworkinferenceoffloadingwithprivacypreservingscalarproductevaluationforedgecomputing AT shuchengyu improvedsecuredeepneuralnetworkinferenceoffloadingwithprivacypreservingscalarproductevaluationforedgecomputing AT jiaweiyuan improvedsecuredeepneuralnetworkinferenceoffloadingwithprivacypreservingscalarproductevaluationforedgecomputing |