Federated Learning for Resource Constrained Devices
As resource constrained edge devices become increasingly more powerful, they are able to provide a larger quantity of higher quality data. However, as these devices are decentralized, it becomes difficult to gain insights from multiple devices at the same time. Federated learning allows us to learn...
| Main Author: | |
|---|---|
| Other Authors: | |
| Format: | Thesis |
| Published: |
Massachusetts Institute of Technology
2022
|
| Online Access: | https://hdl.handle.net/1721.1/144688 |
| _version_ | 1826206692228988928 |
|---|---|
| author | Jain, Kriti |
| author2 | Kagal, Lalana |
| author_facet | Kagal, Lalana Jain, Kriti |
| author_sort | Jain, Kriti |
| collection | MIT |
| description | As resource constrained edge devices become increasingly more powerful, they are able to provide a larger quantity of higher quality data. However, as these devices are decentralized, it becomes difficult to gain insights from multiple devices at the same time. Federated learning allows us to learn from multiple devices in a decentralized manner without requiring data to be shared. Each client trains its own model and communicates relevant model information to a central server. The server aggregates this information according to some specified algorithm and sends the clients a global model; the clients then update their own private models with this global model, without ever sharing their local data or accessing any other client’s local data. On edge devices, however, federated learning becomes increasingly difficult because of computation, battery, and storage constraints. This thesis has two main contributions. The first is a modular, single-machine simulator for federated learning on edge devices. The second is a real world scalable federated learning system for Android devices that is able to automatically allocate resources by leveraging PyTorch Lightning. To the best of my knowledge, this is the first work that uses PyTorch Lightning specifically for training, and not just inference, on edge devices. |
| first_indexed | 2024-09-23T13:36:46Z |
| format | Thesis |
| id | mit-1721.1/144688 |
| institution | Massachusetts Institute of Technology |
| last_indexed | 2024-09-23T13:36:46Z |
| publishDate | 2022 |
| publisher | Massachusetts Institute of Technology |
| record_format | dspace |
| spelling | mit-1721.1/1446882022-08-30T03:28:15Z Federated Learning for Resource Constrained Devices Jain, Kriti Kagal, Lalana Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science As resource constrained edge devices become increasingly more powerful, they are able to provide a larger quantity of higher quality data. However, as these devices are decentralized, it becomes difficult to gain insights from multiple devices at the same time. Federated learning allows us to learn from multiple devices in a decentralized manner without requiring data to be shared. Each client trains its own model and communicates relevant model information to a central server. The server aggregates this information according to some specified algorithm and sends the clients a global model; the clients then update their own private models with this global model, without ever sharing their local data or accessing any other client’s local data. On edge devices, however, federated learning becomes increasingly difficult because of computation, battery, and storage constraints. This thesis has two main contributions. The first is a modular, single-machine simulator for federated learning on edge devices. The second is a real world scalable federated learning system for Android devices that is able to automatically allocate resources by leveraging PyTorch Lightning. To the best of my knowledge, this is the first work that uses PyTorch Lightning specifically for training, and not just inference, on edge devices. M.Eng. 2022-08-29T16:04:57Z 2022-08-29T16:04:57Z 2022-05 2022-05-27T16:18:48.919Z Thesis https://hdl.handle.net/1721.1/144688 In Copyright - Educational Use Permitted Copyright MIT http://rightsstatements.org/page/InC-EDU/1.0/ application/pdf Massachusetts Institute of Technology |
| spellingShingle | Jain, Kriti Federated Learning for Resource Constrained Devices |
| title | Federated Learning for Resource Constrained Devices |
| title_full | Federated Learning for Resource Constrained Devices |
| title_fullStr | Federated Learning for Resource Constrained Devices |
| title_full_unstemmed | Federated Learning for Resource Constrained Devices |
| title_short | Federated Learning for Resource Constrained Devices |
| title_sort | federated learning for resource constrained devices |
| url | https://hdl.handle.net/1721.1/144688 |
| work_keys_str_mv | AT jainkriti federatedlearningforresourceconstraineddevices |