Unlocking Collective Intelligence in Decentralized AI
In the current evolving digital landscape, vast repositories of data and knowledge often remain siloed and untapped due to privacy concerns and centralized control. Thus, despite the transformative potential of artificial intelligence, its utilization in societal sectors lags behind other industries...
Main Author: | |
---|---|
Other Authors: | |
Format: | Thesis |
Published: |
Massachusetts Institute of Technology
2024
|
Online Access: | https://hdl.handle.net/1721.1/156977 https://orcid.org/0009-0008-7223-4320 |
_version_ | 1824458023793328128 |
---|---|
author | Gupta, Gauri |
author2 | Raskar, Ramesh |
author_facet | Raskar, Ramesh Gupta, Gauri |
author_sort | Gupta, Gauri |
collection | MIT |
description | In the current evolving digital landscape, vast repositories of data and knowledge often remain siloed and untapped due to privacy concerns and centralized control. Thus, despite the transformative potential of artificial intelligence, its utilization in societal sectors lags behind other industries. For example in healthcare, data privacy and lack of incentives and trust in the system prevent collaboration on a large scale. This necessitates the development of efficient methods for decentralized learning while preserving privacy to generate wisdom whose quality is on par with the case of data centralization. It involves first identifying and creating essential building blocks that encourage collaboration while preserving the decentralized nature of these critical digital paradigms. A key challenge here is to facilitate collaboration among distrustful, disconnected, and disincentivized entities possessing distinct assets such as data, models, and computation resources. Harnessing the collective wisdom latent within decentralized networks will unlock new avenues for innovation and human collaboration. Therefore, the primary aim of this thesis is to expedite AI adoption in decentralized systems by introducing novel algorithms and systems capable of extracting collective intelligence while preserving privacy.
This thesis addresses the following research questions: First, it delves into methods for training machine learning models collaboratively while simultaneously protecting the privacy of raw data and the proprietary nature of individual models. Second, it explores the coordination mechanisms among system nodes in the absence of a central authority or trusted server to ensure orderly collaboration. Specifically, it answers questions like who should a node talk to. When does random collaboration selection work? Finally, it investigates strategies for conducting crowd-sourced decision-making to obtain population-level predictive results, scaling efficiently to encompass millions of agents. |
first_indexed | 2025-02-19T04:19:18Z |
format | Thesis |
id | mit-1721.1/156977 |
institution | Massachusetts Institute of Technology |
last_indexed | 2025-02-19T04:19:18Z |
publishDate | 2024 |
publisher | Massachusetts Institute of Technology |
record_format | dspace |
spelling | mit-1721.1/1569772024-09-25T03:47:41Z Unlocking Collective Intelligence in Decentralized AI Gupta, Gauri Raskar, Ramesh Program in Media Arts and Sciences (Massachusetts Institute of Technology) In the current evolving digital landscape, vast repositories of data and knowledge often remain siloed and untapped due to privacy concerns and centralized control. Thus, despite the transformative potential of artificial intelligence, its utilization in societal sectors lags behind other industries. For example in healthcare, data privacy and lack of incentives and trust in the system prevent collaboration on a large scale. This necessitates the development of efficient methods for decentralized learning while preserving privacy to generate wisdom whose quality is on par with the case of data centralization. It involves first identifying and creating essential building blocks that encourage collaboration while preserving the decentralized nature of these critical digital paradigms. A key challenge here is to facilitate collaboration among distrustful, disconnected, and disincentivized entities possessing distinct assets such as data, models, and computation resources. Harnessing the collective wisdom latent within decentralized networks will unlock new avenues for innovation and human collaboration. Therefore, the primary aim of this thesis is to expedite AI adoption in decentralized systems by introducing novel algorithms and systems capable of extracting collective intelligence while preserving privacy. This thesis addresses the following research questions: First, it delves into methods for training machine learning models collaboratively while simultaneously protecting the privacy of raw data and the proprietary nature of individual models. Second, it explores the coordination mechanisms among system nodes in the absence of a central authority or trusted server to ensure orderly collaboration. Specifically, it answers questions like who should a node talk to. When does random collaboration selection work? Finally, it investigates strategies for conducting crowd-sourced decision-making to obtain population-level predictive results, scaling efficiently to encompass millions of agents. S.M. 2024-09-24T18:24:26Z 2024-09-24T18:24:26Z 2024-05 2024-08-05T13:47:43.681Z Thesis https://hdl.handle.net/1721.1/156977 https://orcid.org/0009-0008-7223-4320 In Copyright - Educational Use Permitted Copyright retained by author(s) https://rightsstatements.org/page/InC-EDU/1.0/ application/pdf Massachusetts Institute of Technology |
spellingShingle | Gupta, Gauri Unlocking Collective Intelligence in Decentralized AI |
title | Unlocking Collective Intelligence in Decentralized AI |
title_full | Unlocking Collective Intelligence in Decentralized AI |
title_fullStr | Unlocking Collective Intelligence in Decentralized AI |
title_full_unstemmed | Unlocking Collective Intelligence in Decentralized AI |
title_short | Unlocking Collective Intelligence in Decentralized AI |
title_sort | unlocking collective intelligence in decentralized ai |
url | https://hdl.handle.net/1721.1/156977 https://orcid.org/0009-0008-7223-4320 |
work_keys_str_mv | AT guptagauri unlockingcollectiveintelligenceindecentralizedai |