Unlocking Collective Intelligence in Decentralized AI

In the current evolving digital landscape, vast repositories of data and knowledge often remain siloed and untapped due to privacy concerns and centralized control. Thus, despite the transformative potential of artificial intelligence, its utilization in societal sectors lags behind other industries...

Full description

Bibliographic Details
Main Author: Gupta, Gauri
Other Authors: Raskar, Ramesh
Format: Thesis
Published: Massachusetts Institute of Technology 2024
Online Access:https://hdl.handle.net/1721.1/156977
https://orcid.org/0009-0008-7223-4320
_version_ 1824458023793328128
author Gupta, Gauri
author2 Raskar, Ramesh
author_facet Raskar, Ramesh
Gupta, Gauri
author_sort Gupta, Gauri
collection MIT
description In the current evolving digital landscape, vast repositories of data and knowledge often remain siloed and untapped due to privacy concerns and centralized control. Thus, despite the transformative potential of artificial intelligence, its utilization in societal sectors lags behind other industries. For example in healthcare, data privacy and lack of incentives and trust in the system prevent collaboration on a large scale. This necessitates the development of efficient methods for decentralized learning while preserving privacy to generate wisdom whose quality is on par with the case of data centralization. It involves first identifying and creating essential building blocks that encourage collaboration while preserving the decentralized nature of these critical digital paradigms. A key challenge here is to facilitate collaboration among distrustful, disconnected, and disincentivized entities possessing distinct assets such as data, models, and computation resources. Harnessing the collective wisdom latent within decentralized networks will unlock new avenues for innovation and human collaboration. Therefore, the primary aim of this thesis is to expedite AI adoption in decentralized systems by introducing novel algorithms and systems capable of extracting collective intelligence while preserving privacy. This thesis addresses the following research questions: First, it delves into methods for training machine learning models collaboratively while simultaneously protecting the privacy of raw data and the proprietary nature of individual models. Second, it explores the coordination mechanisms among system nodes in the absence of a central authority or trusted server to ensure orderly collaboration. Specifically, it answers questions like who should a node talk to. When does random collaboration selection work? Finally, it investigates strategies for conducting crowd-sourced decision-making to obtain population-level predictive results, scaling efficiently to encompass millions of agents.
first_indexed 2025-02-19T04:19:18Z
format Thesis
id mit-1721.1/156977
institution Massachusetts Institute of Technology
last_indexed 2025-02-19T04:19:18Z
publishDate 2024
publisher Massachusetts Institute of Technology
record_format dspace
spelling mit-1721.1/1569772024-09-25T03:47:41Z Unlocking Collective Intelligence in Decentralized AI Gupta, Gauri Raskar, Ramesh Program in Media Arts and Sciences (Massachusetts Institute of Technology) In the current evolving digital landscape, vast repositories of data and knowledge often remain siloed and untapped due to privacy concerns and centralized control. Thus, despite the transformative potential of artificial intelligence, its utilization in societal sectors lags behind other industries. For example in healthcare, data privacy and lack of incentives and trust in the system prevent collaboration on a large scale. This necessitates the development of efficient methods for decentralized learning while preserving privacy to generate wisdom whose quality is on par with the case of data centralization. It involves first identifying and creating essential building blocks that encourage collaboration while preserving the decentralized nature of these critical digital paradigms. A key challenge here is to facilitate collaboration among distrustful, disconnected, and disincentivized entities possessing distinct assets such as data, models, and computation resources. Harnessing the collective wisdom latent within decentralized networks will unlock new avenues for innovation and human collaboration. Therefore, the primary aim of this thesis is to expedite AI adoption in decentralized systems by introducing novel algorithms and systems capable of extracting collective intelligence while preserving privacy. This thesis addresses the following research questions: First, it delves into methods for training machine learning models collaboratively while simultaneously protecting the privacy of raw data and the proprietary nature of individual models. Second, it explores the coordination mechanisms among system nodes in the absence of a central authority or trusted server to ensure orderly collaboration. Specifically, it answers questions like who should a node talk to. When does random collaboration selection work? Finally, it investigates strategies for conducting crowd-sourced decision-making to obtain population-level predictive results, scaling efficiently to encompass millions of agents. S.M. 2024-09-24T18:24:26Z 2024-09-24T18:24:26Z 2024-05 2024-08-05T13:47:43.681Z Thesis https://hdl.handle.net/1721.1/156977 https://orcid.org/0009-0008-7223-4320 In Copyright - Educational Use Permitted Copyright retained by author(s) https://rightsstatements.org/page/InC-EDU/1.0/ application/pdf Massachusetts Institute of Technology
spellingShingle Gupta, Gauri
Unlocking Collective Intelligence in Decentralized AI
title Unlocking Collective Intelligence in Decentralized AI
title_full Unlocking Collective Intelligence in Decentralized AI
title_fullStr Unlocking Collective Intelligence in Decentralized AI
title_full_unstemmed Unlocking Collective Intelligence in Decentralized AI
title_short Unlocking Collective Intelligence in Decentralized AI
title_sort unlocking collective intelligence in decentralized ai
url https://hdl.handle.net/1721.1/156977
https://orcid.org/0009-0008-7223-4320
work_keys_str_mv AT guptagauri unlockingcollectiveintelligenceindecentralizedai