Merging ring-structured overlay indices : toward network-data transparency

Peer-to-peer index structures distributed and managed over the planet, commonly known as structured overlays (e.g., distributed hash tables) have been touted to play the role of a fundamental building block for internet-scale distributed systems. Traditional designs consider incremental or possibly...

Full description

Bibliographic Details
Main Author: Datta, Anwitaman
Other Authors: School of Computer Engineering
Format: Journal Article
Language:English
Published: 2013
Subjects:
Online Access:https://hdl.handle.net/10356/97384
http://hdl.handle.net/10220/13152
_version_ 1811677762280226816
author Datta, Anwitaman
author2 School of Computer Engineering
author_facet School of Computer Engineering
Datta, Anwitaman
author_sort Datta, Anwitaman
collection NTU
description Peer-to-peer index structures distributed and managed over the planet, commonly known as structured overlays (e.g., distributed hash tables) have been touted to play the role of a fundamental building block for internet-scale distributed systems. Traditional designs consider incremental or possibly even parallelized construction of a single overlay, which implicitly assumes global control and coordination to enforce the construction of an unique overlay. However, if merger of originally isolated overlays is made possible, then one can realize decentralized bootstrapping of overlays. So to say, smaller overlays can be constructed using any of the traditional mechanisms, which can then organically coalesce to form a larger overlay. Such self-organizational attributes of decentralized bootstrapping and organic growth are of paramount importance for large scale systems. In our previous works, we explained the challenges of merging important families of (tree and ring) structured overlays (Datta and Aberer in international workshop on self-organizing systems, 2006), and identified that tree structured overlays are relatively easier to merge in a transparent manner (Datta in IEEE international conference on self-adaptive and self-organizing systems, 2007). In this paper we investigate how ring structured overlays can be merged, both in terms of the necessary algorithms, as well as how it performs during the merger process, taking into account not only the ‘network’ merger process, but also looking into how and whether this process is ‘transparent’ for applications/end-users accessing and using the overlay as an index. We introduce interesting new metrics to evaluate the merger process and carry out asymptotic analysis for estimating the same, besides conducting simulation experiments to validate the theory as well as measure other aspects of the overlays’ performance under merger.
first_indexed 2024-10-01T02:42:31Z
format Journal Article
id ntu-10356/97384
institution Nanyang Technological University
language English
last_indexed 2024-10-01T02:42:31Z
publishDate 2013
record_format dspace
spelling ntu-10356/973842020-05-28T07:18:09Z Merging ring-structured overlay indices : toward network-data transparency Datta, Anwitaman School of Computer Engineering DRNTU::Engineering::Computer science and engineering Peer-to-peer index structures distributed and managed over the planet, commonly known as structured overlays (e.g., distributed hash tables) have been touted to play the role of a fundamental building block for internet-scale distributed systems. Traditional designs consider incremental or possibly even parallelized construction of a single overlay, which implicitly assumes global control and coordination to enforce the construction of an unique overlay. However, if merger of originally isolated overlays is made possible, then one can realize decentralized bootstrapping of overlays. So to say, smaller overlays can be constructed using any of the traditional mechanisms, which can then organically coalesce to form a larger overlay. Such self-organizational attributes of decentralized bootstrapping and organic growth are of paramount importance for large scale systems. In our previous works, we explained the challenges of merging important families of (tree and ring) structured overlays (Datta and Aberer in international workshop on self-organizing systems, 2006), and identified that tree structured overlays are relatively easier to merge in a transparent manner (Datta in IEEE international conference on self-adaptive and self-organizing systems, 2007). In this paper we investigate how ring structured overlays can be merged, both in terms of the necessary algorithms, as well as how it performs during the merger process, taking into account not only the ‘network’ merger process, but also looking into how and whether this process is ‘transparent’ for applications/end-users accessing and using the overlay as an index. We introduce interesting new metrics to evaluate the merger process and carry out asymptotic analysis for estimating the same, besides conducting simulation experiments to validate the theory as well as measure other aspects of the overlays’ performance under merger. 2013-08-16T03:53:23Z 2019-12-06T19:42:05Z 2013-08-16T03:53:23Z 2019-12-06T19:42:05Z 2012 2012 Journal Article Datta, A. (2012). Merging ring-structured overlay indices: toward network-data transparency. Computing, 94(8-10), 783-809. https://hdl.handle.net/10356/97384 http://hdl.handle.net/10220/13152 10.1007/s00607-012-0201-4 en Computing
spellingShingle DRNTU::Engineering::Computer science and engineering
Datta, Anwitaman
Merging ring-structured overlay indices : toward network-data transparency
title Merging ring-structured overlay indices : toward network-data transparency
title_full Merging ring-structured overlay indices : toward network-data transparency
title_fullStr Merging ring-structured overlay indices : toward network-data transparency
title_full_unstemmed Merging ring-structured overlay indices : toward network-data transparency
title_short Merging ring-structured overlay indices : toward network-data transparency
title_sort merging ring structured overlay indices toward network data transparency
topic DRNTU::Engineering::Computer science and engineering
url https://hdl.handle.net/10356/97384
http://hdl.handle.net/10220/13152
work_keys_str_mv AT dattaanwitaman mergingringstructuredoverlayindicestowardnetworkdatatransparency