An Improvement of Static Subtree Partitioning in Metadata Server Cluster
Efficient metadata management is a key issue in distributed file systems. Currently a single metadata server (MDS) was used to provide metadata service in many distributed file systems. As a result the MDS is likely to be the bottleneck of the system with the expanding scale. To deal with this probl...
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Hindawi - SAGE Publishing
2012-09-01
|
| Series: | International Journal of Distributed Sensor Networks |
| Online Access: | https://doi.org/10.1155/2012/835616 |
| _version_ | 1797713823721848832 |
|---|---|
| author | Tan Zhipeng Zhou Wei Sun Jianliang Zhan Tian Cui Jie |
| author_facet | Tan Zhipeng Zhou Wei Sun Jianliang Zhan Tian Cui Jie |
| author_sort | Tan Zhipeng |
| collection | DOAJ |
| description | Efficient metadata management is a key issue in distributed file systems. Currently a single metadata server (MDS) was used to provide metadata service in many distributed file systems. As a result the MDS is likely to be the bottleneck of the system with the expanding scale. To deal with this problem, MDS cluster has been advanced. There are subtree partitioning and hashing partitioning to realize MDS cluster and so on. In view of the strengths and weaknesses of the previous methods, the paper proposes a half-dynamic subtree strategy that supports the replication of metadata, the dynamic addition and failure recovery of MDS. Finally we implement it in the open source pNFS file system and demonstrate its high performance and availability. |
| first_indexed | 2024-03-12T07:42:33Z |
| format | Article |
| id | doaj.art-6ab3385087f64bdd82ed881d4f5e735b |
| institution | Directory Open Access Journal |
| issn | 1550-1477 |
| language | English |
| last_indexed | 2024-03-12T07:42:33Z |
| publishDate | 2012-09-01 |
| publisher | Hindawi - SAGE Publishing |
| record_format | Article |
| series | International Journal of Distributed Sensor Networks |
| spelling | doaj.art-6ab3385087f64bdd82ed881d4f5e735b2023-09-02T21:11:52ZengHindawi - SAGE PublishingInternational Journal of Distributed Sensor Networks1550-14772012-09-01810.1155/2012/835616An Improvement of Static Subtree Partitioning in Metadata Server ClusterTan ZhipengZhou WeiSun JianliangZhan TianCui JieEfficient metadata management is a key issue in distributed file systems. Currently a single metadata server (MDS) was used to provide metadata service in many distributed file systems. As a result the MDS is likely to be the bottleneck of the system with the expanding scale. To deal with this problem, MDS cluster has been advanced. There are subtree partitioning and hashing partitioning to realize MDS cluster and so on. In view of the strengths and weaknesses of the previous methods, the paper proposes a half-dynamic subtree strategy that supports the replication of metadata, the dynamic addition and failure recovery of MDS. Finally we implement it in the open source pNFS file system and demonstrate its high performance and availability.https://doi.org/10.1155/2012/835616 |
| spellingShingle | Tan Zhipeng Zhou Wei Sun Jianliang Zhan Tian Cui Jie An Improvement of Static Subtree Partitioning in Metadata Server Cluster International Journal of Distributed Sensor Networks |
| title | An Improvement of Static Subtree Partitioning in Metadata Server Cluster |
| title_full | An Improvement of Static Subtree Partitioning in Metadata Server Cluster |
| title_fullStr | An Improvement of Static Subtree Partitioning in Metadata Server Cluster |
| title_full_unstemmed | An Improvement of Static Subtree Partitioning in Metadata Server Cluster |
| title_short | An Improvement of Static Subtree Partitioning in Metadata Server Cluster |
| title_sort | improvement of static subtree partitioning in metadata server cluster |
| url | https://doi.org/10.1155/2012/835616 |
| work_keys_str_mv | AT tanzhipeng animprovementofstaticsubtreepartitioninginmetadataservercluster AT zhouwei animprovementofstaticsubtreepartitioninginmetadataservercluster AT sunjianliang animprovementofstaticsubtreepartitioninginmetadataservercluster AT zhantian animprovementofstaticsubtreepartitioninginmetadataservercluster AT cuijie animprovementofstaticsubtreepartitioninginmetadataservercluster AT tanzhipeng improvementofstaticsubtreepartitioninginmetadataservercluster AT zhouwei improvementofstaticsubtreepartitioninginmetadataservercluster AT sunjianliang improvementofstaticsubtreepartitioninginmetadataservercluster AT zhantian improvementofstaticsubtreepartitioninginmetadataservercluster AT cuijie improvementofstaticsubtreepartitioninginmetadataservercluster |