Compact, Popularity-Aware and Adaptive Hybrid Data Placement Schemes for Heterogeneous Cloud Storage
Cloud storage systems frequently have a large user base that requires huge cloud resources. Sometimes, cloud devices become overloaded because of an imbalance in input/output (I/O) or space demand. How can data with different popularity be distributed over heterogeneous devices? The key to resolving...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2017-01-01
|
| Series: | IEEE Access |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/7856885/ |
| _version_ | 1818876936583118848 |
|---|---|
| author | Yang Gao Keqiu Li Yingwei Jin |
| author_facet | Yang Gao Keqiu Li Yingwei Jin |
| author_sort | Yang Gao |
| collection | DOAJ |
| description | Cloud storage systems frequently have a large user base that requires huge cloud resources. Sometimes, cloud devices become overloaded because of an imbalance in input/output (I/O) or space demand. How can data with different popularity be distributed over heterogeneous devices? The key to resolving this problem is to balance the workload of multi-dimension resources. A consistent hash-aware cloud storage system constitutes a good solution for data placement. It can achieve only 1-D balance, usually the balance of the space resource. However, it is not straightforward to obtain a balance of space, I/O, and other resources simultaneously. Many users have experienced the overloading of devices in these systems. We focus mainly on this problem in this paper. In this paper, we discuss the factors that cause the overload of devices that occurs in the hash-aware cloud. Furthermore, we design some schemes with three algorithms to facilitate the assignment of hybrid data of different size and popularity to the heterogeneous cloud. The system can reduce the probability of an overload occurring. Most systems do not easily accommodate the movement of data. However, we argue that relocating part of the necessary data is helpful. This relocation can achieve a balance of resource usage and use fewer resources, without the need for replicas. Our system can provide a better quality of service, because the imbalance in the usage of resources is reduced. We performed an evaluation using extensive simulations driven by real-world traces. We demonstrate that our system can effectively reduce the overload probability of devices in cloud storage systems. |
| first_indexed | 2024-12-19T13:50:19Z |
| format | Article |
| id | doaj.art-535364ce8c1a4e6dbb2ca20d1eaad5f8 |
| institution | Directory Open Access Journal |
| issn | 2169-3536 |
| language | English |
| last_indexed | 2024-12-19T13:50:19Z |
| publishDate | 2017-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Access |
| spelling | doaj.art-535364ce8c1a4e6dbb2ca20d1eaad5f82022-12-21T20:18:45ZengIEEEIEEE Access2169-35362017-01-0151306131810.1109/ACCESS.2017.26683927856885Compact, Popularity-Aware and Adaptive Hybrid Data Placement Schemes for Heterogeneous Cloud StorageYang Gao0https://orcid.org/0000-0002-1366-731XKeqiu Li1Yingwei Jin2School of Computer Science and Technology, Dalian University of Technology, Dalian, ChinaSchool of Computer Science and Technology, Dalian University of Technology, Dalian, ChinaSchool of Management, Dalian University of Technology, Dalian, ChinaCloud storage systems frequently have a large user base that requires huge cloud resources. Sometimes, cloud devices become overloaded because of an imbalance in input/output (I/O) or space demand. How can data with different popularity be distributed over heterogeneous devices? The key to resolving this problem is to balance the workload of multi-dimension resources. A consistent hash-aware cloud storage system constitutes a good solution for data placement. It can achieve only 1-D balance, usually the balance of the space resource. However, it is not straightforward to obtain a balance of space, I/O, and other resources simultaneously. Many users have experienced the overloading of devices in these systems. We focus mainly on this problem in this paper. In this paper, we discuss the factors that cause the overload of devices that occurs in the hash-aware cloud. Furthermore, we design some schemes with three algorithms to facilitate the assignment of hybrid data of different size and popularity to the heterogeneous cloud. The system can reduce the probability of an overload occurring. Most systems do not easily accommodate the movement of data. However, we argue that relocating part of the necessary data is helpful. This relocation can achieve a balance of resource usage and use fewer resources, without the need for replicas. Our system can provide a better quality of service, because the imbalance in the usage of resources is reduced. We performed an evaluation using extensive simulations driven by real-world traces. We demonstrate that our system can effectively reduce the overload probability of devices in cloud storage systems.https://ieeexplore.ieee.org/document/7856885/Cloud storageload balancecounting bloom filterconsistent hash |
| spellingShingle | Yang Gao Keqiu Li Yingwei Jin Compact, Popularity-Aware and Adaptive Hybrid Data Placement Schemes for Heterogeneous Cloud Storage IEEE Access Cloud storage load balance counting bloom filter consistent hash |
| title | Compact, Popularity-Aware and Adaptive Hybrid Data Placement Schemes for Heterogeneous Cloud Storage |
| title_full | Compact, Popularity-Aware and Adaptive Hybrid Data Placement Schemes for Heterogeneous Cloud Storage |
| title_fullStr | Compact, Popularity-Aware and Adaptive Hybrid Data Placement Schemes for Heterogeneous Cloud Storage |
| title_full_unstemmed | Compact, Popularity-Aware and Adaptive Hybrid Data Placement Schemes for Heterogeneous Cloud Storage |
| title_short | Compact, Popularity-Aware and Adaptive Hybrid Data Placement Schemes for Heterogeneous Cloud Storage |
| title_sort | compact popularity aware and adaptive hybrid data placement schemes for heterogeneous cloud storage |
| topic | Cloud storage load balance counting bloom filter consistent hash |
| url | https://ieeexplore.ieee.org/document/7856885/ |
| work_keys_str_mv | AT yanggao compactpopularityawareandadaptivehybriddataplacementschemesforheterogeneouscloudstorage AT keqiuli compactpopularityawareandadaptivehybriddataplacementschemesforheterogeneouscloudstorage AT yingweijin compactpopularityawareandadaptivehybriddataplacementschemesforheterogeneouscloudstorage |