A scheduler system for large-scale distributed data computing in cloud
A novel scheduler system including resource scheduling,application scheduling,configuration and label management center,cloud network and cloud storage services was introduced.The locality of computation and data was ensured by the ability of data topology awareness,and the I/O cost was saved.The im...
Główni autorzy: | , , |
---|---|
Format: | Artykuł |
Język: | zho |
Wydane: |
China InfoCom Media Group
2020-01-01
|
Seria: | 大数据 |
Hasła przedmiotowe: | |
Dostęp online: | http://www.j-bigdataresearch.com.cn/thesisDetails#10.11959/j.issn.2096-0271.2020007 |
_version_ | 1827054491033141248 |
---|---|
author | Wanggen LIU Huaicheng ZHENG Guoping RONG |
author_facet | Wanggen LIU Huaicheng ZHENG Guoping RONG |
author_sort | Wanggen LIU |
collection | DOAJ |
description | A novel scheduler system including resource scheduling,application scheduling,configuration and label management center,cloud network and cloud storage services was introduced.The locality of computation and data was ensured by the ability of data topology awareness,and the I/O cost was saved.The impact of network storm was solved by optimizing the resource scheduling of point to point large data reading.The service level protocol was guaranteed by network and disk isolation technology and preemptive way. |
first_indexed | 2025-02-18T17:17:21Z |
format | Article |
id | doaj.art-314a901b35f14b25ae1238d79954c5df |
institution | Directory Open Access Journal |
issn | 2096-0271 |
language | zho |
last_indexed | 2025-02-18T17:17:21Z |
publishDate | 2020-01-01 |
publisher | China InfoCom Media Group |
record_format | Article |
series | 大数据 |
spelling | doaj.art-314a901b35f14b25ae1238d79954c5df2024-10-22T13:11:02ZzhoChina InfoCom Media Group大数据2096-02712020-01-0162020007159536188A scheduler system for large-scale distributed data computing in cloudWanggen LIUHuaicheng ZHENGGuoping RONGA novel scheduler system including resource scheduling,application scheduling,configuration and label management center,cloud network and cloud storage services was introduced.The locality of computation and data was ensured by the ability of data topology awareness,and the I/O cost was saved.The impact of network storm was solved by optimizing the resource scheduling of point to point large data reading.The service level protocol was guaranteed by network and disk isolation technology and preemptive way.http://www.j-bigdataresearch.com.cn/thesisDetails#10.11959/j.issn.2096-0271.2020007cloud computing;scheduling system;big data;artificial intelligence platform;data locality;distributed computing;preemption |
spellingShingle | Wanggen LIU Huaicheng ZHENG Guoping RONG A scheduler system for large-scale distributed data computing in cloud 大数据 cloud computing;scheduling system;big data;artificial intelligence platform;data locality;distributed computing;preemption |
title | A scheduler system for large-scale distributed data computing in cloud |
title_full | A scheduler system for large-scale distributed data computing in cloud |
title_fullStr | A scheduler system for large-scale distributed data computing in cloud |
title_full_unstemmed | A scheduler system for large-scale distributed data computing in cloud |
title_short | A scheduler system for large-scale distributed data computing in cloud |
title_sort | scheduler system for large scale distributed data computing in cloud |
topic | cloud computing;scheduling system;big data;artificial intelligence platform;data locality;distributed computing;preemption |
url | http://www.j-bigdataresearch.com.cn/thesisDetails#10.11959/j.issn.2096-0271.2020007 |
work_keys_str_mv | AT wanggenliu aschedulersystemforlargescaledistributeddatacomputingincloud AT huaichengzheng aschedulersystemforlargescaledistributeddatacomputingincloud AT guopingrong aschedulersystemforlargescaledistributeddatacomputingincloud AT wanggenliu schedulersystemforlargescaledistributeddatacomputingincloud AT huaichengzheng schedulersystemforlargescaledistributeddatacomputingincloud AT guopingrong schedulersystemforlargescaledistributeddatacomputingincloud |