MapReduce scheduling algorithms: a review
Recent trends in big data have shown that the amount of data continues to increase at an exponential rate. This trend has inspired many researchers over the past few years to explore new research direction of studies related to multiple areas of big data. The widespread popularity of big data proces...
| Main Authors: | , , , , , , , , , , |
|---|---|
| Format: | Article |
| Language: | English English |
| Published: |
Springer
2020
|
| Subjects: | |
| Online Access: | http://umpir.ump.edu.my/id/eprint/30281/1/MapReduce%20scheduling%20algorithms-%20a%20review.pdf http://umpir.ump.edu.my/id/eprint/30281/2/MapReduce%20scheduling%20algorithms-a%20review_FULL.pdf |
| _version_ | 1825813656217059328 |
|---|---|
| author | Hashem, Ibrahim Abaker Targio Nor Badrul, Anuar Marjani, Mohsen Ahmed, Ejaz Chiroma, Haruna Ahmad Firdaus, Zainal Abidin Muhamad Taufik, Abdullah Faiz, Alotaibi Mahmoud Ali, Waleed Kamaleldin Yaqoob, Ibrar Abdullah, Gani |
| author_facet | Hashem, Ibrahim Abaker Targio Nor Badrul, Anuar Marjani, Mohsen Ahmed, Ejaz Chiroma, Haruna Ahmad Firdaus, Zainal Abidin Muhamad Taufik, Abdullah Faiz, Alotaibi Mahmoud Ali, Waleed Kamaleldin Yaqoob, Ibrar Abdullah, Gani |
| author_sort | Hashem, Ibrahim Abaker Targio |
| collection | UMP |
| description | Recent trends in big data have shown that the amount of data continues to increase at an exponential rate. This trend has inspired many researchers over the past few years to explore new research direction of studies related to multiple areas of big data. The widespread popularity of big data processing platforms using MapReduce framework is the growing demand to further optimize their performance for various purposes. In particular, enhancing resources and jobs scheduling are becoming critical since they fundamentally determine whether the applications can achieve the performance goals in different use cases. Scheduling plays an important role in big data, mainly in reducing the execution time and cost of processing. This paper aims to survey the research undertaken in the field of scheduling in big data platforms. Moreover, this paper analyzed scheduling in MapReduce on two aspects: taxonomy and performance evaluation. The research progress in MapReduce scheduling algorithms is also discussed. The limitations of existing MapReduce scheduling algorithms and exploit future research opportunities are pointed out in the paper for easy identification by researchers. Our study can serve as the benchmark to expert researchers for proposing a novel MapReduce scheduling algorithm. However, for novice researchers, the study can be used as a starting point. |
| first_indexed | 2024-03-06T12:47:15Z |
| format | Article |
| id | UMPir30281 |
| institution | Universiti Malaysia Pahang |
| language | English English |
| last_indexed | 2024-03-06T12:47:15Z |
| publishDate | 2020 |
| publisher | Springer |
| record_format | dspace |
| spelling | UMPir302812021-10-14T07:14:01Z http://umpir.ump.edu.my/id/eprint/30281/ MapReduce scheduling algorithms: a review Hashem, Ibrahim Abaker Targio Nor Badrul, Anuar Marjani, Mohsen Ahmed, Ejaz Chiroma, Haruna Ahmad Firdaus, Zainal Abidin Muhamad Taufik, Abdullah Faiz, Alotaibi Mahmoud Ali, Waleed Kamaleldin Yaqoob, Ibrar Abdullah, Gani QA76 Computer software Recent trends in big data have shown that the amount of data continues to increase at an exponential rate. This trend has inspired many researchers over the past few years to explore new research direction of studies related to multiple areas of big data. The widespread popularity of big data processing platforms using MapReduce framework is the growing demand to further optimize their performance for various purposes. In particular, enhancing resources and jobs scheduling are becoming critical since they fundamentally determine whether the applications can achieve the performance goals in different use cases. Scheduling plays an important role in big data, mainly in reducing the execution time and cost of processing. This paper aims to survey the research undertaken in the field of scheduling in big data platforms. Moreover, this paper analyzed scheduling in MapReduce on two aspects: taxonomy and performance evaluation. The research progress in MapReduce scheduling algorithms is also discussed. The limitations of existing MapReduce scheduling algorithms and exploit future research opportunities are pointed out in the paper for easy identification by researchers. Our study can serve as the benchmark to expert researchers for proposing a novel MapReduce scheduling algorithm. However, for novice researchers, the study can be used as a starting point. Springer 2020-07-01 Article PeerReviewed pdf en http://umpir.ump.edu.my/id/eprint/30281/1/MapReduce%20scheduling%20algorithms-%20a%20review.pdf pdf en http://umpir.ump.edu.my/id/eprint/30281/2/MapReduce%20scheduling%20algorithms-a%20review_FULL.pdf Hashem, Ibrahim Abaker Targio and Nor Badrul, Anuar and Marjani, Mohsen and Ahmed, Ejaz and Chiroma, Haruna and Ahmad Firdaus, Zainal Abidin and Muhamad Taufik, Abdullah and Faiz, Alotaibi and Mahmoud Ali, Waleed Kamaleldin and Yaqoob, Ibrar and Abdullah, Gani (2020) MapReduce scheduling algorithms: a review. Journal of Supercomputing, 76 (7). pp. 4915-4945. ISSN 0920-8542. (Published) https://doi.org/10.1007/s11227-018-2719-5 https://doi.org/10.1007/s11227-018-2719-5 |
| spellingShingle | QA76 Computer software Hashem, Ibrahim Abaker Targio Nor Badrul, Anuar Marjani, Mohsen Ahmed, Ejaz Chiroma, Haruna Ahmad Firdaus, Zainal Abidin Muhamad Taufik, Abdullah Faiz, Alotaibi Mahmoud Ali, Waleed Kamaleldin Yaqoob, Ibrar Abdullah, Gani MapReduce scheduling algorithms: a review |
| title | MapReduce scheduling algorithms: a review |
| title_full | MapReduce scheduling algorithms: a review |
| title_fullStr | MapReduce scheduling algorithms: a review |
| title_full_unstemmed | MapReduce scheduling algorithms: a review |
| title_short | MapReduce scheduling algorithms: a review |
| title_sort | mapreduce scheduling algorithms a review |
| topic | QA76 Computer software |
| url | http://umpir.ump.edu.my/id/eprint/30281/1/MapReduce%20scheduling%20algorithms-%20a%20review.pdf http://umpir.ump.edu.my/id/eprint/30281/2/MapReduce%20scheduling%20algorithms-a%20review_FULL.pdf |
| work_keys_str_mv | AT hashemibrahimabakertargio mapreduceschedulingalgorithmsareview AT norbadrulanuar mapreduceschedulingalgorithmsareview AT marjanimohsen mapreduceschedulingalgorithmsareview AT ahmedejaz mapreduceschedulingalgorithmsareview AT chiromaharuna mapreduceschedulingalgorithmsareview AT ahmadfirdauszainalabidin mapreduceschedulingalgorithmsareview AT muhamadtaufikabdullah mapreduceschedulingalgorithmsareview AT faizalotaibi mapreduceschedulingalgorithmsareview AT mahmoudaliwaleedkamaleldin mapreduceschedulingalgorithmsareview AT yaqoobibrar mapreduceschedulingalgorithmsareview AT abdullahgani mapreduceschedulingalgorithmsareview |