Modeling and Analysis of Hadoop MapReduce Systems for Big Data Using Petri Nets
Information technological advances have significantly increased large volumes of corporate datasets, which have also created a wide range of business opportunities related to big data and cloud computing. Hadoop is a popular programming framework used for the setup of a cloud computing system. The M...
Main Authors: | , , , , , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
Taylor & Francis Group
2021-01-01
|
Series: | Applied Artificial Intelligence |
Online Access: | http://dx.doi.org/10.1080/08839514.2020.1842111 |
_version_ | 1797684862946115584 |
---|---|
author | Dai-Lun Chiang Sheng-Kuan Wang Yu-Ying Wang Yi-Nan Lin Tsang-Yen Hsieh Cheng-Ying Yang Victor R. L. Shen Hung-Wei Ho |
author_facet | Dai-Lun Chiang Sheng-Kuan Wang Yu-Ying Wang Yi-Nan Lin Tsang-Yen Hsieh Cheng-Ying Yang Victor R. L. Shen Hung-Wei Ho |
author_sort | Dai-Lun Chiang |
collection | DOAJ |
description | Information technological advances have significantly increased large volumes of corporate datasets, which have also created a wide range of business opportunities related to big data and cloud computing. Hadoop is a popular programming framework used for the setup of a cloud computing system. The MapReduce framework forms a core of the Hadoop program for parallel computing and its parallel framework can greatly increase the efficiency of big data analysis. This paper aims to adopt a Petri net (PN) to create a visual model of the MapReduce framework and to analyze its reachability property. We present a real big data analysis system to demonstrate the feasibility of the PN model, to describe the internal procedure of the MapReduce framework in detail, to list common errors and to propose an error prevention mechanism using the PN models in order to increase its efficiency in the system development. |
first_indexed | 2024-03-12T00:35:55Z |
format | Article |
id | doaj.art-2a2b4e94cdf54e578ef99c007627d936 |
institution | Directory Open Access Journal |
issn | 0883-9514 1087-6545 |
language | English |
last_indexed | 2024-03-12T00:35:55Z |
publishDate | 2021-01-01 |
publisher | Taylor & Francis Group |
record_format | Article |
series | Applied Artificial Intelligence |
spelling | doaj.art-2a2b4e94cdf54e578ef99c007627d9362023-09-15T09:33:58ZengTaylor & Francis GroupApplied Artificial Intelligence0883-95141087-65452021-01-013518010410.1080/08839514.2020.18421111842111Modeling and Analysis of Hadoop MapReduce Systems for Big Data Using Petri NetsDai-Lun Chiang0Sheng-Kuan Wang1Yu-Ying Wang2Yi-Nan Lin3Tsang-Yen Hsieh4Cheng-Ying Yang5Victor R. L. Shen6Hung-Wei Ho7Ming Chuan UniversityMing Chi University of TechnologyJinwen University of Science and TechnologyMing Chi University of TechnologyMing Chi University of TechnologyUniversity of TaipeiChaoyang University of TechnologyInformation Engineering National Taipei UniversityInformation technological advances have significantly increased large volumes of corporate datasets, which have also created a wide range of business opportunities related to big data and cloud computing. Hadoop is a popular programming framework used for the setup of a cloud computing system. The MapReduce framework forms a core of the Hadoop program for parallel computing and its parallel framework can greatly increase the efficiency of big data analysis. This paper aims to adopt a Petri net (PN) to create a visual model of the MapReduce framework and to analyze its reachability property. We present a real big data analysis system to demonstrate the feasibility of the PN model, to describe the internal procedure of the MapReduce framework in detail, to list common errors and to propose an error prevention mechanism using the PN models in order to increase its efficiency in the system development.http://dx.doi.org/10.1080/08839514.2020.1842111 |
spellingShingle | Dai-Lun Chiang Sheng-Kuan Wang Yu-Ying Wang Yi-Nan Lin Tsang-Yen Hsieh Cheng-Ying Yang Victor R. L. Shen Hung-Wei Ho Modeling and Analysis of Hadoop MapReduce Systems for Big Data Using Petri Nets Applied Artificial Intelligence |
title | Modeling and Analysis of Hadoop MapReduce Systems for Big Data Using Petri Nets |
title_full | Modeling and Analysis of Hadoop MapReduce Systems for Big Data Using Petri Nets |
title_fullStr | Modeling and Analysis of Hadoop MapReduce Systems for Big Data Using Petri Nets |
title_full_unstemmed | Modeling and Analysis of Hadoop MapReduce Systems for Big Data Using Petri Nets |
title_short | Modeling and Analysis of Hadoop MapReduce Systems for Big Data Using Petri Nets |
title_sort | modeling and analysis of hadoop mapreduce systems for big data using petri nets |
url | http://dx.doi.org/10.1080/08839514.2020.1842111 |
work_keys_str_mv | AT dailunchiang modelingandanalysisofhadoopmapreducesystemsforbigdatausingpetrinets AT shengkuanwang modelingandanalysisofhadoopmapreducesystemsforbigdatausingpetrinets AT yuyingwang modelingandanalysisofhadoopmapreducesystemsforbigdatausingpetrinets AT yinanlin modelingandanalysisofhadoopmapreducesystemsforbigdatausingpetrinets AT tsangyenhsieh modelingandanalysisofhadoopmapreducesystemsforbigdatausingpetrinets AT chengyingyang modelingandanalysisofhadoopmapreducesystemsforbigdatausingpetrinets AT victorrlshen modelingandanalysisofhadoopmapreducesystemsforbigdatausingpetrinets AT hungweiho modelingandanalysisofhadoopmapreducesystemsforbigdatausingpetrinets |