Modeling and Analysis of Hadoop MapReduce Systems for Big Data Using Petri Nets

Information technological advances have significantly increased large volumes of corporate datasets, which have also created a wide range of business opportunities related to big data and cloud computing. Hadoop is a popular programming framework used for the setup of a cloud computing system. The M...

Full description

Bibliographic Details
Main Authors: Dai-Lun Chiang, Sheng-Kuan Wang, Yu-Ying Wang, Yi-Nan Lin, Tsang-Yen Hsieh, Cheng-Ying Yang, Victor R. L. Shen, Hung-Wei Ho
Format: Article
Language:English
Published: Taylor & Francis Group 2021-01-01
Series:Applied Artificial Intelligence
Online Access:http://dx.doi.org/10.1080/08839514.2020.1842111
_version_ 1797684862946115584
author Dai-Lun Chiang
Sheng-Kuan Wang
Yu-Ying Wang
Yi-Nan Lin
Tsang-Yen Hsieh
Cheng-Ying Yang
Victor R. L. Shen
Hung-Wei Ho
author_facet Dai-Lun Chiang
Sheng-Kuan Wang
Yu-Ying Wang
Yi-Nan Lin
Tsang-Yen Hsieh
Cheng-Ying Yang
Victor R. L. Shen
Hung-Wei Ho
author_sort Dai-Lun Chiang
collection DOAJ
description Information technological advances have significantly increased large volumes of corporate datasets, which have also created a wide range of business opportunities related to big data and cloud computing. Hadoop is a popular programming framework used for the setup of a cloud computing system. The MapReduce framework forms a core of the Hadoop program for parallel computing and its parallel framework can greatly increase the efficiency of big data analysis. This paper aims to adopt a Petri net (PN) to create a visual model of the MapReduce framework and to analyze its reachability property. We present a real big data analysis system to demonstrate the feasibility of the PN model, to describe the internal procedure of the MapReduce framework in detail, to list common errors and to propose an error prevention mechanism using the PN models in order to increase its efficiency in the system development.
first_indexed 2024-03-12T00:35:55Z
format Article
id doaj.art-2a2b4e94cdf54e578ef99c007627d936
institution Directory Open Access Journal
issn 0883-9514
1087-6545
language English
last_indexed 2024-03-12T00:35:55Z
publishDate 2021-01-01
publisher Taylor & Francis Group
record_format Article
series Applied Artificial Intelligence
spelling doaj.art-2a2b4e94cdf54e578ef99c007627d9362023-09-15T09:33:58ZengTaylor & Francis GroupApplied Artificial Intelligence0883-95141087-65452021-01-013518010410.1080/08839514.2020.18421111842111Modeling and Analysis of Hadoop MapReduce Systems for Big Data Using Petri NetsDai-Lun Chiang0Sheng-Kuan Wang1Yu-Ying Wang2Yi-Nan Lin3Tsang-Yen Hsieh4Cheng-Ying Yang5Victor R. L. Shen6Hung-Wei Ho7Ming Chuan UniversityMing Chi University of TechnologyJinwen University of Science and TechnologyMing Chi University of TechnologyMing Chi University of TechnologyUniversity of TaipeiChaoyang University of TechnologyInformation Engineering National Taipei UniversityInformation technological advances have significantly increased large volumes of corporate datasets, which have also created a wide range of business opportunities related to big data and cloud computing. Hadoop is a popular programming framework used for the setup of a cloud computing system. The MapReduce framework forms a core of the Hadoop program for parallel computing and its parallel framework can greatly increase the efficiency of big data analysis. This paper aims to adopt a Petri net (PN) to create a visual model of the MapReduce framework and to analyze its reachability property. We present a real big data analysis system to demonstrate the feasibility of the PN model, to describe the internal procedure of the MapReduce framework in detail, to list common errors and to propose an error prevention mechanism using the PN models in order to increase its efficiency in the system development.http://dx.doi.org/10.1080/08839514.2020.1842111
spellingShingle Dai-Lun Chiang
Sheng-Kuan Wang
Yu-Ying Wang
Yi-Nan Lin
Tsang-Yen Hsieh
Cheng-Ying Yang
Victor R. L. Shen
Hung-Wei Ho
Modeling and Analysis of Hadoop MapReduce Systems for Big Data Using Petri Nets
Applied Artificial Intelligence
title Modeling and Analysis of Hadoop MapReduce Systems for Big Data Using Petri Nets
title_full Modeling and Analysis of Hadoop MapReduce Systems for Big Data Using Petri Nets
title_fullStr Modeling and Analysis of Hadoop MapReduce Systems for Big Data Using Petri Nets
title_full_unstemmed Modeling and Analysis of Hadoop MapReduce Systems for Big Data Using Petri Nets
title_short Modeling and Analysis of Hadoop MapReduce Systems for Big Data Using Petri Nets
title_sort modeling and analysis of hadoop mapreduce systems for big data using petri nets
url http://dx.doi.org/10.1080/08839514.2020.1842111
work_keys_str_mv AT dailunchiang modelingandanalysisofhadoopmapreducesystemsforbigdatausingpetrinets
AT shengkuanwang modelingandanalysisofhadoopmapreducesystemsforbigdatausingpetrinets
AT yuyingwang modelingandanalysisofhadoopmapreducesystemsforbigdatausingpetrinets
AT yinanlin modelingandanalysisofhadoopmapreducesystemsforbigdatausingpetrinets
AT tsangyenhsieh modelingandanalysisofhadoopmapreducesystemsforbigdatausingpetrinets
AT chengyingyang modelingandanalysisofhadoopmapreducesystemsforbigdatausingpetrinets
AT victorrlshen modelingandanalysisofhadoopmapreducesystemsforbigdatausingpetrinets
AT hungweiho modelingandanalysisofhadoopmapreducesystemsforbigdatausingpetrinets