Extending ETL framework using service oriented architecture

Extraction, Transformation and Loading (ETL) represent a big portion of a data warehouse project. Complexity of components extensibility is a main problem in the ETL area, because ETL components are tightly-coupled to each others in the current ETL framework.The missing extensibility feature causes...

Full description

Bibliographic Details
Main Authors: Awad, Mohammed M I, Abdullah, Mohd Syazwan, Mat Ali, Abdul Bashah
Format: Article
Language:English
Published: Elsevier Ltd 2010
Subjects:
Online Access:https://repo.uum.edu.my/id/eprint/4318/1/Ex.pdf
_version_ 1803624839483752448
author Awad, Mohammed M I
Abdullah, Mohd Syazwan
Mat Ali, Abdul Bashah
author_facet Awad, Mohammed M I
Abdullah, Mohd Syazwan
Mat Ali, Abdul Bashah
author_sort Awad, Mohammed M I
collection UUM
description Extraction, Transformation and Loading (ETL) represent a big portion of a data warehouse project. Complexity of components extensibility is a main problem in the ETL area, because ETL components are tightly-coupled to each others in the current ETL framework.The missing extensibility feature causes impediments to add new components to the current ETL framework; to meet special business needs.This paper shows how to restructure the current ETL framework based on Service Oriented Architecture (SOA) to be easier to extend.This restructuring solution distributes the ETL into interoperable components. The distribution of Extraction, Transformation and Loading components while keeping interoperability amongst them; can be achieved by SOA.A Classified-Fragmentation component to enhance the report generation speed is added to the new framework; as a proof of the extensibility concept.The result of this work is an extensible ETL framework including Classified-Fragmentation component as an extension.
first_indexed 2024-07-04T05:24:45Z
format Article
id uum-4318
institution Universiti Utara Malaysia
language English
last_indexed 2024-07-04T05:24:45Z
publishDate 2010
publisher Elsevier Ltd
record_format dspace
spelling uum-43182012-02-15T02:14:03Z https://repo.uum.edu.my/id/eprint/4318/ Extending ETL framework using service oriented architecture Awad, Mohammed M I Abdullah, Mohd Syazwan Mat Ali, Abdul Bashah QA76 Computer software Extraction, Transformation and Loading (ETL) represent a big portion of a data warehouse project. Complexity of components extensibility is a main problem in the ETL area, because ETL components are tightly-coupled to each others in the current ETL framework.The missing extensibility feature causes impediments to add new components to the current ETL framework; to meet special business needs.This paper shows how to restructure the current ETL framework based on Service Oriented Architecture (SOA) to be easier to extend.This restructuring solution distributes the ETL into interoperable components. The distribution of Extraction, Transformation and Loading components while keeping interoperability amongst them; can be achieved by SOA.A Classified-Fragmentation component to enhance the report generation speed is added to the new framework; as a proof of the extensibility concept.The result of this work is an extensible ETL framework including Classified-Fragmentation component as an extension. Elsevier Ltd 2010 Article PeerReviewed application/pdf en https://repo.uum.edu.my/id/eprint/4318/1/Ex.pdf Awad, Mohammed M I and Abdullah, Mohd Syazwan and Mat Ali, Abdul Bashah (2010) Extending ETL framework using service oriented architecture. Procedia Computer Science, 3. pp. 110-114. ISSN 1877-0509 http://dx.doi.org/10.1016/j.procs.2010.12.019
spellingShingle QA76 Computer software
Awad, Mohammed M I
Abdullah, Mohd Syazwan
Mat Ali, Abdul Bashah
Extending ETL framework using service oriented architecture
title Extending ETL framework using service oriented architecture
title_full Extending ETL framework using service oriented architecture
title_fullStr Extending ETL framework using service oriented architecture
title_full_unstemmed Extending ETL framework using service oriented architecture
title_short Extending ETL framework using service oriented architecture
title_sort extending etl framework using service oriented architecture
topic QA76 Computer software
url https://repo.uum.edu.my/id/eprint/4318/1/Ex.pdf
work_keys_str_mv AT awadmohammedmi extendingetlframeworkusingserviceorientedarchitecture
AT abdullahmohdsyazwan extendingetlframeworkusingserviceorientedarchitecture
AT mataliabdulbashah extendingetlframeworkusingserviceorientedarchitecture