Anomaly detection for controlling data accruracy in service industry

The purpose of this project is to investigate the application of anomaly detection, particularly control charts for individual sample, to control data quality of a risk management system in a financial industry. Four control charts are investigated, namely individual control chart, moving range (MR)...

Full description

Bibliographic Details
Main Author: Samsuddin, Nurul Asyikin
Format: Thesis
Published: 2013
Subjects:
_version_ 1796858044900966400
author Samsuddin, Nurul Asyikin
author_facet Samsuddin, Nurul Asyikin
author_sort Samsuddin, Nurul Asyikin
collection ePrints
description The purpose of this project is to investigate the application of anomaly detection, particularly control charts for individual sample, to control data quality of a risk management system in a financial industry. Four control charts are investigated, namely individual control chart, moving range (MR) control chart, moving average (MA) control chart and exponentially weighted moving average (EWMA) control chart. The quantitative and qualitative detection performance of these control charts is analyzed on two scenarios: live stream and data profiling. Results are compared with expected anomalies determined by system experts. It is discovered that individual control chart performed best for live stream scenario, while MR control chart performed best for data profiling scenario. Qualitatively control charts are simple, user-friendly and easy to fully automate and implement when compared with other detection methods available in literature. In addition, a suitable data quality assurance and control program using the two control charts is suggested
first_indexed 2024-03-05T19:06:49Z
format Thesis
id utm.eprints-41784
institution Universiti Teknologi Malaysia - ePrints
last_indexed 2024-03-05T19:06:49Z
publishDate 2013
record_format dspace
spelling utm.eprints-417842020-07-02T06:01:44Z http://eprints.utm.my/41784/ Anomaly detection for controlling data accruracy in service industry Samsuddin, Nurul Asyikin TK Electrical engineering. Electronics Nuclear engineering The purpose of this project is to investigate the application of anomaly detection, particularly control charts for individual sample, to control data quality of a risk management system in a financial industry. Four control charts are investigated, namely individual control chart, moving range (MR) control chart, moving average (MA) control chart and exponentially weighted moving average (EWMA) control chart. The quantitative and qualitative detection performance of these control charts is analyzed on two scenarios: live stream and data profiling. Results are compared with expected anomalies determined by system experts. It is discovered that individual control chart performed best for live stream scenario, while MR control chart performed best for data profiling scenario. Qualitatively control charts are simple, user-friendly and easy to fully automate and implement when compared with other detection methods available in literature. In addition, a suitable data quality assurance and control program using the two control charts is suggested 2013 Thesis NonPeerReviewed Samsuddin, Nurul Asyikin (2013) Anomaly detection for controlling data accruracy in service industry. Masters thesis, Universiti Teknologi Malaysia, Faculty of Mechanical Engineering. http://dms.library.utm.my:8080/vital/access/manager/Repository/vital:78059?queryType=vitalDismax&query=Anomaly+detection+for+controlling+data+accruracy&public=true
spellingShingle TK Electrical engineering. Electronics Nuclear engineering
Samsuddin, Nurul Asyikin
Anomaly detection for controlling data accruracy in service industry
title Anomaly detection for controlling data accruracy in service industry
title_full Anomaly detection for controlling data accruracy in service industry
title_fullStr Anomaly detection for controlling data accruracy in service industry
title_full_unstemmed Anomaly detection for controlling data accruracy in service industry
title_short Anomaly detection for controlling data accruracy in service industry
title_sort anomaly detection for controlling data accruracy in service industry
topic TK Electrical engineering. Electronics Nuclear engineering
work_keys_str_mv AT samsuddinnurulasyikin anomalydetectionforcontrollingdataaccruracyinserviceindustry