An overview of outlier detection methods
Outlier detection is a necessary task; in many safety critical environments such as aircraft engine rotation failure, factory production line, network intrusion, and bust analysis. Most proposed methods are based on distance and density based outlier detection which simply detects outliers by calcul...
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Penerbit UTM Press
2008
|
| Subjects: | |
| Online Access: | http://eprints.utm.my/39/1/MohdNoorMdSap2008_AnOverviewofOutlierDetectionMethods-.pdf |
| _version_ | 1796853026590294016 |
|---|---|
| author | Md. Sap, Mohd. Noor Mohebi, Ehsan |
| author_facet | Md. Sap, Mohd. Noor Mohebi, Ehsan |
| author_sort | Md. Sap, Mohd. Noor |
| collection | ePrints |
| description | Outlier detection is a necessary task; in many safety critical environments such as aircraft engine rotation failure, factory production line, network intrusion, and bust analysis. Most proposed methods are based on distance and density based outlier detection which simply detects outliers by calculating distances or density between the data points. In high dimensional datasets, it's very difficult to find outliers with the measure of distance or density methods, because in such spaces the data become sparse and the imagination of data distribution is also hard. So with the curse of dimensionality we discuss a cluster based method that examines the behavior of the data in low dimensional projection. On the other hand most existing methods detect outliers with some parameters that needed to be defined by users in advance. In some cases it is very difficult for users to define these parameters. To solve such problems, example based method has been proposed. In this paper, wide and different modem technologies of outlier detection will be considered. |
| first_indexed | 2024-03-05T17:53:35Z |
| format | Article |
| id | utm.eprints-39 |
| institution | Universiti Teknologi Malaysia - ePrints |
| language | English |
| last_indexed | 2024-03-05T17:53:35Z |
| publishDate | 2008 |
| publisher | Penerbit UTM Press |
| record_format | dspace |
| spelling | utm.eprints-392017-11-01T04:17:24Z http://eprints.utm.my/39/ An overview of outlier detection methods Md. Sap, Mohd. Noor Mohebi, Ehsan VM Naval architecture. Shipbuilding. Marine engineering Outlier detection is a necessary task; in many safety critical environments such as aircraft engine rotation failure, factory production line, network intrusion, and bust analysis. Most proposed methods are based on distance and density based outlier detection which simply detects outliers by calculating distances or density between the data points. In high dimensional datasets, it's very difficult to find outliers with the measure of distance or density methods, because in such spaces the data become sparse and the imagination of data distribution is also hard. So with the curse of dimensionality we discuss a cluster based method that examines the behavior of the data in low dimensional projection. On the other hand most existing methods detect outliers with some parameters that needed to be defined by users in advance. In some cases it is very difficult for users to define these parameters. To solve such problems, example based method has been proposed. In this paper, wide and different modem technologies of outlier detection will be considered. Penerbit UTM Press 2008 Article PeerReviewed application/pdf en http://eprints.utm.my/39/1/MohdNoorMdSap2008_AnOverviewofOutlierDetectionMethods-.pdf Md. Sap, Mohd. Noor and Mohebi, Ehsan (2008) An overview of outlier detection methods. Jurnal Teknologi Maklumat, 20 (1). pp. 87-105. ISSN 0128-3790 |
| spellingShingle | VM Naval architecture. Shipbuilding. Marine engineering Md. Sap, Mohd. Noor Mohebi, Ehsan An overview of outlier detection methods |
| title | An overview of outlier detection methods |
| title_full | An overview of outlier detection methods |
| title_fullStr | An overview of outlier detection methods |
| title_full_unstemmed | An overview of outlier detection methods |
| title_short | An overview of outlier detection methods |
| title_sort | overview of outlier detection methods |
| topic | VM Naval architecture. Shipbuilding. Marine engineering |
| url | http://eprints.utm.my/39/1/MohdNoorMdSap2008_AnOverviewofOutlierDetectionMethods-.pdf |
| work_keys_str_mv | AT mdsapmohdnoor anoverviewofoutlierdetectionmethods AT mohebiehsan anoverviewofoutlierdetectionmethods AT mdsapmohdnoor overviewofoutlierdetectionmethods AT mohebiehsan overviewofoutlierdetectionmethods |