Developing a Data Quality Evaluation Framework for Sewer Inspection Data
The increasing amount of data and the growing use of them in the information era have raised questions about the quality of data and its impact on the decision-making process. Currently, the importance of high-quality data is widely recognized by researchers and decision-makers. Sewer inspection dat...
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2023-05-01
|
| Series: | Water |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2073-4441/15/11/2043 |
| _version_ | 1797596735975981056 |
|---|---|
| author | Hossein Khaleghian Yongwei Shan |
| author_facet | Hossein Khaleghian Yongwei Shan |
| author_sort | Hossein Khaleghian |
| collection | DOAJ |
| description | The increasing amount of data and the growing use of them in the information era have raised questions about the quality of data and its impact on the decision-making process. Currently, the importance of high-quality data is widely recognized by researchers and decision-makers. Sewer inspection data have been collected for over three decades, but the reliability of the data was questionable. It was estimated that between 25% and 50% of sewer inspection data is not usable due to data quality problems. In order to address reliability problems, a data quality evaluation framework is developed. Data quality evaluation is a multi-dimensional concept that includes both subjective perceptions and objective measurements. Five data quality metrics were defined to assess different quality dimensions of the sewer inspection data, including Accuracy, Consistency, Completeness, Uniqueness, and Validity. These data quality metrics were calculated for the collected sewer inspection data, and it was found that consistency and uniqueness are the major problems based on the current practices with sewer pipeline inspection. This paper contributes to the overall body of knowledge by providing a robust data quality evaluation framework for sewer system data for the first time, which will result in quality data for sewer asset management. |
| first_indexed | 2024-03-11T02:54:19Z |
| format | Article |
| id | doaj.art-f6c0fdf70ebd441e80331f6927e167cd |
| institution | Directory Open Access Journal |
| issn | 2073-4441 |
| language | English |
| last_indexed | 2024-03-11T02:54:19Z |
| publishDate | 2023-05-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Water |
| spelling | doaj.art-f6c0fdf70ebd441e80331f6927e167cd2023-11-18T08:46:49ZengMDPI AGWater2073-44412023-05-011511204310.3390/w15112043Developing a Data Quality Evaluation Framework for Sewer Inspection DataHossein KhaleghianYongwei ShanThe increasing amount of data and the growing use of them in the information era have raised questions about the quality of data and its impact on the decision-making process. Currently, the importance of high-quality data is widely recognized by researchers and decision-makers. Sewer inspection data have been collected for over three decades, but the reliability of the data was questionable. It was estimated that between 25% and 50% of sewer inspection data is not usable due to data quality problems. In order to address reliability problems, a data quality evaluation framework is developed. Data quality evaluation is a multi-dimensional concept that includes both subjective perceptions and objective measurements. Five data quality metrics were defined to assess different quality dimensions of the sewer inspection data, including Accuracy, Consistency, Completeness, Uniqueness, and Validity. These data quality metrics were calculated for the collected sewer inspection data, and it was found that consistency and uniqueness are the major problems based on the current practices with sewer pipeline inspection. This paper contributes to the overall body of knowledge by providing a robust data quality evaluation framework for sewer system data for the first time, which will result in quality data for sewer asset management.https://www.mdpi.com/2073-4441/15/11/2043data qualitysewer infrastructurepipeline assessment certification programsewer asset management |
| spellingShingle | Hossein Khaleghian Yongwei Shan Developing a Data Quality Evaluation Framework for Sewer Inspection Data Water data quality sewer infrastructure pipeline assessment certification program sewer asset management |
| title | Developing a Data Quality Evaluation Framework for Sewer Inspection Data |
| title_full | Developing a Data Quality Evaluation Framework for Sewer Inspection Data |
| title_fullStr | Developing a Data Quality Evaluation Framework for Sewer Inspection Data |
| title_full_unstemmed | Developing a Data Quality Evaluation Framework for Sewer Inspection Data |
| title_short | Developing a Data Quality Evaluation Framework for Sewer Inspection Data |
| title_sort | developing a data quality evaluation framework for sewer inspection data |
| topic | data quality sewer infrastructure pipeline assessment certification program sewer asset management |
| url | https://www.mdpi.com/2073-4441/15/11/2043 |
| work_keys_str_mv | AT hosseinkhaleghian developingadataqualityevaluationframeworkforsewerinspectiondata AT yongweishan developingadataqualityevaluationframeworkforsewerinspectiondata |