USING THE AGGREGATED CRITERIA TO EVALUATE THE SOFTWARE TESTS QUALITY
An approach to evaluating the software tests quality using aggregated quality criteria is proposed. The article considers the finding of such characteristics of software tests that can be used to judge their quality and their need for improvement. The subject of the study is the formation of a softw...
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
National Technical University Kharkiv Polytechnic Institute
2019-11-01
|
| Series: | Вісник Національного технічного університету "ХПÌ": Системний аналіз, управління та інформаційні технології |
| Subjects: | |
| Online Access: | http://samit.khpi.edu.ua/article/view/183453 |
| _version_ | 1797935762804572160 |
|---|---|
| author | Iryna Victorivna Liutenko Oleksii Igorovych Kurasov Daryna Andriivna Lukinova Svitlana Ivanivna Yershova Anastasiia Oleksandrivna Semanyk |
| author_facet | Iryna Victorivna Liutenko Oleksii Igorovych Kurasov Daryna Andriivna Lukinova Svitlana Ivanivna Yershova Anastasiia Oleksandrivna Semanyk |
| author_sort | Iryna Victorivna Liutenko |
| collection | DOAJ |
| description | An approach to evaluating the software tests quality using aggregated quality criteria is proposed. The article considers the finding of such characteristics of software tests that can be used to judge their quality and their need for improvement. The subject of the study is the formation of a software tests quality evaluation system, which can be used in the software development process. It is proposed to consider a software test as a multiattribute object. It is emphasized that it is necessary to take into account both quantitative and qualitative characteristics of tests and test coverage, which greatly complicates the construction of a model for evaluating the software tests quality. Various approaches to solving the problem of evaluating complex, multiattribute objects are considered. The problem of comparing and ordering complex objects taking into account different criteria is considered. The choice of the method of sequential aggregation of classified states to solve the problem of multi-criteria selection and assessment is justified. The stages of the procedure for solving the estimation problem using the method of sequential aggregation of classified states are considered. An activity diagram is constructed that reflects an algorithm for constructing a hierarchical system of criteria. The criteria for evaluating software tests are given, which belong to three groups - efficiency, coverage, and software implementation. For a hierarchical system of criteria aggregation, a set of indicators, their qualitative gradations with corresponding numerical intervals, are allocated. At the highest level of the hierarchy, it is proposed to use three composite criteria that correspond to the groups of efficiency, coverage and implementation, which will allow to obtain an integral indicator of the software tests quality. The resulting integral indicator includes five quality classes, each of which corresponds to a multitude of low-level indicator estimates. Tests quality evaluation will improve the testing process, which purpose is to ensure the specified quality of the software being developed. |
| first_indexed | 2024-04-10T18:19:13Z |
| format | Article |
| id | doaj.art-841cc097285d43db9bbd8a3c43a18be6 |
| institution | Directory Open Access Journal |
| issn | 2079-0023 2410-2857 |
| language | English |
| last_indexed | 2024-04-10T18:19:13Z |
| publishDate | 2019-11-01 |
| publisher | National Technical University Kharkiv Polytechnic Institute |
| record_format | Article |
| series | Вісник Національного технічного університету "ХПÌ": Системний аналіз, управління та інформаційні технології |
| spelling | doaj.art-841cc097285d43db9bbd8a3c43a18be62023-02-02T07:34:46ZengNational Technical University Kharkiv Polytechnic InstituteВісник Національного технічного університету "ХПÌ": Системний аналіз, управління та інформаційні технології2079-00232410-28572019-11-012707510.20998/2079-0023.2019.02.12172454USING THE AGGREGATED CRITERIA TO EVALUATE THE SOFTWARE TESTS QUALITYIryna Victorivna Liutenkohttps://orcid.org/0000-0003-4357-1826Oleksii Igorovych Kurasovhttps://orcid.org/0000-0003-2518-577XDaryna Andriivna Lukinovahttps://orcid.org/0000-0002-3644-9972Svitlana Ivanivna Yershovahttps://orcid.org/0000-0003-3893-117XAnastasiia Oleksandrivna Semanykhttps://orcid.org/0000-0003-0653-5359An approach to evaluating the software tests quality using aggregated quality criteria is proposed. The article considers the finding of such characteristics of software tests that can be used to judge their quality and their need for improvement. The subject of the study is the formation of a software tests quality evaluation system, which can be used in the software development process. It is proposed to consider a software test as a multiattribute object. It is emphasized that it is necessary to take into account both quantitative and qualitative characteristics of tests and test coverage, which greatly complicates the construction of a model for evaluating the software tests quality. Various approaches to solving the problem of evaluating complex, multiattribute objects are considered. The problem of comparing and ordering complex objects taking into account different criteria is considered. The choice of the method of sequential aggregation of classified states to solve the problem of multi-criteria selection and assessment is justified. The stages of the procedure for solving the estimation problem using the method of sequential aggregation of classified states are considered. An activity diagram is constructed that reflects an algorithm for constructing a hierarchical system of criteria. The criteria for evaluating software tests are given, which belong to three groups - efficiency, coverage, and software implementation. For a hierarchical system of criteria aggregation, a set of indicators, their qualitative gradations with corresponding numerical intervals, are allocated. At the highest level of the hierarchy, it is proposed to use three composite criteria that correspond to the groups of efficiency, coverage and implementation, which will allow to obtain an integral indicator of the software tests quality. The resulting integral indicator includes five quality classes, each of which corresponds to a multitude of low-level indicator estimates. Tests quality evaluation will improve the testing process, which purpose is to ensure the specified quality of the software being developed.http://samit.khpi.edu.ua/article/view/183453softwaretestingqualityevaluationassessment criteriamultiattribute objectaggregated criterion |
| spellingShingle | Iryna Victorivna Liutenko Oleksii Igorovych Kurasov Daryna Andriivna Lukinova Svitlana Ivanivna Yershova Anastasiia Oleksandrivna Semanyk USING THE AGGREGATED CRITERIA TO EVALUATE THE SOFTWARE TESTS QUALITY Вісник Національного технічного університету "ХПÌ": Системний аналіз, управління та інформаційні технології software testing quality evaluation assessment criteria multiattribute object aggregated criterion |
| title | USING THE AGGREGATED CRITERIA TO EVALUATE THE SOFTWARE TESTS QUALITY |
| title_full | USING THE AGGREGATED CRITERIA TO EVALUATE THE SOFTWARE TESTS QUALITY |
| title_fullStr | USING THE AGGREGATED CRITERIA TO EVALUATE THE SOFTWARE TESTS QUALITY |
| title_full_unstemmed | USING THE AGGREGATED CRITERIA TO EVALUATE THE SOFTWARE TESTS QUALITY |
| title_short | USING THE AGGREGATED CRITERIA TO EVALUATE THE SOFTWARE TESTS QUALITY |
| title_sort | using the aggregated criteria to evaluate the software tests quality |
| topic | software testing quality evaluation assessment criteria multiattribute object aggregated criterion |
| url | http://samit.khpi.edu.ua/article/view/183453 |
| work_keys_str_mv | AT irynavictorivnaliutenko usingtheaggregatedcriteriatoevaluatethesoftwaretestsquality AT oleksiiigorovychkurasov usingtheaggregatedcriteriatoevaluatethesoftwaretestsquality AT darynaandriivnalukinova usingtheaggregatedcriteriatoevaluatethesoftwaretestsquality AT svitlanaivanivnayershova usingtheaggregatedcriteriatoevaluatethesoftwaretestsquality AT anastasiiaoleksandrivnasemanyk usingtheaggregatedcriteriatoevaluatethesoftwaretestsquality |