Conducting Empirical Studies to Evaluate a Technique to Inspect Software Testing Artifacts

Experimentation is becoming increasingly used in the Software Engineering field. Several methodologies adopt empirical studies as an instrument to support the software technologies’ conception and maturation. This paper presents the application of a methodology based on the conduction of primary stu...

Full description

Bibliographic Details
Main Authors: Jardelane Brito, Arilo Claudio Dias-Neto
Format: Article
Language:English
Published: Centro Latinoamericano de Estudios en Informática 2013-04-01
Series:CLEI Electronic Journal
Online Access:http://www.clei.org/cleiej-beta/index.php/cleiej/article/view/123
_version_ 1811317554073829376
author Jardelane Brito
Arilo Claudio Dias-Neto
author_facet Jardelane Brito
Arilo Claudio Dias-Neto
author_sort Jardelane Brito
collection DOAJ
description Experimentation is becoming increasingly used in the Software Engineering field. Several methodologies adopt empirical studies as an instrument to support the software technologies’ conception and maturation. This paper presents the application of a methodology based on the conduction of primary studies to develop a new checklist-based technique, named TestCheck, for inspection of software testing artifacts (test plan, cases, and procedures). Thus far, three empirical studies have been conducted (two feasibility studies and one observational study). The results of the first feasibility study indicate that TestCheck is more efficient and effective when detecting defects in software testing artifacts than an Ad-hoc approach. The results of the second feasibility study suggest an improvement in TestCheck regarding the defects detection and the reduction of the number of false positives per inspector. Finally, the results of the third study (observational study) evaluated positively the application of TestCheck by software engineers inspecting testing artifacts developed in an industrial environment. Thus, it would be qualified for the execution of the methodology’s next steps (case studies in the software industry).
first_indexed 2024-04-13T12:10:16Z
format Article
id doaj.art-2c107654bd0b4726b8d9454898037505
institution Directory Open Access Journal
issn 0717-5000
language English
last_indexed 2024-04-13T12:10:16Z
publishDate 2013-04-01
publisher Centro Latinoamericano de Estudios en Informática
record_format Article
series CLEI Electronic Journal
spelling doaj.art-2c107654bd0b4726b8d94548980375052022-12-22T02:47:30ZengCentro Latinoamericano de Estudios en InformáticaCLEI Electronic Journal0717-50002013-04-0116110.19153/cleiej.16.1.9Conducting Empirical Studies to Evaluate a Technique to Inspect Software Testing ArtifactsJardelane BritoArilo Claudio Dias-NetoExperimentation is becoming increasingly used in the Software Engineering field. Several methodologies adopt empirical studies as an instrument to support the software technologies’ conception and maturation. This paper presents the application of a methodology based on the conduction of primary studies to develop a new checklist-based technique, named TestCheck, for inspection of software testing artifacts (test plan, cases, and procedures). Thus far, three empirical studies have been conducted (two feasibility studies and one observational study). The results of the first feasibility study indicate that TestCheck is more efficient and effective when detecting defects in software testing artifacts than an Ad-hoc approach. The results of the second feasibility study suggest an improvement in TestCheck regarding the defects detection and the reduction of the number of false positives per inspector. Finally, the results of the third study (observational study) evaluated positively the application of TestCheck by software engineers inspecting testing artifacts developed in an industrial environment. Thus, it would be qualified for the execution of the methodology’s next steps (case studies in the software industry).http://www.clei.org/cleiej-beta/index.php/cleiej/article/view/123
spellingShingle Jardelane Brito
Arilo Claudio Dias-Neto
Conducting Empirical Studies to Evaluate a Technique to Inspect Software Testing Artifacts
CLEI Electronic Journal
title Conducting Empirical Studies to Evaluate a Technique to Inspect Software Testing Artifacts
title_full Conducting Empirical Studies to Evaluate a Technique to Inspect Software Testing Artifacts
title_fullStr Conducting Empirical Studies to Evaluate a Technique to Inspect Software Testing Artifacts
title_full_unstemmed Conducting Empirical Studies to Evaluate a Technique to Inspect Software Testing Artifacts
title_short Conducting Empirical Studies to Evaluate a Technique to Inspect Software Testing Artifacts
title_sort conducting empirical studies to evaluate a technique to inspect software testing artifacts
url http://www.clei.org/cleiej-beta/index.php/cleiej/article/view/123
work_keys_str_mv AT jardelanebrito conductingempiricalstudiestoevaluateatechniquetoinspectsoftwaretestingartifacts
AT ariloclaudiodiasneto conductingempiricalstudiestoevaluateatechniquetoinspectsoftwaretestingartifacts