Deep learning for UI testing

User Interface (UI) Testing of Android Applications has been greatly overlooked by many developers in the recent years despite proliferation in application usage. One of the reason is because of the inefficiency in undergoing UI tests to search for crashes despite the many benefits of doing so. This...

Full description

Bibliographic Details
Main Author: Koh, Hong Da
Other Authors: Liu Yang
Format: Final Year Project (FYP)
Language:English
Published: 2018
Subjects:
Online Access:http://hdl.handle.net/10356/74227
_version_ 1811678105124732928
author Koh, Hong Da
author2 Liu Yang
author_facet Liu Yang
Koh, Hong Da
author_sort Koh, Hong Da
collection NTU
description User Interface (UI) Testing of Android Applications has been greatly overlooked by many developers in the recent years despite proliferation in application usage. One of the reason is because of the inefficiency in undergoing UI tests to search for crashes despite the many benefits of doing so. This report seeks to improve the efficiency of UI testing while ensuring coverage remains high. To achieve this, we collect data from the many applications on Google Play, use them to train a deep learning model before determining the accuracy and correlation between underlying UI hierarchy data with exploration rates. We document various experiments done with four different training models: fastText from Facebook, Logistic Regression Model, Recurrent Neural Network (RNN) using the Long Short-Term Memory (LSTM) model as well as the Wide and Deep Model with the latter three using Tensorflow. We also document the design and implementation of the automated tool which is used in collecting data as well as the relevant data collected. Our results suggest an optimal accuracy of 85% when using both the Recurrent Neural Network Model and Wide and Deep Model. As for fast- Text and the Logistic Regression Model, our results show a poor correlation primarily because of the differences in data used.
first_indexed 2024-10-01T02:47:58Z
format Final Year Project (FYP)
id ntu-10356/74227
institution Nanyang Technological University
language English
last_indexed 2024-10-01T02:47:58Z
publishDate 2018
record_format dspace
spelling ntu-10356/742272023-03-03T20:37:36Z Deep learning for UI testing Koh, Hong Da Liu Yang School of Computer Science and Engineering DRNTU::Science::Medicine::Computer applications User Interface (UI) Testing of Android Applications has been greatly overlooked by many developers in the recent years despite proliferation in application usage. One of the reason is because of the inefficiency in undergoing UI tests to search for crashes despite the many benefits of doing so. This report seeks to improve the efficiency of UI testing while ensuring coverage remains high. To achieve this, we collect data from the many applications on Google Play, use them to train a deep learning model before determining the accuracy and correlation between underlying UI hierarchy data with exploration rates. We document various experiments done with four different training models: fastText from Facebook, Logistic Regression Model, Recurrent Neural Network (RNN) using the Long Short-Term Memory (LSTM) model as well as the Wide and Deep Model with the latter three using Tensorflow. We also document the design and implementation of the automated tool which is used in collecting data as well as the relevant data collected. Our results suggest an optimal accuracy of 85% when using both the Recurrent Neural Network Model and Wide and Deep Model. As for fast- Text and the Logistic Regression Model, our results show a poor correlation primarily because of the differences in data used. Bachelor of Engineering (Computer Science) 2018-05-11T01:57:39Z 2018-05-11T01:57:39Z 2018 Final Year Project (FYP) http://hdl.handle.net/10356/74227 en Nanyang Technological University 46 p. application/pdf
spellingShingle DRNTU::Science::Medicine::Computer applications
Koh, Hong Da
Deep learning for UI testing
title Deep learning for UI testing
title_full Deep learning for UI testing
title_fullStr Deep learning for UI testing
title_full_unstemmed Deep learning for UI testing
title_short Deep learning for UI testing
title_sort deep learning for ui testing
topic DRNTU::Science::Medicine::Computer applications
url http://hdl.handle.net/10356/74227
work_keys_str_mv AT kohhongda deeplearningforuitesting