A Non-Intrusive Automated Testing System for Internet of Vehicles App Based on Deep Learning

In the non-intrusive automated testing system for Internet of Vehicles (IoV) applications, automatic recognition of text and icons on vehicle central control screens is of paramount importance. However, the detection and recognition of content on vehicle central control screens are inherently comple...

Full description

Bibliographic Details
Main Authors: Yanan Zhang, Zhen Guo, Tao Sun
Format: Article
Language:English
Published: MDPI AG 2023-06-01
Series:Electronics
Subjects:
Online Access:https://www.mdpi.com/2079-9292/12/13/2873
_version_ 1797591826469748736
author Yanan Zhang
Zhen Guo
Tao Sun
author_facet Yanan Zhang
Zhen Guo
Tao Sun
author_sort Yanan Zhang
collection DOAJ
description In the non-intrusive automated testing system for Internet of Vehicles (IoV) applications, automatic recognition of text and icons on vehicle central control screens is of paramount importance. However, the detection and recognition of content on vehicle central control screens are inherently complex. Additionally, during non-intrusive vehicle central control screen image testing, there is a deficiency of suitable datasets and detection methods. This deficiency renders information within vehicle application images difficult to be accurately extracted by the detection network. To address this problem, this study first constructs a dataset tailored for text detection and recognition on vehicle screens. This dataset encompasses a variety of vehicle central control images, enabling the generic text detection and recognition network to more effectively identify and interpret text within vehicle screens. Subsequently, this research proposes an enhanced Fully Convolutional Networks for Text Detection (FOTS) method for vehicle central control screen text detection and recognition. This method elevates the semantic expression capabilities of features by sharing vehicle central control screen text detection and recognition features. Furthermore, it improves multi-scale feature processing capabilities through the utilization of a feature transformation module. Validation through visual and quantitative experiments demonstrates that the proposed method can effectively accomplish text detection and recognition tasks on vehicle screens. This achievement bears significant implications for the field of automated testing in IoV applications.
first_indexed 2024-03-11T01:42:53Z
format Article
id doaj.art-5330bf6af3064bfcabcbf399f43b458f
institution Directory Open Access Journal
issn 2079-9292
language English
last_indexed 2024-03-11T01:42:53Z
publishDate 2023-06-01
publisher MDPI AG
record_format Article
series Electronics
spelling doaj.art-5330bf6af3064bfcabcbf399f43b458f2023-11-18T16:24:41ZengMDPI AGElectronics2079-92922023-06-011213287310.3390/electronics12132873A Non-Intrusive Automated Testing System for Internet of Vehicles App Based on Deep LearningYanan Zhang0Zhen Guo1Tao Sun2School of Mechanical Engineering, Tianjin University, No. 135 Yaguan Road, Haihe Education Park, Jinnan District, Tianjin 300354, ChinaChina Automotive Technology & Research Center Co., Ltd., Dongli District, Tianjin 300300, ChinaSchool of Mechanical Engineering, Tianjin University, No. 135 Yaguan Road, Haihe Education Park, Jinnan District, Tianjin 300354, ChinaIn the non-intrusive automated testing system for Internet of Vehicles (IoV) applications, automatic recognition of text and icons on vehicle central control screens is of paramount importance. However, the detection and recognition of content on vehicle central control screens are inherently complex. Additionally, during non-intrusive vehicle central control screen image testing, there is a deficiency of suitable datasets and detection methods. This deficiency renders information within vehicle application images difficult to be accurately extracted by the detection network. To address this problem, this study first constructs a dataset tailored for text detection and recognition on vehicle screens. This dataset encompasses a variety of vehicle central control images, enabling the generic text detection and recognition network to more effectively identify and interpret text within vehicle screens. Subsequently, this research proposes an enhanced Fully Convolutional Networks for Text Detection (FOTS) method for vehicle central control screen text detection and recognition. This method elevates the semantic expression capabilities of features by sharing vehicle central control screen text detection and recognition features. Furthermore, it improves multi-scale feature processing capabilities through the utilization of a feature transformation module. Validation through visual and quantitative experiments demonstrates that the proposed method can effectively accomplish text detection and recognition tasks on vehicle screens. This achievement bears significant implications for the field of automated testing in IoV applications.https://www.mdpi.com/2079-9292/12/13/2873non-intrusive testingdeep learningautomated testing
spellingShingle Yanan Zhang
Zhen Guo
Tao Sun
A Non-Intrusive Automated Testing System for Internet of Vehicles App Based on Deep Learning
Electronics
non-intrusive testing
deep learning
automated testing
title A Non-Intrusive Automated Testing System for Internet of Vehicles App Based on Deep Learning
title_full A Non-Intrusive Automated Testing System for Internet of Vehicles App Based on Deep Learning
title_fullStr A Non-Intrusive Automated Testing System for Internet of Vehicles App Based on Deep Learning
title_full_unstemmed A Non-Intrusive Automated Testing System for Internet of Vehicles App Based on Deep Learning
title_short A Non-Intrusive Automated Testing System for Internet of Vehicles App Based on Deep Learning
title_sort non intrusive automated testing system for internet of vehicles app based on deep learning
topic non-intrusive testing
deep learning
automated testing
url https://www.mdpi.com/2079-9292/12/13/2873
work_keys_str_mv AT yananzhang anonintrusiveautomatedtestingsystemforinternetofvehiclesappbasedondeeplearning
AT zhenguo anonintrusiveautomatedtestingsystemforinternetofvehiclesappbasedondeeplearning
AT taosun anonintrusiveautomatedtestingsystemforinternetofvehiclesappbasedondeeplearning
AT yananzhang nonintrusiveautomatedtestingsystemforinternetofvehiclesappbasedondeeplearning
AT zhenguo nonintrusiveautomatedtestingsystemforinternetofvehiclesappbasedondeeplearning
AT taosun nonintrusiveautomatedtestingsystemforinternetofvehiclesappbasedondeeplearning