Deep neural network compression for artificial intelligent of Things (AIoT)

Stay cable is a very important part of a cable-stayed bridge. Structural Health Monitoring (SHM) is used for cable damage detection as the cable may fail due to external factors. A Long Short-Term Memory Fully Convolution Network (LSTM-FCN) method is used to detect cable damage by measuring cable fo...

Full description

Bibliographic Details
Main Author: Nur’ Aishah Binte Saddeli
Other Authors: Fu Yuguang
Format: Final Year Project (FYP)
Language:English
Published: Nanyang Technological University 2022
Subjects:
Online Access:https://hdl.handle.net/10356/163872
_version_ 1826129853953343488
author Nur’ Aishah Binte Saddeli
author2 Fu Yuguang
author_facet Fu Yuguang
Nur’ Aishah Binte Saddeli
author_sort Nur’ Aishah Binte Saddeli
collection NTU
description Stay cable is a very important part of a cable-stayed bridge. Structural Health Monitoring (SHM) is used for cable damage detection as the cable may fail due to external factors. A Long Short-Term Memory Fully Convolution Network (LSTM-FCN) method is used to detect cable damage by measuring cable forces by recognizing biased patterns from intact conditions. This would help solve the pattern recognition problem for cable damage detection through Time Series Classification (TSC). The TSC is trained and validated using data collected from the stay cables, setting the segmented data series as input and cable ID as class a label. Two series were investigated, and raw time series of cable and cable ratios were considered. Further reducing the size of the model, pruning is done through Constant Sparsity and Polynomial Decay and comparing the two to observe which would take up the smaller size while maintaining or improving accuracy. The model is further quantized after pruning to further compress its size for interference while making them faster and keeping as accurate as possible through Post-Training Quantization and Aware Training Quantization. An additional method of reducing size was also used such as Depthwise Separable Convolution 1D is used to replace Fully Convolution Network (FCN). This study proposes a methodology that would reduce the memory of models by sieving through redundant parameters to ensure better and faster interference while still maintaining or improving the accuracy of the model.
first_indexed 2024-10-01T07:47:00Z
format Final Year Project (FYP)
id ntu-10356/163872
institution Nanyang Technological University
language English
last_indexed 2024-10-01T07:47:00Z
publishDate 2022
publisher Nanyang Technological University
record_format dspace
spelling ntu-10356/1638722022-12-21T00:48:19Z Deep neural network compression for artificial intelligent of Things (AIoT) Nur’ Aishah Binte Saddeli Fu Yuguang School of Civil and Environmental Engineering yuguang.fu@ntu.edu.sg Engineering::Civil engineering Stay cable is a very important part of a cable-stayed bridge. Structural Health Monitoring (SHM) is used for cable damage detection as the cable may fail due to external factors. A Long Short-Term Memory Fully Convolution Network (LSTM-FCN) method is used to detect cable damage by measuring cable forces by recognizing biased patterns from intact conditions. This would help solve the pattern recognition problem for cable damage detection through Time Series Classification (TSC). The TSC is trained and validated using data collected from the stay cables, setting the segmented data series as input and cable ID as class a label. Two series were investigated, and raw time series of cable and cable ratios were considered. Further reducing the size of the model, pruning is done through Constant Sparsity and Polynomial Decay and comparing the two to observe which would take up the smaller size while maintaining or improving accuracy. The model is further quantized after pruning to further compress its size for interference while making them faster and keeping as accurate as possible through Post-Training Quantization and Aware Training Quantization. An additional method of reducing size was also used such as Depthwise Separable Convolution 1D is used to replace Fully Convolution Network (FCN). This study proposes a methodology that would reduce the memory of models by sieving through redundant parameters to ensure better and faster interference while still maintaining or improving the accuracy of the model. Bachelor of Engineering (Civil) 2022-12-21T00:48:19Z 2022-12-21T00:48:19Z 2023 Final Year Project (FYP) Nur’ Aishah Binte Saddeli (2023). Deep neural network compression for artificial intelligent of Things (AIoT). Final Year Project (FYP), Nanyang Technological University, Singapore. https://hdl.handle.net/10356/163872 https://hdl.handle.net/10356/163872 en https://doi.org/10.48550/arXiv.2101.03701 application/pdf Nanyang Technological University
spellingShingle Engineering::Civil engineering
Nur’ Aishah Binte Saddeli
Deep neural network compression for artificial intelligent of Things (AIoT)
title Deep neural network compression for artificial intelligent of Things (AIoT)
title_full Deep neural network compression for artificial intelligent of Things (AIoT)
title_fullStr Deep neural network compression for artificial intelligent of Things (AIoT)
title_full_unstemmed Deep neural network compression for artificial intelligent of Things (AIoT)
title_short Deep neural network compression for artificial intelligent of Things (AIoT)
title_sort deep neural network compression for artificial intelligent of things aiot
topic Engineering::Civil engineering
url https://hdl.handle.net/10356/163872
work_keys_str_mv AT nuraishahbintesaddeli deepneuralnetworkcompressionforartificialintelligentofthingsaiot