Computer vision optimization on embedded GPU board
Computer vision tasks such as image classification have prevalent use and are greatly aided by the development of deep learning techniques, in particular CNN. Performing such tasks on specialized embedded GPU boards can have intriguing prospects in edge computing development. In this study, popular...
| Main Author: | |
|---|---|
| Other Authors: | |
| Format: | Final Year Project (FYP) |
| Language: | English |
| Published: |
Nanyang Technological University
2022
|
| Subjects: | |
| Online Access: | https://hdl.handle.net/10356/156654 |
| _version_ | 1811686940664135680 |
|---|---|
| author | Li, Ziyang |
| author2 | Vun Chan Hua, Nicholas |
| author_facet | Vun Chan Hua, Nicholas Li, Ziyang |
| author_sort | Li, Ziyang |
| collection | NTU |
| description | Computer vision tasks such as image classification have prevalent use and are greatly aided by the development of deep learning techniques, in particular CNN. Performing such tasks on specialized embedded GPU boards can have intriguing prospects in edge computing development. In this study, popular CNN model architectures including GoogLeNet, ResNet and VGG were implemented on the new Jetson Xavier NX Developer Kit. The models are implemented using different deep learning frameworks including PyTorch, TensorFlow and Caffe, the latter involving TensorRT, the Nvidia optimization tool for inference model. The model implementations were evaluated based on various metrics including timing and resource utilization and the results were compared. This study draws the conclusion that DL-based computer vision tasks are compute-bound even on more powerful GPU devices, and the choice of frameworks has a significant effect on the performance of the inference task. In particular, TensorRT produces very significant improvement in terms of inference timing, and scales well across model architecture and model depth. |
| first_indexed | 2024-10-01T05:08:24Z |
| format | Final Year Project (FYP) |
| id | ntu-10356/156654 |
| institution | Nanyang Technological University |
| language | English |
| last_indexed | 2024-10-01T05:08:24Z |
| publishDate | 2022 |
| publisher | Nanyang Technological University |
| record_format | dspace |
| spelling | ntu-10356/1566542022-04-22T01:41:24Z Computer vision optimization on embedded GPU board Li, Ziyang Vun Chan Hua, Nicholas School of Computer Science and Engineering ASCHVUN@ntu.edu.sg Engineering::Computer science and engineering::Computing methodologies::Image processing and computer vision Computer vision tasks such as image classification have prevalent use and are greatly aided by the development of deep learning techniques, in particular CNN. Performing such tasks on specialized embedded GPU boards can have intriguing prospects in edge computing development. In this study, popular CNN model architectures including GoogLeNet, ResNet and VGG were implemented on the new Jetson Xavier NX Developer Kit. The models are implemented using different deep learning frameworks including PyTorch, TensorFlow and Caffe, the latter involving TensorRT, the Nvidia optimization tool for inference model. The model implementations were evaluated based on various metrics including timing and resource utilization and the results were compared. This study draws the conclusion that DL-based computer vision tasks are compute-bound even on more powerful GPU devices, and the choice of frameworks has a significant effect on the performance of the inference task. In particular, TensorRT produces very significant improvement in terms of inference timing, and scales well across model architecture and model depth. Bachelor of Engineering (Computer Engineering) 2022-04-22T01:41:24Z 2022-04-22T01:41:24Z 2022 Final Year Project (FYP) Li, Z. (2022). Computer vision optimization on embedded GPU board. Final Year Project (FYP), Nanyang Technological University, Singapore. https://hdl.handle.net/10356/156654 https://hdl.handle.net/10356/156654 en SCSE21-0325 application/pdf Nanyang Technological University |
| spellingShingle | Engineering::Computer science and engineering::Computing methodologies::Image processing and computer vision Li, Ziyang Computer vision optimization on embedded GPU board |
| title | Computer vision optimization on embedded GPU board |
| title_full | Computer vision optimization on embedded GPU board |
| title_fullStr | Computer vision optimization on embedded GPU board |
| title_full_unstemmed | Computer vision optimization on embedded GPU board |
| title_short | Computer vision optimization on embedded GPU board |
| title_sort | computer vision optimization on embedded gpu board |
| topic | Engineering::Computer science and engineering::Computing methodologies::Image processing and computer vision |
| url | https://hdl.handle.net/10356/156654 |
| work_keys_str_mv | AT liziyang computervisionoptimizationonembeddedgpuboard |