Technologies for implementing of artificial intelligence as a service based on hardware accelerators
The subject of study in this article is modern technologies, tools and methods of building AI systems as a service using FPGA as a platform. The goal is to analyze modern technologies and tools used to develop FPGA-based projects for systems that implement artificial intelligence as a service and to...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
National Aerospace University «Kharkiv Aviation Institute»
2022-11-01
|
| Series: | Авіаційно-космічна техніка та технологія |
| Subjects: | |
| Online Access: | http://nti.khai.edu/ojs/index.php/aktt/article/view/1853 |
| _version_ | 1827932200290484224 |
|---|---|
| author | Artem Perepelitsyn Yelyzaveta Kasapien Herman Fesenko Vyacheslav Kharchenko |
| author_facet | Artem Perepelitsyn Yelyzaveta Kasapien Herman Fesenko Vyacheslav Kharchenko |
| author_sort | Artem Perepelitsyn |
| collection | DOAJ |
| description | The subject of study in this article is modern technologies, tools and methods of building AI systems as a service using FPGA as a platform. The goal is to analyze modern technologies and tools used to develop FPGA-based projects for systems that implement artificial intelligence as a service and to prepare a practical AI service prototype. Task: to analyze the evolution of changes in the products of leading manufacturers of programmable logic devices and experimental and practical examples of the implementation of the paradigm of continuous reprogramming of programmable logic; analyze the dynamics of changes in the development environment of programmable logic systems for AI; analyze the essential elements of building projects for AI systems using programmable logic. According to the tasks, the following results were obtained. The area of application of hardware implementation of artificial intelligence for on-board and embedded systems including airspace industry, smart cars and medical systems is analyzed. The process of programming FPGA accelerators for AI projects is analyzed. The analysis of the capabilities of FPGA with HBM for building projects that require enough of high speed memory is performed. Description languages, frameworks, the hierarchy of tools for building of hardware accelerators for AI projects are analyzed in detail. The stages of prototyping of AI projects using new FPGA development tools and basic DPU blocks are analyzed. The parameters of the DPU blocks were analyzed. Practical steps for building such systems are offered. The practical recommendations for optimizing the neural network for FPGA implementation are given. The stages of neural network optimization are provided. The proposed steps include pruning of branches with low priority and the use of fixed point computations with custom range based on the requirements of an exact neural network. Based on these solutions, a practical case of AI service was prepared, trained and tested. Conclusions. The main contribution of this study is that, based on the proposed ideas and solutions, the next steps to create heterogeneous systems based on the combination of three elements are clear: AI as a service, FPGA accelerators as a technology for improving performance, reliability and security, and cloud or Edge resources to create FPGA infrastructure and AI as service. The development of this methodological and technological basis is the direction of further R&D. |
| first_indexed | 2024-03-13T07:06:19Z |
| format | Article |
| id | doaj.art-2f817f2b730f4ebb8102f027376dc2d2 |
| institution | Directory Open Access Journal |
| issn | 1727-7337 2663-2217 |
| language | English |
| last_indexed | 2024-03-13T07:06:19Z |
| publishDate | 2022-11-01 |
| publisher | National Aerospace University «Kharkiv Aviation Institute» |
| record_format | Article |
| series | Авіаційно-космічна техніка та технологія |
| spelling | doaj.art-2f817f2b730f4ebb8102f027376dc2d22023-06-06T10:25:22ZengNational Aerospace University «Kharkiv Aviation Institute»Авіаційно-космічна техніка та технологія1727-73372663-22172022-11-0106576510.32620/aktt.2022.6.071802Technologies for implementing of artificial intelligence as a service based on hardware acceleratorsArtem Perepelitsyn0Yelyzaveta Kasapien1Herman Fesenko2Vyacheslav Kharchenko3National Aerospace University «Kharkov Aviation Institute», KharkivNational Aerospace University «Kharkov Aviation Institute», KharkivNational Aerospace University «Kharkov Aviation Institute», KharkivNational Aerospace University «Kharkov Aviation Institute», KharkivThe subject of study in this article is modern technologies, tools and methods of building AI systems as a service using FPGA as a platform. The goal is to analyze modern technologies and tools used to develop FPGA-based projects for systems that implement artificial intelligence as a service and to prepare a practical AI service prototype. Task: to analyze the evolution of changes in the products of leading manufacturers of programmable logic devices and experimental and practical examples of the implementation of the paradigm of continuous reprogramming of programmable logic; analyze the dynamics of changes in the development environment of programmable logic systems for AI; analyze the essential elements of building projects for AI systems using programmable logic. According to the tasks, the following results were obtained. The area of application of hardware implementation of artificial intelligence for on-board and embedded systems including airspace industry, smart cars and medical systems is analyzed. The process of programming FPGA accelerators for AI projects is analyzed. The analysis of the capabilities of FPGA with HBM for building projects that require enough of high speed memory is performed. Description languages, frameworks, the hierarchy of tools for building of hardware accelerators for AI projects are analyzed in detail. The stages of prototyping of AI projects using new FPGA development tools and basic DPU blocks are analyzed. The parameters of the DPU blocks were analyzed. Practical steps for building such systems are offered. The practical recommendations for optimizing the neural network for FPGA implementation are given. The stages of neural network optimization are provided. The proposed steps include pruning of branches with low priority and the use of fixed point computations with custom range based on the requirements of an exact neural network. Based on these solutions, a practical case of AI service was prepared, trained and tested. Conclusions. The main contribution of this study is that, based on the proposed ideas and solutions, the next steps to create heterogeneous systems based on the combination of three elements are clear: AI as a service, FPGA accelerators as a technology for improving performance, reliability and security, and cloud or Edge resources to create FPGA infrastructure and AI as service. The development of this methodological and technological basis is the direction of further R&D.http://nti.khai.edu/ojs/index.php/aktt/article/view/1853штучний інтелектfpgaші як сервісгетерогенні проєкти ші системапаратні прискорювачі шіdpuінструментальні засоби розробки шіxrt |
| spellingShingle | Artem Perepelitsyn Yelyzaveta Kasapien Herman Fesenko Vyacheslav Kharchenko Technologies for implementing of artificial intelligence as a service based on hardware accelerators Авіаційно-космічна техніка та технологія штучний інтелект fpga ші як сервіс гетерогенні проєкти ші систем апаратні прискорювачі ші dpu інструментальні засоби розробки ші xrt |
| title | Technologies for implementing of artificial intelligence as a service based on hardware accelerators |
| title_full | Technologies for implementing of artificial intelligence as a service based on hardware accelerators |
| title_fullStr | Technologies for implementing of artificial intelligence as a service based on hardware accelerators |
| title_full_unstemmed | Technologies for implementing of artificial intelligence as a service based on hardware accelerators |
| title_short | Technologies for implementing of artificial intelligence as a service based on hardware accelerators |
| title_sort | technologies for implementing of artificial intelligence as a service based on hardware accelerators |
| topic | штучний інтелект fpga ші як сервіс гетерогенні проєкти ші систем апаратні прискорювачі ші dpu інструментальні засоби розробки ші xrt |
| url | http://nti.khai.edu/ojs/index.php/aktt/article/view/1853 |
| work_keys_str_mv | AT artemperepelitsyn technologiesforimplementingofartificialintelligenceasaservicebasedonhardwareaccelerators AT yelyzavetakasapien technologiesforimplementingofartificialintelligenceasaservicebasedonhardwareaccelerators AT hermanfesenko technologiesforimplementingofartificialintelligenceasaservicebasedonhardwareaccelerators AT vyacheslavkharchenko technologiesforimplementingofartificialintelligenceasaservicebasedonhardwareaccelerators |