Bipolar Morphological Neural Networks: Gate-Efficient Architecture for Computer Vision
The priority of building hardware-oriented neural network models is growing steadily. The target goals for their development are the performance and energy efficiency of promising hardware-software solutions. Simultaneously, for different classes of computing architectures of the computer, the optim...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2021-01-01
|
| Series: | IEEE Access |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/9474510/ |
| _version_ | 1819103027573817344 |
|---|---|
| author | Elena E. Limonova Daniil M. Alfonso Dmitry P. Nikolaev Vladimir V. Arlazarov |
| author_facet | Elena E. Limonova Daniil M. Alfonso Dmitry P. Nikolaev Vladimir V. Arlazarov |
| author_sort | Elena E. Limonova |
| collection | DOAJ |
| description | The priority of building hardware-oriented neural network models is growing steadily. The target goals for their development are the performance and energy efficiency of promising hardware-software solutions. Simultaneously, for different classes of computing architectures of the computer, the optimal neural network models will differ. The most interesting from a practical point of view are application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs) and central processing units (CPUs). We have recently proposed a bipolar morphological network as a hardware-oriented model for these computer types, the computationally intensive parts of which use only maximum and addition. In this work, we present for the first time a theoretical assessment of the expressive power of a neural network consisting of BM neurons and show that it corresponds to the expressive power of the classical multilayer perceptron. In addition, we summarize the current results on the use of the bipolar morphological model in typical tasks of technical vision: image classification and semantic segmentation. We consider simple LeNet-5-like neural networks, as well as deeper ResNet and UNet architectures. We show that BM networks demonstrate accuracy that allows their practical use, with significantly higher performance in terms of a transistor budget for two (ASIC, FPGA) of the three architectures under consideration. The source code of the model and ResNet experiments are available at <uri>https://github.com/SmartEngines/bipolar-morphological-resnet</uri>. |
| first_indexed | 2024-12-22T01:43:56Z |
| format | Article |
| id | doaj.art-42d20b175dbb4d85b892d716f9e71534 |
| institution | Directory Open Access Journal |
| issn | 2169-3536 |
| language | English |
| last_indexed | 2024-12-22T01:43:56Z |
| publishDate | 2021-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Access |
| spelling | doaj.art-42d20b175dbb4d85b892d716f9e715342022-12-21T18:43:07ZengIEEEIEEE Access2169-35362021-01-019975699758110.1109/ACCESS.2021.30944849474510Bipolar Morphological Neural Networks: Gate-Efficient Architecture for Computer VisionElena E. Limonova0https://orcid.org/0000-0001-7673-9109Daniil M. Alfonso1https://orcid.org/0000-0002-6228-2782Dmitry P. Nikolaev2https://orcid.org/0000-0001-5560-7668Vladimir V. Arlazarov3https://orcid.org/0000-0003-3260-9104FRC CSC RAS, Moscow, RussiaJSC MCST, Moscow, RussiaSmart Engines Service LLC, Moscow, RussiaFRC CSC RAS, Moscow, RussiaThe priority of building hardware-oriented neural network models is growing steadily. The target goals for their development are the performance and energy efficiency of promising hardware-software solutions. Simultaneously, for different classes of computing architectures of the computer, the optimal neural network models will differ. The most interesting from a practical point of view are application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs) and central processing units (CPUs). We have recently proposed a bipolar morphological network as a hardware-oriented model for these computer types, the computationally intensive parts of which use only maximum and addition. In this work, we present for the first time a theoretical assessment of the expressive power of a neural network consisting of BM neurons and show that it corresponds to the expressive power of the classical multilayer perceptron. In addition, we summarize the current results on the use of the bipolar morphological model in typical tasks of technical vision: image classification and semantic segmentation. We consider simple LeNet-5-like neural networks, as well as deeper ResNet and UNet architectures. We show that BM networks demonstrate accuracy that allows their practical use, with significantly higher performance in terms of a transistor budget for two (ASIC, FPGA) of the three architectures under consideration. The source code of the model and ResNet experiments are available at <uri>https://github.com/SmartEngines/bipolar-morphological-resnet</uri>.https://ieeexplore.ieee.org/document/9474510/ASICbipolar morphological networkscomputational complexityexpressive powerFPGA |
| spellingShingle | Elena E. Limonova Daniil M. Alfonso Dmitry P. Nikolaev Vladimir V. Arlazarov Bipolar Morphological Neural Networks: Gate-Efficient Architecture for Computer Vision IEEE Access ASIC bipolar morphological networks computational complexity expressive power FPGA |
| title | Bipolar Morphological Neural Networks: Gate-Efficient Architecture for Computer Vision |
| title_full | Bipolar Morphological Neural Networks: Gate-Efficient Architecture for Computer Vision |
| title_fullStr | Bipolar Morphological Neural Networks: Gate-Efficient Architecture for Computer Vision |
| title_full_unstemmed | Bipolar Morphological Neural Networks: Gate-Efficient Architecture for Computer Vision |
| title_short | Bipolar Morphological Neural Networks: Gate-Efficient Architecture for Computer Vision |
| title_sort | bipolar morphological neural networks gate efficient architecture for computer vision |
| topic | ASIC bipolar morphological networks computational complexity expressive power FPGA |
| url | https://ieeexplore.ieee.org/document/9474510/ |
| work_keys_str_mv | AT elenaelimonova bipolarmorphologicalneuralnetworksgateefficientarchitectureforcomputervision AT daniilmalfonso bipolarmorphologicalneuralnetworksgateefficientarchitectureforcomputervision AT dmitrypnikolaev bipolarmorphologicalneuralnetworksgateefficientarchitectureforcomputervision AT vladimirvarlazarov bipolarmorphologicalneuralnetworksgateefficientarchitectureforcomputervision |