Please use this identifier to cite or link to this item:
|Title:||Hardware implementation of a convolutional neural network using calculations in the residue number system|
|Authors:||Chervyakov, N. I.|
Червяков, Н. И.
Lyakhov, P. A.
Ляхов, П. А.
Nagornov, N. N.
Нагорнов, Н. Н.
Valueva, M. V.
Валуева, М. В.
Valuev, G. V.
Валуев, Г. В.
|Keywords:||Convolutional neural networks;Image processing;Pattern recognition;Residue number system (RNS);Security systems;Network architecture|
|Publisher:||Institution of Russian Academy of Sciences|
|Citation:||Chervyakov, N.I., Lyakhov, P.A., Nagornov, N.N., Valueva, M.V., Valuev, G.V. Hardware implementation of a convolutional neural network using calculations in the residue number system // Computer Optics. - 2019. - Volume 43. - Issue 5. - Pages 857-868|
|Series/Report no.:||Computer Optics|
|Abstract:||Modern convolutional neural networks architectures are very resource intensive which limits the possibilities for their wide practical application. We propose a convolutional neural network architecture in which the neural network is divided into hardware and software parts to increase performance and reduce the cost of implementation resources. We also propose to use the residue number system in the hardware part to implement the convolutional layer of the neural network for resource costs reducing. A numerical method for quantizing the filters coefficients of a convolu-tional network layer is proposed to minimize the influence of quantization noise on the calculation result in the residue number system and determine the bit-width of the filters coefficients. This method is based on scaling the coefficients by a fixed number of bits and rounding up and down. The operations used make it possible to reduce resources in hardware implementation due to the simplifying of their execution. All calculations in the convolutional layer are performed on numbers in a fixed-point format. Software simulations using Matlab 2017b showed that convolutional neural network with a minimum number of layers can be quickly and successfully trained. Hardware implementation using the field-programmable gate array Kintex7 xc7k70tfbg484-2 showed that the use of residue number system in the convolutional layer of the neural network reduces the hardware costs by 32.6% compared with the traditional approach based on the two’s complement representation. The research results can be applied to create effective video surveillance systems, for recognizing handwriting, individuals, objects and terrain|
|Appears in Collections:||Статьи, проиндексированные в SCOPUS, WOS|
Files in This Item:
|scopusresults 1080 .pdf||967.51 kB||Adobe PDF|
|WoS 715 .pdf||76.59 kB||Adobe PDF|
Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.