Please use this identifier to cite or link to this item: http://hdl.handle.net/20.500.12258/8604
Title: Hardware implementation of a convolutional neural network using calculations in the residue number system
Authors: Chervyakov, N. I.
Червяков, Н. И.
Lyakhov, P. A.
Ляхов, П. А.
Nagornov, N. N.
Нагорнов, Н. Н.
Valueva, M. V.
Валуева, М. В.
Valuev, G. V.
Валуев, Г. В.
Keywords: Convolutional neural networks;Image processing;Pattern recognition;Residue number system (RNS);Security systems;Network architecture
Issue Date: 2019
Publisher: Institution of Russian Academy of Sciences
Citation: Chervyakov, N.I., Lyakhov, P.A., Nagornov, N.N., Valueva, M.V., Valuev, G.V. Hardware implementation of a convolutional neural network using calculations in the residue number system // Computer Optics. - 2019. - Volume 43. - Issue 5. - Pages 857-868
Series/Report no.: Computer Optics
Abstract: Modern convolutional neural networks architectures are very resource intensive which limits the possibilities for their wide practical application. We propose a convolutional neural network architecture in which the neural network is divided into hardware and software parts to increase performance and reduce the cost of implementation resources. We also propose to use the residue number system in the hardware part to implement the convolutional layer of the neural network for resource costs reducing. A numerical method for quantizing the filters coefficients of a convolu-tional network layer is proposed to minimize the influence of quantization noise on the calculation result in the residue number system and determine the bit-width of the filters coefficients. This method is based on scaling the coefficients by a fixed number of bits and rounding up and down. The operations used make it possible to reduce resources in hardware implementation due to the simplifying of their execution. All calculations in the convolutional layer are performed on numbers in a fixed-point format. Software simulations using Matlab 2017b showed that convolutional neural network with a minimum number of layers can be quickly and successfully trained. Hardware implementation using the field-programmable gate array Kintex7 xc7k70tfbg484-2 showed that the use of residue number system in the convolutional layer of the neural network reduces the hardware costs by 32.6% compared with the traditional approach based on the two’s complement representation. The research results can be applied to create effective video surveillance systems, for recognizing handwriting, individuals, objects and terrain
URI: https://www.scopus.com/record/display.uri?eid=2-s2.0-85075043198&origin=resultslist&sort=plf-f&src=s&st1=Hardware+implementation+of+a+convolutional+neural+network+using+calculations+in+the+residue+number+system&st2=&sid=89f29b0d3c0c6fc7964e417a86d76dbf&sot=b&sdt=b&sl=120&s=TITLE-ABS-KEY%28Hardware+implementation+of+a+convolutional+neural+network+using+calculations+in+the+residue+number+system%29&relpos=0&citeCnt=0&searchTerm=
http://hdl.handle.net/20.500.12258/8604
Appears in Collections:Статьи, проиндексированные в SCOPUS, WOS

Files in This Item:
File Description SizeFormat 
scopusresults 1080 .pdf967.51 kBAdobe PDFThumbnail
View/Open
WoS 715 .pdf76.59 kBAdobe PDFThumbnail
View/Open


Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.