Please use this identifier to cite or link to this item:
https://dspace.ncfu.ru/handle/20.500.12258/14736
Title: | Search for the global extremum using the correlation indicator for neural networks supervised learning |
Authors: | Vershkov, N. A. Вершков, Н. А. Babenko, M. G. Бабенко, М. Г. Kuchukov, V. A. Кучуков, В. А. Kuchukova, N. N. Кучукова, Н. Н. |
Keywords: | Data communication systems;Least squares approximations;Comparative analysis;Correlation function;Effective analysis;Neural networks |
Issue Date: | 2020 |
Publisher: | Pleiades journals |
Citation: | Vershkov, N., Babenko, M., Kuchukov, V., Kuchukova, N. Search for the global extremum using the correlation indicator for neural networks supervised learning // Programming and Computer Software. - 2020. - Volume 46. - Issue 8. - Pages 609-618 |
Series/Report no.: | Programming and Computer Software |
Abstract: | The article discusses the search for a global extremum in the training of artificial neural networks using a correlation indicator. A method based on a mathematical model of an artificial neural network presented as an information transmission system is proposed. Drawing attention to the fact that in information transmission systems widely used methods that allow effective analysis and recovery of useful signal against the background of various interferences: Gaussian, concentrated, pulsed, etc., it is possible to make an assumption about the effectiveness of the mathematical model of artificial neural network, presented as a system of information transmission. The article analyzes the convergence of training and experimentally obtained sequences based on a correlation indicator for fully-connected neural network. The possibility of estimating the convergence of the training and experimentally obtained sequences based on the joint correlation function as a measure of their energy similarity (difference) is confirmed. To evaluate the proposed method, a comparative analysis is made with the currently used indicators. The potential sources of errors in the least-squares method and the possibilities of the proposed indicator to overcome them are investigated. Simulation of the learning process of an artificial neural network has shown that the use of the joint correlation function together with the Adadelta optimizer allows us to get again in learning speed 2-3 times compared to CrossEntropyLoss |
URI: | http://hdl.handle.net/20.500.12258/14736 |
Appears in Collections: | Статьи, проиндексированные в SCOPUS, WOS |
Files in This Item:
File | Description | Size | Format | |
---|---|---|---|---|
scopusresults 1501 .pdf Restricted Access | 733.97 kB | Adobe PDF | View/Open | |
WoS 971 .pdf Restricted Access | 260.37 kB | Adobe PDF | View/Open |
Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.