Neural Networks2022,Vol.15210.DOI:10.1016/j.neunet.2022.04.015

Multistability analysis of delayed recurrent neural networks with a class of piecewise nonlinear activation functions

Liu, Yang Wang, Zhen Ma, Qian Shen, Hao
Neural Networks2022,Vol.15210.DOI:10.1016/j.neunet.2022.04.015

Multistability analysis of delayed recurrent neural networks with a class of piecewise nonlinear activation functions

Liu, Yang 1Wang, Zhen 1Ma, Qian 2Shen, Hao3
扫码查看

作者信息

  • 1. Coll Math & Syst Sci,Shandong Univ Sci & Technol
  • 2. Sch Automation,Nanjing Univ Sci & Technol
  • 3. Coll Elect & Informat Engn,Anhui Univ Technol
  • 折叠

Abstract

This paper studies the multistability of delayed recurrent neural networks (DRNNs) with a class of piecewise nonlinear activation functions. The coexistence as well as the stability of multiple equilibrium points (EPs) of DRNNs are proved. With the Brouwer's fixed point theorem as well as the Lagrange mean value theorem, it is obtained that under some conditions, the n-neuron DRNNs with the proposed activation function can have at least 5(n) EPs and 3(n) of them are locally stable. Compared with the DRNNs with sigmoidal activation functions, DRNNs with this kind of activation function can have more total EPs and more locally stable EPs. It implies that when designing DRNNs with the proposed activation function to apply in associative memory, it can have an even larger storage capacity. Furthermore, it is obtained that there exists a relationship between the number of the total EPs/stable EPs and the frequency of the sinusoidal function in the proposed activation function. Last, the above obtained results are extended to a more general case. It is shown that, DRNNs with the extended activation function can have (2k + 1)(n) EPs, (k + 1)(n) of which are locally stable, therein k is closely related to the frequency of the sinusoidal function in the extended activation function. Two simulation examples are given to verify the correctness of the theoretical results. (C) 2022 Elsevier Ltd. All rights reserved.

Key words

Multistability/Recurrent neural networks/Time-varying delay/Piecewise nonlinear activation functions/Equilibrium points/ASSOCIATIVE MEMORY/GLOBAL STABILITY/DYNAMICAL BEHAVIORS/MULTIPERIODICITY/ATTRACTION/CRITERIA

引用本文复制引用

出版年

2022
Neural Networks

Neural Networks

EISCI
ISSN:0893-6080
被引量5
参考文献量49
段落导航相关论文