中国科学:技术科学(英文版)2024,Vol.67Issue(8) :2319-2330.DOI:10.1007/s11431-024-2753-3

Brain-inspired dual-pathway neural network architecture and its generalization analysis

DONG SongLin TAN ChengLi ZUO ZhenTao HE YuHang GONG YiHong ZHOU TianGang LIU JunMin ZHANG JiangShe
中国科学:技术科学(英文版)2024,Vol.67Issue(8) :2319-2330.DOI:10.1007/s11431-024-2753-3

Brain-inspired dual-pathway neural network architecture and its generalization analysis

DONG SongLin 1TAN ChengLi 2ZUO ZhenTao 3HE YuHang 1GONG YiHong 1ZHOU TianGang 3LIU JunMin 2ZHANG JiangShe2
扫码查看

作者信息

  • 1. College of Artificial Intelligence,Xi'an Jiaotong University,Xi'an 710049,China
  • 2. School of Mathematics and Statistics,Xi'an Jiaotong University,Xi'an 710049,China
  • 3. State Key Laboratory of Brain and Cognitive Science,Institute of Biophysics,Chinese Academy of Sciences,Beijing 100101,China;Institute of Artificial Intelligence,Hefei Comprehensive National Science Center,Hefei 230088,China;University of Chinese Academy of Sciences,Beijing 100049,China
  • 折叠

Abstract

In this study,we explored the neural mechanism of global topological perception in the human visual system.We showed strong evidence that the retinotectal pathway in the archicortex of the human brain is responsible for global topological perception,and for modulating the local feature processing in the classical ventral visual pathway.Inspired by this recent cognitive discovery,we developed a novel CogNet architecture to emulate the global-local dichotomy of human visual cognitive mechanisms.The thorough experimental results indicate that the proposed CogNet not only significantly improves image classification accuracies but also effectively addresses the texture bias problem observed in baseline CNN models.We have also conducted mathematical analysis for the generalization gap for general neural networks.Our theoretical derivations suggest that the Hurst parameter,a measure of the curvature of the loss landscape,can closely bind the generalization gap.A larger Hurst parameter corresponds to a better generalization ability.We found that our proposed CogNet achieves a lower test error and attains a larger Hurst parameter,strengthening its superiority over the baseline CNN models further.

Key words

global topological perception/dual-pathway/generalization gap analysis/Hurst parameter

引用本文复制引用

基金项目

National Key Research and Development Project of China(2020AAA0105600)

National Natural science Foundation of China(U21B2048)

National Natural science Foundation of China(62276208)

Shenzhen Key Technical Projects(CJGJZD2022051714160501)

Chinese Academy of Sciences(2021091)

Chinese Academy of Sciences(YSBR-068)

出版年

2024
中国科学:技术科学(英文版)
中国科学院

中国科学:技术科学(英文版)

CSTPCDEI
影响因子:1.056
ISSN:1674-7321
参考文献量1
段落导航相关论文