A comparison of statistical learning of naturalistic textures between DCNNs and the human visual hierarchy

LU XinCheng ¹YUAN ZiQi ²ZHANG YiChi ²AI HaiLin ¹CHENG SiYuan ¹GE YiRan ¹FANG Fang ³CHEN NiHong⁴

扫码查看

作者信息

1. Department of Psychological and Cognitive Sciences,Tsinghua University,Beijing 100084,China
2. Department of Computer Science and Technology,Tsinghua University,Beijing 100084,China
3. School of Psychological and Cognitive Sciences and Beijing Key Laboratory of Behavior and Mental Health,Peking University,Beijing 100871,China;Key Laboratory of Machine Perception(Ministry of Education),Peking University,Beijing 100871,China;Peking-Tsinghua Center for Life Sciences,Peking University,Beijing 100871,China;IDG/McGovern Institute for Brain Research,Peking University,Beijing 100871,China
4. State Key Laboratory of Brain and Cognitive Science,Institute of Psychology,Chinese Academy of Sciences,Beijing 100101,China;Department of Psychological and Cognitive Sciences,Tsinghua University,Beijing 100084,China;IDG/McGovern Institute for Brain Research,Tsinghua University,Beijing 100084,China
折叠

Abstract

The visual system continuously adapts to the statistical properties of the environment.Existing evidence shows a close re-semblance between deep convolutional neural networks(CNNs)and primate visual stream in neural selectivity to naturalistic textures above the primary visual processing stage.This study delves into the mechanisms of perceptual learning in CNNs,focusing on how they assimilate the high-order statistics of natural textures.Our results show that a CNN model achieves a similar performance improvement as humans,as manifested in the learning pattern across different types of high-order image statistics.While L2 was the first stage exhibiting texture selectivity,we found that stages beyond L2 were critically involved in learning.The significant contribution of L4 to learning was manifested both in the modulations of texture-selective responses and in the consequences of training with frozen connection weights.Our findings highlight learning-dependent plasticity in the mid-to-high-level areas of the visual hierarchy.This research introduces an AI-inspired approach for studying learning-induced cortical plasticity,utilizing DCNNs as an experimental framework to formulate testable predictions for empirical brain studies.

Key words

CNN/perceptual learning/naturalistic texture/psychophysics

引用本文复制引用

基金项目

National Natural Science Foundation of China(31971031)

National Natural Science Foundation of China(31930053)

National Natural Science Foundation of China(32171039)

STI2030-Major Projects(2021ZD0203600)

STI2030-Major Projects(2022ZD0204802)

STI2030-Major Projects(2022ZD0204804)

出版年

2024

中国科学:技术科学(英文版)

中国科学院

中国科学:技术科学(英文版)

CSTPCDEI

影响因子：1.056

ISSN：1674-7321

段落导航