中国科学:信息科学(英文版)2024,Vol.67Issue(5) :1-23.DOI:10.1007/s11432-023-3888-0

Bioinspired sensing-memory-computing integrated vision systems:biomimetic mechanisms,design principles,and applications

Yujie HUANG Yinlong TAN Yan KANG Yabo CHEN Yuhua TANG Tian JIANG
中国科学:信息科学(英文版)2024,Vol.67Issue(5) :1-23.DOI:10.1007/s11432-023-3888-0

Bioinspired sensing-memory-computing integrated vision systems:biomimetic mechanisms,design principles,and applications

Yujie HUANG 1Yinlong TAN 2Yan KANG 2Yabo CHEN 1Yuhua TANG 1Tian JIANG3
扫码查看

作者信息

  • 1. Institute for Quantum Information and State Key Laboratory of High Performance Computing,College of Computer,National University of Defense Technology,Changsha 410073,China
  • 2. College of Advanced Interdisciplinary Studies,National University of Defense Technology,Changsha 410073,China
  • 3. Institute for Quantum Science and Technology,College of Science,National University of Defense Technology,Changsha 410073,China
  • 折叠

Abstract

With the explosion of sensory data in the Internet of Things(IoT)era,conventional machine vision systems are becoming increasingly difficult to meet the requirements of high efficiency,low energy consumption,and low latency due to their inherent shortcomings of separate sensing,memory,and computing units.Inspired by the retina and neuromorphic computing,the sensing-memory-computing integrated vision system(SMCVS)that features low power consumption,low latency,and high parallelism has been considered a promising technology to surpass the von Neumann architecture and realize strong artificial intelligence.Meanwhile,novel materials like two-dimensional semiconductors and quantum dots with novel optoelectronic performance provide hardware carriers for implementing integrated sensing-memory-computing architectures,attracting considerable attention.This paper reviews the recent research progress in bioinspired vision systems in terms of biomimetic mechanisms,design principles,computational architectures,and applications.Firstly,the biomimetic mechanisms are illustrated to guide the design of high-performance artificial visual perception systems.Then the research progress of optoelectronic-synapse-based bioinspired vision systems in the device principles and applications including image filtering,color recognition,visual adaptation,and motion detection are summarized.Finally,the challenges and future developing directions of the SMCVS are provided regarding bionic application,architecture design,and device fabrication.

Key words

sensing-memory-computing architecture/neuromorphic computing/retinomorphic device/im-age recognition/visual system

引用本文复制引用

基金项目

National Natural Science Foundation of China(52103311)

National Natural Science Foundation of China(62075240)

Scientific Researches Foundation of National University of Defense Technology(ZK18-01-03)

National Key Research and Development Program of China(2020YFB2205804)

出版年

2024
中国科学:信息科学(英文版)
中国科学院

中国科学:信息科学(英文版)

CSTPCDEI
影响因子:0.715
ISSN:1674-733X
参考文献量149
段落导航相关论文