Neural Networks2022,Vol.15213.DOI:10.1016/j.neunet.2022.04.011

Tri-view two-photon microscopic image registration and deblurring with convolutional neural networks

Lee, Sehyung Kume, Hideaki Urakubo, Hidetoshi Kasai, Haruo Ishii, Shin
Neural Networks2022,Vol.15213.DOI:10.1016/j.neunet.2022.04.011

Tri-view two-photon microscopic image registration and deblurring with convolutional neural networks

Lee, Sehyung 1Kume, Hideaki 2Urakubo, Hidetoshi 1Kasai, Haruo 2Ishii, Shin1
扫码查看

作者信息

  • 1. Grad Sch Informat,Kyoto Univ
  • 2. Fac Med,Univ Tokyo
  • 折叠

Abstract

Two-photon fluorescence microscopy has enabled the three-dimensional (3D) neural imaging of deep cortical regions. While it can capture the detailed neural structures in the x-y image space, the image quality along the depth direction is lower because of lens blur, which often makes it difficult to identify the neural connectivity. To address this problem, we propose a novel approach for restoring the isotropic image volume by estimating and fusing the intersection regions of the images captured from three orthogonal viewpoints using convolutional neural networks (CNNs). Because convolution on 3D images is computationally complex, the proposed method takes the form of cascaded CNN models consisting of rigid transformation, dense registration, and deblurring networks for more efficient processing. In addition, to enable self-supervised learning, we trained the CNN models with simulated synthetic images by considering the distortions of the microscopic imaging process. Through extensive experiments, the proposed method achieved substantial image quality improvements.(c) 2022 Elsevier Ltd. All rights reserved.

Key words

Microscopy image/Deep learning/Convolutional neural network/Deblurring/Registration/RESOLUTION/EFFICIENT

引用本文复制引用

出版年

2022
Neural Networks

Neural Networks

EISCI
ISSN:0893-6080
被引量3
参考文献量69
段落导航相关论文