清华大学学报自然科学版(英文版)2024,Vol.29Issue(1) :197-206.DOI:10.26599/TST.2022.9010071

Transformer and GAN-Based Super-Resolution Reconstruction Network for Medical Images

Weizhi Du Shihao Tian
清华大学学报自然科学版(英文版)2024,Vol.29Issue(1) :197-206.DOI:10.26599/TST.2022.9010071

Transformer and GAN-Based Super-Resolution Reconstruction Network for Medical Images

Weizhi Du 1Shihao Tian2
扫码查看

作者信息

  • 1. Arts & Sciences College,Washington University in St.Louis,St.Louis,MO 63130,USA
  • 2. Department of Electric and Computing Engineering,Cornell University,Ithaca,NY 14850,USA
  • 折叠

Abstract

Super-resolution reconstruction in medical imaging has become more demanding due to the necessity of obtaining high-quality images with minimal radiation dose,such as in low-field magnetic resonance imaging(MRI).However,image super-resolution reconstruction remains a difficult task because of the complexity and high textual requirements for diagnosis purpose.In this paper,we offer a deep learning based strategy for reconstructing medical images from low resolutions utilizing Transformer and generative adversarial networks(T-GANs).The integrated system can extract more precise texture information and focus more on important locations through global image matching after successfully inserting Transformer into the generative adversarial network for picture reconstruction.Furthermore,we weighted the combination of content loss,adversarial loss,and adversarial feature loss as the final multi-task loss function during the training of our proposed model T-GAN.In comparison to established measures like peak signal-to-noise ratio(PSNR)and structural similarity index measure(SSIM),our suggested T-GAN achieves optimal performance and recovers more texture features in super-resolution reconstruction of MRI scanned images of the knees and belly.

Key words

super-resolution/image reconstruction/Transformer/generative adversarial network(GAN)

引用本文复制引用

出版年

2024
清华大学学报自然科学版(英文版)
清华大学

清华大学学报自然科学版(英文版)

CSTPCDEI
影响因子:0.474
ISSN:1007-0214
参考文献量26
段落导航相关论文