首页|Semantic segmentation-based semantic communication system for image transmission

Semantic segmentation-based semantic communication system for image transmission

扫码查看
With the rapid development of artificial intelligence and the widespread use of the Internet of Things,semantic communication,as an emerging communication paradigm,has been attracting great interest.Taking image transmission as an example,from the semantic communication's view,not all pixels in the images are equally important for certain receivers.The existing semantic communication systems directly perform semantic encoding and decoding on the whole image,in which the region of interest cannot be identified.In this paper,we propose a novel semantic communication system for image transmission that can distinguish between Regions Of Interest(ROI)and Regions Of Non-Interest(RONI)based on semantic segmentation,where a semantic segmentation algorithm is used to classify each pixel of the image and distinguish ROI and RONI.The system also enables high-quality transmission of ROI with lower communication overheads by transmissions through different semantic communication networks with different bandwidth requirements.An improved metric θPSNR is proposed to evaluate the transmission accuracy of the novel semantic transmission network.Experimental results show that our proposed system achieves a significant performance improvement compared with existing approaches,namely,existing semantic communication approaches and the conventional approach without semantics.

Semantic CommunicationSemantic segmentationImage transmissionImage compressionDeep learning

Jiale Wu、Celimuge Wu、Yangfei Lin、Tsutomu Yoshinaga、Lei Zhong、Xianfu Chen、Yusheng Ji

展开 >

The University of Electro-Communication,Tokyo,182-8585,Japan

Toyota Motor Corporation,Tokyo,112-8701,Japan

VTT Technical Research Centre of Finland,Oulu,Finland

National Institute of Informatics(NII),Tokyo,101-8430,Japan

展开 >

collaborative research with Toyota Motor CorporationROIS NII Open Collaborative ResearchJSPS KAKENHIJSPS KAKENHI

21S060120H0059221H03424

2024

数字通信与网络(英文)

数字通信与网络(英文)

ISSN:
年,卷(期):2024.10(3)