Aiming at the existing radiographic report generation methods that mainly focus on the guiding role of the preceding information in the report generation process and ignore the role of the following information in the report description generation,which has the problems of incomplete semantic information and missing key information,anterior-posterior memory matrix model for chest radiology image report generation(RadRG)is proposed.In order to obtain richer semantic information in the generation process,anterior-posterior memory matrix(MA)is proposed,which uses the memory matrix to record the schema information and semantic information of the report,and uses a gating unit to regulate it in order to prevent the gradient from disappearing or the information explosion in the training process.The model in this paper is tested on the IU X-Ray and MIMIC-CXR public datasets,and the experimental results show that the model in this paper achieves a 2.6％improvement in the BIEU metrics compared with the existing mainstream models.
关键词
医学报告生成/前后文记忆矩阵/门控单元/跨模态
Key words
medical report generation/context memory matrix/gating unit/cross model
维普
万方数据