Anterior-posterior memory matrix model for chest radiology image report generation
Aiming at the existing radiographic report generation methods that mainly focus on the guiding role of the preceding information in the report generation process and ignore the role of the following information in the report description generation,which has the problems of incomplete semantic information and missing key information,anterior-posterior memory matrix model for chest radiology image report generation(RadRG)is proposed.In order to obtain richer semantic information in the generation process,anterior-posterior memory matrix(MA)is proposed,which uses the memory matrix to record the schema information and semantic information of the report,and uses a gating unit to regulate it in order to prevent the gradient from disappearing or the information explosion in the training process.The model in this paper is tested on the IU X-Ray and MIMIC-CXR public datasets,and the experimental results show that the model in this paper achieves a 2.6％improvement in the BIEU metrics compared with the existing mainstream models.
medical report generationcontext memory matrixgating unitcross model
万方数据
维普
