Depression Intensity Recognition Based on Perceptually Locally-enhanced Global Depression Features and Fused Global-local Semantic Correlation Features on Faces
For automatic recognition of the depression intensity in patients,the existing deep learning based methods typically face two main challenges:(1)It is difficult for deep models to effectively capture the global context information relevant to the level of depression intensity from facial expressions,and(2)the semantic consistency between the global semantic information and the local one associated with depression intensity is often ignored.One new deep neural network for recognizing the severity of depressive symptoms,by combining the Perceptually Locally-Enhanced Global Depression Features and the Fused Global-Local Semantic Correlation Features(PLEGDF-FGLSCF),is proposed in this paper.Firstly,the PLEGDF module for the extraction of global depression features with local perceptual enhancement,is designed to extract the semantic correlations among local facial regions,to promote the interactions between depression-relevant information in different local regions,and thus to enhance the expressiveness of the global depression features driven by the local ones.Secondly,in order to achieve full integration of global and local semantic features related to depression severity,the FGLSCF module is proposed,aiming to capture the correlation of global and local semantic information and thus to ensure the semantic consistency in describing the depression intensity by means of global and local semantic features.Finally,on the AVEC2013 and AVEC2014 datasets,the PLEGDF-FGLSCF model achieved recognition results in terms of the Root Mean Square Error(RMSE)and the Mean Absolute Error(MAE)with the values of 7.75/5.96 and 7.49/5.99,respectively,demonstrating its superiority to most existing benchmark methods,verifying the rationality and effectiveness of our approach.
Depression intensityFace imageLocal perceptual enhancementGlobal and local features fusionSemantic consistency
万方数据
维普
