Semantic information fusion interaction method based on multi-channel
Therefore,in order to solve the existing problem of single interaction channel,this paper proposes a semantic information fusion interaction method based on multi-channel,using different network structures to extract the semantic features of original voice information,image information and behavioral information,through hidden Markov the model strengthens the interaction between different features,uses the attention mechanism to establish semantic information fusion,and captures deep semantic features.The effectiveness of the method proposed in this article is verified on the IEMOCAP data set.
NETL
NSTL
万方数据
