首页|Hierarchical multihead self-attention for time-series-based fault diagnosis
Hierarchical multihead self-attention for time-series-based fault diagnosis
扫码查看
点击上方二维码区域，可以放大扫码查看
原文链接
万方数据
维普
Fault diagnosis is important for maintaining the safety and effectiveness of chemical process. Considering the multivariate, nonlinear, and dynamic characteristic of chemical process, many time-series-based data-driven fault diagnosis methods have been developed in recent years. However, the existing methods have the problem of long-term dependency and are difficult to train due to the sequential way of training. To overcome these problems, a novel fault diagnosis method based on time-series and the hierarchical multihead self-attention (HMSAN) is proposed for chemical process. First, a sliding window strategy is adopted to construct the normalized time-series dataset. Second, the HMSAN is developed to extract the time-relevant features from the time-series process data. It improves the basic self-attention model in both width and depth. With the multihead structure, the HMSAN can pay attention to different aspects of the complicated chemical process and obtain the global dynamic features. However, the multiple heads in parallel lead to redundant information, which cannot improve the diagnosis perfor-mance. With the hierarchical structure, the redundant information is reduced and the deep local time-related features are further extracted. Besides, a novel many-to-one training strategy is introduced for HMSAN to simplify the training procedure and capture the long-term dependency. Finally, the effec-tiveness of the proposed method is demonstrated by two chemical cases. The experimental results show that the proposed method achieves a great performance on time-series industrial data and outperforms the state-of-the-art approaches.
Key Laboratory of Smart Manufacturing in Energy Chemical Process of the Ministry of Education, East China University of Science and Technology, Shanghai 200237, China
National Natural Science Foundation of ChinaNational Natural Science Foundation of ChinaShanghai Rising-Star Program
万方数据
维普
