Multimodal Data Fusion Decision Technology for Overhead Monorail Based on Transformer
As one of the foundations of the global economy,the mining industry faces numerous challenges,including rising labor costs,worker safety,and equipment safety.With the rapid development of artificial intelligence technology,new solutions were provided for the mining industry.This study aims to explore the application of Transformer based multimodal data fusion decision-making technology in coal mine overhead monorail suspension systems.By integrating video data and sensor data,comprehensive monitoring of the operational status of the overhead monorail suspension system can be achieved,potential risks can be identified in a timely manner,decision-making interventions can be made,accidents can be reduced,and the safety and operational efficiency of the system can be improved.A Transformer based multimodal data fusion decision-making technology was designed for overhead monorail,achieving effective fusion and information sharing of visual information and sensor data.Through experimental verification,the model that integrates sensor data had better detection accuracy and robustness than the model that uses visual information alone,providing new ideas and technical support for the intelligent development of the coal mining industry.