Large language model-based approach for human-mobile inspection robot interactive navigation
In the manufacturing field,the wide application of mobile robots has become the key to improving opera-tional safety and efficiency.However,most existing robotic systems can only complete predefined navigation tasks,and cannot be adapted to the unstructured environment.To overcome this bottleneck,an interactive navigation method for mobile inspection robots based on large language models was introduced,which replaced operators in conducting inspections within hazardous industrial areas,and to execute complex navigation tasks based on verbal in-structions.The High-Resolution Net(HRNet)model was utilized for semantic scene segmentation,integrating the segmentation results into the reconstructed 3D scene mesh during the point cloud fusion phase to create a compre-hensive 3D semantic map.A large language model was used to make the robot comprehend human natural language instructions and generate Python code based on the 3D semantic map to complete navigation tasks.A series of exper-iments had been conducted to validate the effectiveness of the proposed system.
human-robot interactionlarge language modelvision and language navigationsmart manufacturingIn-dustry 5.0
NETL
NSTL
万方数据
