To expand the design of multimodal human-machine interaction modes in ship navigation,promote the intel-ligent development of navigation systems used in ship navigation,study the application of multimodal human-machine inter-action systems in ship navigation,and design a multimodal human-machine interaction system for ship navigation.Crew members can complete command input through multimodal interaction modes such as voice interaction and gesture interac-tion during the shearing bed navigation,without the need for manual steering.The experimental test results verify that after using the multimodal human-machine interaction mode,the control instructions can be effectively conveyed through voice and gestures during ship navigation.The ship navigation control is reliable and does not require manual control of the servo,achieving intelligent interactive control of ship navigation.
关键词
多模态/人机交互/船舶航行/语音交互/手势交互/隐马尔科夫模型
Key words
multimodal/human computer interaction/ship navigation/voice interaction/gesture interaction/hidden Markov model
维普
万方数据