首页|多模态人机交互系统在船舶航行中的应用

多模态人机交互系统在船舶航行中的应用

扫码查看
为拓展设计船舶航行中多模态人机交互模式,促进船舶航行所用导航系统的智能化发展,研究多模态人机交互系统在船舶航行中的应用,设计一种船舶航行使用的多模态人机交互系统.船员可在船舶航行时,以语音交互、手势交互这种多模态交互模式,完成指令输入,无需人工手动操舵.实验测试结果验证,多模态人机交互模式使用后,船舶航行时,控制指令通过语音与手势便可有效传达,船舶航行控制可靠,且无须手动控制舵机,可实现船舶航行智能化交互控制.
Application of multimodal human-machine interaction system in ship navigation
To expand the design of multimodal human-machine interaction modes in ship navigation,promote the intel-ligent development of navigation systems used in ship navigation,study the application of multimodal human-machine inter-action systems in ship navigation,and design a multimodal human-machine interaction system for ship navigation.Crew members can complete command input through multimodal interaction modes such as voice interaction and gesture interac-tion during the shearing bed navigation,without the need for manual steering.The experimental test results verify that after using the multimodal human-machine interaction mode,the control instructions can be effectively conveyed through voice and gestures during ship navigation.The ship navigation control is reliable and does not require manual control of the servo,achieving intelligent interactive control of ship navigation.

multimodalhuman computer interactionship navigationvoice interactiongesture interactionhidden Markov model

王卉、高家骥、曹福存

展开 >

大连工业大学,辽宁大连 116034

多模态 人机交互 船舶航行 语音交互 手势交互 隐马尔科夫模型

辽宁省教育厅高等学校基本科研项目辽宁省社科规划基金项目辽宁省社科联课题

J202154L22BJY0092023LSLYbkt-010

2024

舰船科学技术
中国舰船研究院,中国船舶信息中心

舰船科学技术

CSTPCD北大核心
影响因子:0.373
ISSN:1672-7649
年,卷(期):2024.46(3)
  • 7