为拓展设计船舶航行中多模态人机交互模式，促进船舶航行所用导航系统的智能化发展，研究多模态人机交互系统在船舶航行中的应用，设计一种船舶航行使用的多模态人机交互系统。船员可在船舶航行时，以语音交互、手势交互这种多模态交互模式，完成指令输入，无需人工手动操舵。实验测试结果验证，多模态人机交互模式使用后，船舶航行时，控制指令通过语音与手势便可有效传达，船舶航行控制可靠，且无须手动控制舵机，可实现船舶航行智能化交互控制。
To expand the design of multimodal human-machine interaction modes in ship navigation, promote the intelligent development of navigation systems used in ship navigation, study the application of multimodal human-machine interaction systems in ship navigation, and design a multimodal human-machine interaction system for ship navigation. Crew members can complete command input through multimodal interaction modes such as voice interaction and gesture interaction during the shearing bed navigation, without the need for manual steering. The experimental test results verify that after using the multimodal human-machine interaction mode, the control instructions can be effectively conveyed through voice and gestures during ship navigation. The ship navigation control is reliable and does not require manual control of the servo, achieving intelligent interactive control of ship navigation.
2024,46(3): 157-160 收稿日期：2023-10-20
DOI：10.3404/j.issn.1672-7649.2024.03.028
分类号：TP181
基金项目：辽宁省教育厅高等学校基本科研项目（J202154）；辽宁省社科规划基金项目（L22BJY009）；辽宁省社科联课题（2023LSLYbkt-010）。
作者简介：王卉(1985-),女,博士,讲师,研究方向为艺术与科技交互
参考文献：
[1] 古毅杰, 张闯, 房美含. 基于输入延迟神经网络的船舶GPS/INS组合导航[J]. 船舶工程, 2022, 44(7): 96-102.
GU Yijie, ZHANG CHUANG, FANG Meihan. Ship GPS/INS integrated navigation based on input delay dynamic neural network[J]. Ship Engineering, 2022, 44(7): 96-102.
[2] 冯书庆, 徐志强, 王志勇, 等. 渔船姿态导航图形化界面研究[J]. 渔业现代化, 2020, 47(6): 74-80.
FENG Shuqing, XU Zhiqiang, WANG Zhiyong, et al. Research on graphical MMI of fishing vessel attitude navigation[J]. Fishery Modernization, 2020, 47(6): 74-80.
[3] 陈立, 朱兵. 400000 DWT智能矿砂船冗余导航系统设计方案[J]. 船海工程, 2020, 49(3): 48-52,58.
CHEN Li, ZHU Bing. Design of redundant navigation system for 400000 DWT intelligent VLOC[J]. Ship & Ocean Engineering, 2020, 49(3): 48-52,58.
[4] 孙沛, 郜凌云, 贾越等. 多终端联合下的远程人机交互仿真培训系统设计[J]. 电子设计工程, 2023, 31(13): 167-172.
SUN Pei, GAO Lingyun, JIA Yue, et al. Design of remote human-computer interaction simulation training system under multi-terminal union[J]. Electronic Design Engineering, 2023, 31(13): 167-172.
[5] 陈卓, 金建海, 张波, 等. 水面无人艇自主导航与控制系统的设计与实现[J]. 中国造船, 2020, 61(z1): 89-96.
CHEN Zhuo, JIN Jianhai, ZHANG Bo, et al. Design and implementation of autonomous navigation and control system for unmanned surface vehicle[J]. Shipbuilding of China, 2020, 61(z1): 89-96.
[6] 李明峰, 王胜正, 谢宗轩. 恶劣气象海况下船舶航线的多变量多目标优化建模[J]. 中国航海, 2020, 43(2): 14-19+30.
LI Mingfeng, WANG Shengzheng, XIE Zongxuan. Multi-variable-multi-objective optimization of ship routes under rough weather condition[J]. Navigation of China. 2020, 43(2): 14-19+30.
[7] 杨晓, 任鸿翔, 廉静静, 等. VR交互式三维虚拟船舶建模与仿真[J]. 中国航海, 2022, 45(1): 37-42+49.
YANG Xiao, REN Hongxiang, LIAN Jingjing, et al. 3 D virtual ship construction and simulation through VR interactive technology[J]. Navigation of China, 2022, 45(1): 37-42+49.
