首页|多模交互智能终端

多模交互智能终端

扫码查看
为了使用户出行便利,尤其对于眼障人士,以语义分析和机器视觉技术为基础,设计了一款多模交互智能终端.整个系统在硬件上主要以树莓派为核心处理器,配合语音处理采集板、摄像头、扬声器、GPS定位模块来实现.软件上采用模块化插件的方式进行设计,综合运用了网络爬虫、语音识别与合成、语义理解、智能对话、天气新闻播报、障碍物检测、路线规划等技术.该系统具有完整的前后端设计,前端提供Web接入、聊天信息查看、障碍物实时查看和地图查看,后端提供后台管理.实际测试表明,该系统具有良好的稳定性和实用性,对于服务视障人士的日常出行具有较强的现实意义.
Multimode Interactive Intelligent Terminal
In order to improve the user's travel convenience,especially for the visual impaired person,a multi-mode interactive intelli-gent terminal is designed based on semantic analysis and machine vision technology.The whole system is implemented in hardware,mainly with the Raspberry Pi as the core processor,together with a speech processing acquisition board,camera,speaker and GPS posi-tioning module.The software is designed by means of modular plug-ins,and makes comprehensive use of web crawler technology,speech recognition and synthesis technology,semantic understanding,intelligent dialogue,weather news broadcast,obstacle detection,route planning and so on.The system has a complete front-end and back-end design,with the front-end providing Web access,chat in-formation viewing,real-time obstacle viewing and map viewing,and the back-end providing back-end management.The result shows that the system has good stability,accuracy and practicality,which is of strong practical significance to serve people's daily travel.

deep learningtarget recognitionspeech processingintelligent terminals

阚保强、余容森

展开 >

福建师范大学协和学院,福建 福州 350003

深度学习 目标识别 语音处理 智能终端

福建省教师教育科研项目福建师范大学协和学院科研基金资助项目泉州市科技计划项目

JAT191117KY202002022017T009

2024

长春师范大学学报
长春师范学院

长春师范大学学报

CHSSCD
影响因子:0.312
ISSN:1008-178X
年,卷(期):2024.43(2)
  • 9