摘要
为了使用户出行便利,尤其对于眼障人士,以语义分析和机器视觉技术为基础,设计了一款多模交互智能终端.整个系统在硬件上主要以树莓派为核心处理器,配合语音处理采集板、摄像头、扬声器、GPS定位模块来实现.软件上采用模块化插件的方式进行设计,综合运用了网络爬虫、语音识别与合成、语义理解、智能对话、天气新闻播报、障碍物检测、路线规划等技术.该系统具有完整的前后端设计,前端提供Web接入、聊天信息查看、障碍物实时查看和地图查看,后端提供后台管理.实际测试表明,该系统具有良好的稳定性和实用性,对于服务视障人士的日常出行具有较强的现实意义.
Abstract
In order to improve the user's travel convenience,especially for the visual impaired person,a multi-mode interactive intelli-gent terminal is designed based on semantic analysis and machine vision technology.The whole system is implemented in hardware,mainly with the Raspberry Pi as the core processor,together with a speech processing acquisition board,camera,speaker and GPS posi-tioning module.The software is designed by means of modular plug-ins,and makes comprehensive use of web crawler technology,speech recognition and synthesis technology,semantic understanding,intelligent dialogue,weather news broadcast,obstacle detection,route planning and so on.The system has a complete front-end and back-end design,with the front-end providing Web access,chat in-formation viewing,real-time obstacle viewing and map viewing,and the back-end providing back-end management.The result shows that the system has good stability,accuracy and practicality,which is of strong practical significance to serve people's daily travel.
基金项目
福建省教师教育科研项目(JAT191117)
福建师范大学协和学院科研基金资助项目(KY20200202)
泉州市科技计划项目(2017T009)
NETL
NSTL
万方数据