首页|深度学习与机器视觉辅助脑卒中康复后期训练系统

深度学习与机器视觉辅助脑卒中康复后期训练系统

扫码查看
为缓解当前脑卒中康复医护资源与病患需求之间的较大矛盾,减轻医护人员压力,实现脑卒中康复后期患者居家康复训练与评估,基于深度学习与机器视觉技术,以上肢为例,提出一种可以智能监控患者完成康复训练动作并判断动作是否达标的脑卒中康复后期训练系统,以求实现康复训练成效最大化,提升脑卒中患者的恢复速度.通过深度学习神经网络对二维人体关节点识别,在保证识别速率的前提下提高准确度.在康复训练的过程中,通过对骨骼框架进行识别,实时监控患者的动作.将获取的关节点信息与正确动作对比,纠正患者的错误体态,并显示完成度.这一系统在保证关键点的有效性的前提下,实时性佳,响应速度快,置信度整体平均值达到98.2%,视频每秒帧数在15~30之间,关节角度与完成数的准确率均在99%以上.基于深度学习与机器视觉技术,为脑卒中患者在没有医护人员的指导下进行自身恢复情况评估与上肢康复训练提供了可行性方案.Ⅲ-Ⅴ阶段脑卒中患者可以在家中独自完成康复训练,缓解康复资源紧张问题.
In order to alleviate the great contradiction between the current stroke rehabilitation medical resource and the need of patient,reduce the pressure of medical staff,and realize the home rehabilitation training and evaluation of patient in the late stage of stroke rehabilitation,based on deep learning and machine vision technology,a post-stroke rehabilitation training system that can intelligently monitor the patient's completion of rehabilitation training action and judge whether the action is up to standard was proposed,so as to maximize the effectiveness of rehabilitation training and improve the recovery speed of stroke patient.The two-dimensional human joint point is recognized by deep learning neural network to improve the accuracy on the premise of ensuring the recognition rate.In the process of rehabilitation training,the patient's movement is monitored in real time by identifying the skeletal framework.The obtained joint point information is compared with the correct movement,the patient's incorrect posture is corrected,and the degree of completion is displayed.On the premise of ensuring the effectiveness of key point,this system has good real-time performance,fast response speed,the overall average confidence level reaches 98.2%,the number of video frames per second is between 15~30,and the accuracy rates of joint angle and completion number are more than 99%.Based on deep learning and machine vision technology,it provides a feasible solution for stroke patient to evaluate recovery and upper limb rehabilitation training without the guidance of medical staff.StageⅢ~Ⅴ stroke patients can complete rehabilitation training at home alone to alleviate the shortage of rehabilitation resource.

StrokeRehabilitation TrainingDeep LearningMachine Vision

蒋奕帆、陈杨、黄清

展开 >

宁波大学科学技术学院 浙江慈溪 315300

宁波大学附属第一医院 浙江宁波 315000

脑卒中 康复训练 深度学习 机器视觉

2025

机械制造
上海市机械工程学会

机械制造

影响因子:0.211
ISSN:1000-4998
年,卷(期):2025.63(1)