成都中医药大学学报2024,Vol.47Issue(5) :60-66.DOI:10.13593/j.cnki.51-1501/r.2024.05.012

基于多级任务的"视觉脉诊"方法研究

Methodological Study of Visual Pulse Diagnosis Based on Multi-Level Task

赵智慧 秦睿 李炜弘 许强 陈帅 王昕 王锭
成都中医药大学学报2024,Vol.47Issue(5) :60-66.DOI:10.13593/j.cnki.51-1501/r.2024.05.012

基于多级任务的"视觉脉诊"方法研究

Methodological Study of Visual Pulse Diagnosis Based on Multi-Level Task

赵智慧 1秦睿 2李炜弘 3许强 1陈帅 4王昕 3王锭3
扫码查看

作者信息

  • 1. 成都中医药大学 智能医学学院,四川 成都,611137
  • 2. 真术相成(成都)科技有限公司,四川 成都,610096
  • 3. 成都中医药大学 基础医学院,四川 成都,611137
  • 4. 广东省新黄埔中医药联合创新研究院,广东 广州,510700
  • 折叠

摘要

脉诊对中医诊断至关重要.然现有脉诊客观化高度依赖设备,阻碍其在远程在线诊疗中推广.受近年来基于远程光电容积脉搏波描记法(Remote Photoplethysmography,rPPG)的视频非接触式生理参数检测启发,本文提出了一种基于rPPG的"视觉脉诊"方法,以面部视频为输入预测中医脉象;研究通过多尺度融合及多任务学习进行ROI检测,利用深度卷积神经网络进行滤波获取纯净血容量脉搏波,后基于深度神经网络进行脉象预测.经真实病例验证后发现,基于深度学习及多级任务的"视觉脉诊"准确率可达85%以上,且优于其他rPPG法."视觉脉诊"研究创新了非接触式脉诊研究范式,未来可推广至中医移动医疗,具有较大应用价值.

Abstract

Pulse diagnosis is crucial for Chinese medicine diagnosis.However,the existing objectivization of pulse diagnosis highly relies on equipment,which,unfortunately,hinders its promotion in mobile health.Inspired by the recent video-based non-contact physiological measurements based on remote photoplethysmography(rPPG),this paper proposes an rPPG-based"visual pulse diagno-sis"method to predict the pulse with facial video.The study performed ROI detection through multi-scale fusion and multi-task learn-ing,obtained rPPG-wave by filtering based on deep convolutional neural networks,and conducted pulse prediction using deep neural networks.After examination in real cases,we found that the accuracy of the deep learning and multilevel task-based"visual pulse di-agnosis"can be over 85%and outperforms other rPPG methods."Visual Pulse Diagnosis"is an innovative paradigm for non-contact pulse diagnosis,which can be applied to mobile healthcare in Chinese medicine in the future with promising value.

关键词

视觉脉诊/多级任务/脉诊客观化/远程光电容积脉搏波描记法

Key words

Visual pulse diagnosis/Multilevel task/Objectivization of pulse diagnosis/rPPG

引用本文复制引用

出版年

2024
成都中医药大学学报
成都中医药大学

成都中医药大学学报

影响因子:0.572
ISSN:1004-0668
段落导航相关论文