Research on a brain controlled robotic arm system combining SSVEP and eye-tracking in mixed reality scenarios
Brain computer interface,as an important part of brain science and brain-like intelligence research,is of strategic importance in multiple countries.A mixed reality brain controlled robotic arm system integrating steady-state visual evoked potential(SSVEP)and eye-tracking technology is designed to address the poor interactivity and small instruction set in brain controlled robotic arm systems in mixed reality scenarios.The system achieves the initial selection of the target area through eye-tracking technology,and the SSVEP signal is employed to identify the final target instruction within the initial selection area.The instruction set is expanded without increasing the number of stimulus categories,and asynchronous control is implemented based on the subject's gaze retention area.The offline experimental results indicate that increasing the number of visual stimulus targets has no marked impact on classification accuracy when using the same number of stimulus categories.And the applicability of the system is verified through online experiments.Compared to the robotic arm control system using a single SSVEP paradigm,the proposed system achieves better interactivity and a larger instruction set.
国家科技期刊平台
NSTL
万方数据
