首页|Research on Robotics Detailed by a Researcher at China University of Geosciences (Audio-Visual Bimodal Combination-Based Speaker Tracking Method for Mobile Robot)
Research on Robotics Detailed by a Researcher at China University of Geosciences (Audio-Visual Bimodal Combination-Based Speaker Tracking Method for Mobile Robot)
扫码查看
点击上方二维码区域，可以放大扫码查看
原文链接
NETL
NSTL
A new study on robotics is now available. According to news originating from Hubei, People’s Republic of China, by NewsRx editors, the research stated, “Initiative service is a key research direction for the new generation of service robots. It is important to automatically track humans for initiative service in human-robot interaction.” Funders for this research include College Students’ Innovative Entrepreneurial Training Plan Program; China University of Geosciences. Our news journalists obtained a quote from the research from China University of Geosciences: “To solve the problems of low precision and poor anti-interference capability of only using single-modal (audio or visual) information, a speaker positioning and tracking method based on an audio-visual bimodal combination is proposed. First, the azimuth of the speaker is obtained based on the time difference of arrival using a microphone array, and face detection based on AdaBoost is carried out using the camera. A distance and azimuth calculation model is established to obtain the position of the speaker. Second, a speaker positioning strategy based on an audio-visual bimodal combination is designed to handle different situations. Third, the path is planned by which the azimuth and distance between the robot and the speaker are maintained in a limited range. Different azimuths and distances for speaker tracking are set to perform various simulations. Finally, the mobile robot is driven to follow the path using the STM32 real-time control system. Information from the microphone array and the camera is collected and processed by Raspberry Pi.”
China University of GeosciencesHubeiPeople’s Republic of ChinaAsiaEmerging TechnologiesMachine LearningRobotRobotics
NETL
NSTL
