Robotics & Machine Learning Daily News2024,Issue(Feb.6) :51-52.DOI:10.20965/jaciii.2024.p0196

Research on Robotics Detailed by a Researcher at China University of Geosciences (Audio-Visual Bimodal Combination-Based Speaker Tracking Method for Mobile Robot)

Robotics & Machine Learning Daily News2024,Issue(Feb.6) :51-52.DOI:10.20965/jaciii.2024.p0196

Research on Robotics Detailed by a Researcher at China University of Geosciences (Audio-Visual Bimodal Combination-Based Speaker Tracking Method for Mobile Robot)

扫码查看

Abstract

A new study on robotics is now available. According to news originating from Hubei, People’s Republic of China, by NewsRx editors, the research stated, “Initiative service is a key research direction for the new generation of service robots. It is important to automatically track humans for initiative service in human-robot interaction.” Funders for this research include College Students’ Innovative Entrepreneurial Training Plan Program; China University of Geosciences. Our news journalists obtained a quote from the research from China University of Geosciences: “To solve the problems of low precision and poor anti-interference capability of only using single-modal (audio or visual) information, a speaker positioning and tracking method based on an audio-visual bimodal combination is proposed. First, the azimuth of the speaker is obtained based on the time difference of arrival using a microphone array, and face detection based on AdaBoost is carried out using the camera. A distance and azimuth calculation model is established to obtain the position of the speaker. Second, a speaker positioning strategy based on an audio-visual bimodal combination is designed to handle different situations. Third, the path is planned by which the azimuth and distance between the robot and the speaker are maintained in a limited range. Different azimuths and distances for speaker tracking are set to perform various simulations. Finally, the mobile robot is driven to follow the path using the STM32 real-time control system. Information from the microphone array and the camera is collected and processed by Raspberry Pi.”

Key words

China University of Geosciences/Hubei/People’s Republic of China/Asia/Emerging Technologies/Machine Learning/Robot/Robotics

引用本文复制引用

出版年

2024
Robotics & Machine Learning Daily News

Robotics & Machine Learning Daily News

ISSN:
段落导航相关论文