移动增强现实应用中,用户频繁地与环境中不同的智能物体交互完成任务,其完成效率和用户体验由所采用的定向交互技术决定.然而,从交互手段上来说,现阶段定向交互依赖于Wi-Fi、BLE等无线技术,其信号全向传播的特点使其不能利用用户的空间环境(即位置和方向)来缩短互动时间,带来了不必要的时间成本;从交互界面上来说,现阶段基于视觉的界面存在可靠性低、扩展性低等问题,进一步限制了系统的通用性.本文介绍了 RetroAR——基于可见光逆反射通信的定向交互系统.RetroAR利用了光的定向传播特性来保留用户的空间环境,并依靠逆反射通信实现用户与目标设备之间无连接的快速定向交互.系统实验表明,RetroAR最远可在4 m距离支持100°视角的交互,同时实现厘米级的六自由度(6-Degrees Of Freedom,6-DoF)三维跟踪.用户研究表明,与基于Wi-Fi的解决方案相比,RetroAR将非接触式控制的交互时间减少了2倍,并且具有更好的用户体验.RetroAR借助可见光逆反射通信来利用用户空间环境,保持交互过程中的直观性.用户可以"所指即所控"的方式与多个目标进行互动,实现类似自然交互的快速定向交互.
Directional Interaction for Mobile Augmented Reality Based on Visible Light Backscatter Communication
In mobile augmented reality applications,users interact with smart objects in proximity to finish collabora-tion or interaction tasks,whose efficiency and user experience are determined by the underlying directional interaction tech-nology.However,current directional interaction technologies at this stage are inefficient.For interaction means,they rely on wireless technologies such as Wi-Fi and BLE,which propagates omni-directionally and thus cannot use the user's spa-tial context(i.e.,location and direction)to shorten the interaction time,bringing unnecessary effort.In terms of interaction interface,current vision-based interfaces suffer from low reliability and low scalability,which further limits the adaptability and efficiency of the system.To address this issue,we developed RetroAR:an optical-sensing solution that leverages visi-ble light backscatter communication to serve for directional interaction with intelligent objects on commodity smartphones.RetroAR exploits the directional propagation property of light to preserve the user's spatial context,which enables fast con-nection-free directional interaction between the user and the target devices.RetroAR instruments objects with custom retro-reflective markers called ViTags.When users interact with these smart objects,these ViTags are used to communicate with the camera on the mobile reader by backscattering the flashlight beams.We first conducted a system evaluation which showed that RetroAR could work reliably at a distance up to 4 meters and a view angle up to 100 degrees,and is able to achieve 6-DoF 3D tracking with an error as low as 1 cm on translation and 4.7 degrees on rotation.To evaluate how our sys-tem performs in terms of interaction,we then conducted a user study with 12 participants,which demonstrated that RetroAR improves the interaction time of MAR contactless control by at least two times compared to Wi-Fi-based solutions.Ret-roAR utilizes the user's spatial environment with visible light backscatter communication to maintain the intuitiveness of the interaction process.Users can interact with multiple targets in a point-and-control manner,which reduces interaction costs and brings a natural and intuitive interaction experience.
mobile augmented realitydirectional interactionpoint-and-controlvisible light backscatter communi-cationpolymer dispersed liquid crystal
万方数据
维普
