首页|Vision–Language Navigation With Beam-Constrained Global Normalization
Vision–Language Navigation With Beam-Constrained Global Normalization
扫码查看
点击上方二维码区域，可以放大扫码查看
原文链接
NETL
NSTL
IEEE
Vision–language navigation (VLN) is a challenging task, which guides an agent to navigate in a realistic environment by natural language instructions. Sequence-to-sequence modeling is one of the most prospective architectures for the task, which achieves the agent navigation goal by a sequence of moving actions. The line of work has led to the state-of-the-art performance. Recently, several studies showed that the beam-search decoding during the inference can result in promising performance, as it ranks multiple candidate trajectories by scoring each trajectory as a whole. However, the trajectory-level score might be seriously biased during ranking. The score is a simple averaging of individual unit scores of the target-sequence actions, and these unit scores could be incomparable among different trajectories since they are calculated by a local discriminant classifier. To address this problem, we propose a global normalization strategy to rescale the scores at the trajectory level. Concretely, we present two global score functions to rerank all candidates in the output beam, resulting in more comparable trajectory scores. In this way, the bias problem can be greatly alleviated. We conduct experiments on the benchmark room-to-room (R2R) dataset of VLN to verify our method, and the results show that the proposed global method is effective, providing significant performance than the corresponding baselines. Our final model can achieve competitive performance on the VLN leaderboard.
Academy of Military Sciences China, National Innovation Institute of Defense Technology, Beijing, China|Tianjin Artificial Intelligence Innovation Center (TAIIC), Tianjin, China
Institute of Computing and Intelligence, Harbin Institute of Technology (Shenzhen), Shenzhen, China
National Key Laboratory of Human Factors Engineering, China Astronaut Research and Training Center, Beijing, China
NETL
NSTL
IEEE
