Vision-Language Navigation Algorithm Based on Cosine Similarity

Jie Jin; Kaiyan Liu; Shunkao Zha

doi:10.3788/LOP202158.1615001

Journals >Laser & Optoelectronics Progress >Volume 58 >Issue 16 >Page 1615001 > Article

Laser & Optoelectronics Progress
Vol. 58, Issue 16, 1615001 (2021)

Vision-Language Navigation Algorithm Based on Cosine Similarity

Jie Jin¹, Kaiyan Liu¹, and Shunkao Zha^2、*

Author Affiliations

¹School of Electrical and Information Engineering, Tianjin University, Tianjin 300072, China

²School of Software Engineering, University of Science and Technology of China, Suzhou, Jiangsu 215123, China

show less

DOI: 10.3788/LOP202158.1615001 Cite this Article Set citation alerts

Jie Jin, Kaiyan Liu, Shunkao Zha. Vision-Language Navigation Algorithm Based on Cosine Similarity[J]. Laser & Optoelectronics Progress, 2021, 58(16): 1615001 Copy Citation Text

show less

Fig. 1. Regretful agent framework^[13]

Download full size

Fig. 2. Distribution of scene nodes in dataset

Download full size

Fig. 3. Examples of complex navigation scenarios

Download full size

Model	Validation-Seen				Validation-Unseen				Test (unseen)
Model	NE↓	SR↑	OSR↑	SPL↑	NE↓	SR↑	OSR↑	SPL↑	NE↓	SR↑	OSR↑	SPL↑
Random	9.45	0.16	0.21	--	9.23	0.16	0.22	--	9.77	0.13	0.18	0.12
Seq-to-Seq	6.01	0.39	0.53	--	7.81	0.22	0.28	--	7.85	0.20	0.27	0.18
RPA	5.56	0.43	0.53	--	7.65	0.25	0.32	--	7.53	0.25	0.33	0.23
Speaker-Follower	3.36	0.66	0.74	--	6.62	0.36	0.45	--	6.62	0.35	0.44	0.28
RCM	3.37	0.67	0.77	--	5.88	0.43	0.52	--	6.01	0.43	0.51	0.35
Self-Monitoring	3.22	0.67	0.78	0.58	5.52	0.45	0.56	0.32	5.99	0.43	0.55	0.32
Regretful	3.69	0.65	0.72	0.59	5.36	0.48	0.61	0.37	--	--	--	--
Regretful*	3.23	0.69	0.77	0.63	5.32	0.50	0.59	0.41	5.69	0.48	0.56	0.40
Ours	3.23	0.70	0.76	0.65	5.33	0.52	0.61	0.42	5.69	0.50	0.57	0.41

Table 1. Comparison of different models

Jie Jin, Kaiyan Liu, Shunkao Zha. Vision-Language Navigation Algorithm Based on Cosine Similarity[J]. Laser & Optoelectronics Progress, 2021, 58(16): 1615001

Download Citation

Set citation alerts for the article

Tools

Set citation alerts for the article

Save the article for my favorites

Paper Information