Light field depth estimation of fusing consistency and difference constraints

Zeyang He; Huiping Deng; Sen Xiang; Jin Wu

doi:10.3788/IRLA20210021

Journals >Infrared and Laser Engineering >Volume 50 >Issue 11 >Page 20210021 > Article

Infrared and Laser Engineering
Vol. 50, Issue 11, 20210021 (2021)

Light field depth estimation of fusing consistency and difference constraints

Zeyang He^1、2, Huiping Deng^1、2, Sen Xiang^1、2, and Jin Wu^1、2

Author Affiliations

¹School of Information Science and Engineering, Wuhan University of Science and Technology, Wuhan 430081, China

²Engineering Research Center for Metallurgical Automation and Measurement Technology of Ministry of Education, Wuhan University of Science and Technology, Wuhan 430081, China

show less

DOI: 10.3788/IRLA20210021 Cite this Article

Zeyang He, Huiping Deng, Sen Xiang, Jin Wu. Light field depth estimation of fusing consistency and difference constraints[J]. Infrared and Laser Engineering, 2021, 50(11): 20210021 Copy Citation Text

show less

Fig. 1. Schematic diagram of light field and EPI acquisition (top), and diagram after overlaying light field images (bottom)

Download full size | View in the Article

Fig. 2. Schematic diagram of SPO and SLO

Download full size | View in the Article

Fig. 3. The flow chart of light field depth estimation

Download full size | View in the Article

Fig. 4. Analysis of the accuracy of the cost function

Download full size | View in the Article

Fig. 5. Comparison of the accuracy of the two cost functions

Download full size | View in the Article

Fig. 6. Comparison of experimental results of depth maps with two cost functions

Download full size | View in the Article

Fig. 7. Comparison of the results of the depth bad pixel map

Download full size | View in the Article

Fig. 8. Comparison of boxes and dino depth map detail results

Download full size | View in the Article

Symbol	Physical significance	Symbol	Physical significance
R(x*,θN)	EPI slash	wθ(i,j)	SPO distance weight
E(x*+ $\Delta $x N,u)	EPI slash pixel coordinate information	χ2(aθ,bθ)	SPO histogram χ2 distance
tanθN	EPI slope	Ds(P,θN)	SPO cost function
I1，I2	Pixel adjacent integer pixel value	c,cs,ce	Adaptive confidence weight
w1，w2	Horizontal distance weight	D(P,θN)	One-way final cost function
h(x,u′)	Pixel value probability	Du,v(x,y,θ)	Final cost function
Cei(P,θN)	Initial single channel entropy cost	Eunary	MRF data cost
w(P,θN)	Color similarity weight	ES(p,p(α))	SPO data cost
Ce(P,θN)	Final single channel entropy cost	Ee(p,p(α))	SLO data cost
De(P,θN)	SLO color entropy cost function	Ebinary	MRF smoothing term

Table 1. Physical significance of important symbols

View in the Article

	BP>0.07
	boxes	Cotton	Sideboard	dino
CAE	0.187 8	0.038 4	0.120 0	0.068 8
IGF	0.192 4	0.141 8	0.108 3	0.070 5
LF	0.287 4	0.100 1	0.243 2	0.210 9
LF_DC	0.893 3	0.889 7	0.957 8	0.869 1
LF_OOC	0.405 6	0.365 5	0.436 4	0.252 7
LF_PAC	0.225 5	0.073 7	0.100 5	0.091 0
MBM	0.201 3	0.068 4	0.163 3	0.082 9
POBR	0.397 8	0.120 6	0.296 2	0.271 8
SPO	0.143 3	0.031 8	0.073 3	0.025 1
Proposed	0.141 1	0.025 5	0.071 9	0.023 7

Table 2. Comparison of results of BP>0.07

View in the Article

	MSE
	boxes	Cotton	Sideboard	dino
CAE	0.089 1	0.026 9	0.008 6	0.004 0
IGF	0.106 1	0.108 3	0.012 0	0.009 9
LF	0.162 9	0.141 0	0.039 0	0.017 1
LF_DC	0.121 2	0.061 8	0.575 5	0.030 5
LF_OOC	0.074 8	0.056 7	0.043 0	0.017 2
LF_PAC	0.099 2	0.070 5	0.011 0	0.009 2
MBM	0.101 9	0.067 1	0.029 1	0.013 7
POBR	0.134 8	0.063 5	0.046 8	0.023 4
SPO	0.108 8	0.041 4	0.009 9	0.003 9
Proposed	0.101 7	0.024 8	0.009 6	0.003 5

Table 3. Comparison of results of MSE

Zeyang He, Huiping Deng, Sen Xiang, Jin Wu. Light field depth estimation of fusing consistency and difference constraints[J]. Infrared and Laser Engineering, 2021, 50(11): 20210021

Download Citation

Tools

Save the article for my favorites

Paper Information