Scene Disparity Reconstruction from Light Field Based on Fourier Disparity Layer Representation

Fei Wei; Chang Liu; Jun Qiu

doi:10.3788/AOS202242.1610001

[1] Fang L, Dai Q H. Computational light field imaging[J]. Acta Optica Sinica, 40, 0111001(2020).

[2] Yin Y K, Yu K, Yu C Z et al. 3D imaging using geometric light field: a review[J]. Chinese Journal of Lasers, 48, 1209001(2021).

[3] Heber S, Pock T. Shape from light field meets robust PCA[M]. Fleet D, Pajdla T, Schiele B, et al. Computer vision-ECCV 2014. Lecture notes in computer science, 8694, 751-767(2014).

[4] Jeon H G, Park J, Choe G et al. Accurate depth map estimation from a lenslet light field camera[C], 1547-1555(2015).

[5] Zhang C, Zhou F G, Xue B D. Multiple candidates and multiple constraints based accurate depth estimation for multi-view stereo[J]. Proceedings of SPIE, 10225, 102251O(2017).

[6] Mishiba K. Fast depth estimation for light field cameras[J]. IEEE Transactions on Image Processing, 29, 4232-4242(2020).

[7] Tao M W, Hadap S, Malik J et al. Depth from combining defocus and correspondence using light-field cameras[C], 673-680(2013).

[8] Tao M W, Srinivasan P P, Malik J et al. Depth from shading, defocus, and correspondence using light-field angular coherence[C], 1940-1948(2015).

[9] Wang T C, Efros A A, Ramamoorthi R. Occlusion-aware depth estimation using light-field cameras[C], 3487-3495(2015).

[10] Pan X H, Zhang T, Wang H. A method for handling multi-occlusion in depth estimation of light field[C], 1069-1073(2019).

[11] Li J Q, Lu M L, Li Z N. Continuous depth map reconstruction from light fields[J]. IEEE Transactions on Image Processing, 24, 3257-3265(2015).

[12] Zhang Y B, Lü H J, Liu Y B et al. Light-field depth estimation via epipolar plane image analysis and locally linear embedding[J]. IEEE Transactions on Circuits and Systems for Video Technology, 27, 739-747(2017).

[13] Chantara W, Ho Y S. Initial depth estimation using EPIs and structure tensor[C], 255-258(2017).

[14] Sheng H, Zhao P, Zhang S et al. Occlusion-aware depth estimation for light field using multi-orientation EPIs[J]. Pattern Recognition, 74, 587-599(2018).

[15] Strecke M, Alperovich A, Goldluecke B. Accurate depth and normal maps from occlusion-aware focal stack symmetry[C], 2529-2537(2017).

[16] Javidnia H, Corcoran P. Application of preconditioned alternating direction method of multipliers in depth from focal stack[J]. Journal of Electronic Imaging, 27, 023019(2018).

[17] Xiao Y H, Wang G J, Hu X W et al. Guided, fusion-based, large depth-of-field 3D imaging using a focal stack[J]. Sensors, 19, 4845(2019).

[18] Chantara W, Jeon M. All-in-focused image combination in the frequency domain using light field images[J]. Applied Sciences, 9, 3752(2019).

[19] Yu Z, Guo X Q, Ling H B et al. Line assisted light field triangulation and stereo matching[C], 2792-2799(2013).

[20] Chen C, Lin H T, Yu Z et al. Light field stereo matching using bilateral statistics of surface cameras[C], 1518-1525(2014).

[21] Heber S, Pock T. Shape from light field meets robust PCA[M]. Fleet D, Pajdla T, Schiele B, et al. Computer Vision-ECCV 2014. Lecture notes in computer science, 8694, 751-767(2014).

[22] Liu C, Qiu J, Zhao S N. Iterative reconstruction of scene depth with fidelity based on light field data[J]. Applied Optics, 56, 3185-3192(2017).

[23] Tao M W, Hadap S, Malik J et al. Depth from combining defocus and correspondence using light-field cameras[C], 673-680(2013).

[24] Wang T C, Efros A A, Ramamoorthi R. Depth estimation with occlusion modeling using light-field cameras[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 38, 2170-2181(2016).

[25] Zhu H, Wang Q, Yu J Y. Occlusion-model guided antiocclusion depth estimation in light field[J]. IEEE Journal of Selected Topics in Signal Processing, 11, 965-978(2017).

[26] Zhang S, Sheng H, Li C et al. Robust depth estimation for light field via spinning parallelogram operator[J]. Computer Vision and Image Understanding, 145, 148-159(2016).

[27] He J M, Qiu J, Liu C. Fusing feature point density and edge information for scene depth estimation[J]. Laser & Optoelectronics Progress, 54, 071101(2017).

[28] Kang X K, Qiu J, Liu C et al. Global imaging based on monomer subset of focal stack architecture[J]. Laser & Optoelectronics Progress, 57, 241101(2020).

[29] le Pendu M, Guillemot C, Smolic A. A Fourier disparity layer representation for light fields[J]. IEEE Transactions on Image Processing, 28, 5740-5753(2019).

[30] le Pendu M, Smolic A. High resolution light field recovery with Fourier disparity layer completion, demosaicing, and super-resolution[C], 19653339(2020).

[31] Dib E, Pendu M L, Guillemot C. Light field compression using Fourier disparity layers[C], 3751-3755(2019).

[32] Xiao Z L, Zhang M, Jin H Y et al. A light field FDL-HSIFT feature in scale-disparity space[C], 1549-1553(2021).

[33] Yang X G, Cao F, Miao D et al. Study on the image grayscale matching algorithm based on similarity measures[J]. Systems Engineering and Electronics, 27, 918-921(2005).

[34] Zitová B, Flusser J. Image registration methods: a survey[J]. Image and Vision Computing, 21, 977-1000(2003).

[35] Wu P, Xu H L, Song W L. A fast NCC image matching algorithm based on wavelet pyramid search strategy[J]. Journal of Harbin Engineering University, 38, 791-796(2017).

[36] Shuaeb S M A A, Kamruzzaman M, Ali M H. Extracting a bounded region from a map using flood fill algorithm[J]. Asian Journal of Research in Computer Science, 14-20(2021).

[37] Ali U, Mahmood M T. Depth enhancement through correlation-based guided filtering in shape from focus[J]. Microscopy Research and Technique, 84, 1368-1374(2021).

[38] Yu H Q, Jia S H, Liu Y B et al. Autofocusing based on cosine similarity in dual-wavelength digital holographic microscopy[J]. Measurement Science and Technology, 32, 045204(2021).

[39] Honauer K, Johannsen O, Kondermann D et al. A dataset and evaluation methodology for depth estimation on 4D light fields[M]. Lai S H, Lepetit V, Nishino K, et al. Computer vision-ACCV 2016. Lecture notes in computer science, 10113, 19-34(2017).