• Chinese Journal of Lasers
  • Vol. 48, Issue 15, 1509001 (2021)
Shujun Xing1,2, Liangcai Cao2,*, Xinzhu Sang1, Xunbo Yu1, and Guofan Jin2
Author Affiliations
  • 1State Key Laboratory of Information Photonics and Optical Communications, Beijing University of Posts and Telecommunications (BUPT), Beijing 100876, China
  • 2State Key Laboratory of Precision Measurement Technology and Instruments, Tsinghua University, Beijing 100084, China
  • show less
    DOI: 10.3788/CJL202148.1509001 Cite this Article Set citation alerts
    Shujun Xing, Liangcai Cao, Xinzhu Sang, Xunbo Yu, Guofan Jin. Overview of Virtual Stereo Content Generation Technology for Super Multi-View Light Field[J]. Chinese Journal of Lasers, 2021, 48(15): 1509001 Copy Citation Text show less
    References

    [1] Sang X. CCTV interview on China science fiction conference 2020[EB/OL]. (2020-10-31)[2020-03-14]. http://file.cgt3d.cn:8013/cctv_interview_bupt.mp4

    [2] Moon P, Spencer D E. Theory of the photic field[J]. Journal of the Franklin Institute, 255, 33-50(1953).

    [3] Levoy M, Hanrahan P. Light field rendering[J]. ACM, 31-42(1996).

    [4] Wang A H, Wang Q H. Overview on autostereoscopic display device based on parallax barrier or lenticular lens[J]. Advanced Display, 20, 12-17(2009).

    [5] Wang P R, Sang X Z, Yu X B et al. Demonstration of a low-crosstalk super multi-view light field display with natural depth cues and smooth motion parallax[J]. Optics Express, 27, 34442-34453(2019).

    [9] Lippmann G. La photographie integrale[J]. Comptes Rendus de l’Académie des Sciences, 146, 446-451(1908).

    [10] Fan F C, Choi S, Jiang C C. Demonstration of perfect holographic display on commercial 4K plane displayer[C]. //Digital Holography and Three-Dimensional Imaging 2015, May 24-28, 2015, Shanghai, China, DW3A, 4(2015).

    [11] Sang X Z, Gao X, Yu X B et al. Interactive floating full-parallax digital three-dimensional light-field display based on wavefront recomposing[J]. Optics Express, 26, 8883-8889(2018).

    [12] Balogh T, Zanetti G, Bouvier E et al. An interactive multi-user holographic environment[C]. //ACM SIGGRAPH 2006 Emerging technologies on-SIGGRAPH ‘06, July 30-August 3, 2006, Boston, Massachusetts., 18-42(2006).

    [13] Agocs T, Balogh T, Forgacs T et al. A large scale interactive holographic display[C]. //IEEE Virtual Reality Conference (VR 2006), March 25-29, 2006, Alexandria, VA, USA., 311(2006).

    [14] Zhong Q, Chen B S, Li H F et al. Multi-projector-type immersive light field display[J]. Chinese Optics Letters, 12, 060009(2014).

    [15] Zhong Q, Peng Y F, Li H F et al. Multiview and light-field reconstruction algorithms for 360° multiple-projector-type 3D display[J]. Applied Optics, 52, 4419-4425(2013).

    [16] Peng Y F, Li H F, Zhong Q et al. Large-sized light field three-dimensional display using multi-projectors and directional diffuser[J]. Optical Engineering, 52, 017402(2013).

    [17] McKay S, Mason S, Mair L S et al. Membrane-mirror-based display for viewing 2D and 3D images[J]. Proceedings of SPIE, 3634, 144-155(1999).

    [19] Silva O H M, Laburú C E. Uma alternativa de baixo custo ao experimento de óptica denominado comercialmente “magic hologram-mirage 3D”[J]. Caderno Brasileiro De Ensino De Física, 32, 246(2014).

    [20] Mahfud J, Matsumaru T. Interactive aerial projection of 3D hologram object[C]. //2016 IEEE International Conference on Robotics and Biomimetics (ROBIO), December 3-7, 2016, Qingdao, China., 1930-1935(2016).

    [21] Tsuchiya K, Koizumi N. Aerial imaging by retro-reflection for mid-air image display and camera viewpoint transfer[J]. IEEE Access, 9, 25110-25117(2021).

    [22] Kim Y M, Jung K M, Min S W. Analysis of off-axis integral floating system using concave mirror[J]. Journal of the Optical Society of Korea, 16, 270-276(2012).

    [23] Yamamoto H, Tomiyama Y, Suyama S. Floating aerial LED signage based on aerial imaging by retro-reflection (AIRR)[J]. Optics Express, 22, 26919-26924(2014).

    [24] Du J Y, Sang X Z, Yu X B et al. Large viewing angle floating three-dimensional light field display based on the spatial data reconstruction (SDR) algorithm[J]. Optics Communications, 475, 126229(2020).

    [26] Huang Z G, Fan C, Han D C et al. A kind of flat plate optical structure: CN207502815U[P](2017).

    [27] Smith S. Method and apparatus for automatic linear shift parallax correction for multi-array image systems: US7738017 B2(2010).

    [28] Liluashvili V, Kalayci S, Fluder E et al. iCAVE: an open source tool for visualizing biomolecular networks in 3D, stereoscopic 3D and immersive 3D[J]. GigaScience, 6, 1-13(2017).

    [29] Yamaji M, Hayashi T. Depth perception in stereo graphics using off-axis projection[J]. Journal of Informatics, 23, 103-127(2005).

    [30] VanArsdale D. Homogeneous transformation matrices for computer graphics[J]. Computers & Graphics, 18, 177-191(1994).

    [31] de Sorbier F, Nozick V, Saito H. Multi-view rendering using GPU for 3-D displays[J]. GSTF International Journal on Computing, 1, 44-49(2010).

    [32] Zhou W P, Tang H, Ji Z. GPU instancing method for crowd animation based on motion capturedata[J]. Journal of Computational Information Systems, 9, 4459-4467(2013).

    [33] do Nascimento B T, Franzin F P, Pozzer C T. GPU-based real-time procedural distribution of vegetation on large-scale virtual terrains[C]. //2018 17th Brazilian Symposium on Computer Games and Digital Entertainment (SBGames), October 29-November 1, 2018, Foz do Iguacu, Brazil., 18434878(2019).

    [34] Wade N J, Hughes P. Fooling the eyes: trompe l’oeil and reverse perspective[J]. Perception, 28, 1115-1119(1999).

    [35] Cook N D, Hayashi T, Amemiya T et al. Effects of visual-field inversions on the reverse-perspective illusion[J]. Perception, 31, 1147-1151(2002).

    [36] Munkberg C J, Akenine-Möller T G, Salvi M et al. Backface culling for motion blur and depth of field[J]. Journal of Graphics, GPU, and Game Tools, 15, 123-139(2010).

    [37] Nyberg D. Analysis of two common hidden surface removal algorithms, Painter’s algorithm & Z-Buffering[EB/OL]. [2021-03-15]. https://xueshu.baidu.com/usercenter/paper/show?paperid=20405c9bcfa94cce386cf9b278b0fdb6&site=xueshu_se

    [38] Purcell T J, Buck I, Mark W R et al. Ray tracing on programmable graphics hardware[J]. ACM Transactions on Graphics, 21, 703-712(2005).

    [39] Xing S J, Sang X Z, Yu X B et al. High-efficient computer-generated integral imaging based on the backward ray-tracing technique and optical reconstruction[J]. Optics Express, 25, 330-338(2017).

    [40] Huo W P, Sang X Z, Xing S J et al. Backward ray tracing based rectification for real-time integral imaging display system[J]. Optics Communications, 458, 124752(2020).

    [41] Parker S G, Robison A, Stich M et al. OptiX: ageneral purpose ray tracing engine[C]. //ACM SIGGRAPH 2010 papers on-SIGGRAPH ‘10, July 26-30, 2010, Los Angeles, California, 1-10(2010).

    [42] Miyazawa T, Koyamada K. A high-speed integrated renderer for interpreting multiple 3D volume data[J]. The Journal of Visualization and Computer Animation, 3, 65-83(1992).

    [43] Ruijters D. Dynamic resolution in GPU-accelerated volume rendering to autostereoscopic multiview lenticular displays[J]. EURASIP Journal on Advances in Signal Processing, 2009, 843753(2008).

    [44] Pang B, Sang X Z, Xing S J et al. High-efficient rendering of the multi-view image for the three-dimensional display based on the backward ray-tracing technique[J]. Optics Communications, 405, 306-311(2017).

    [45] Li Y H, Sang X Z, Xing S J et al. Real-time optical 3D reconstruction based on Monte Carlo integration and recurrent CNNs denoising with the 3D light field display[J]. Optics Express, 27, 22198-22208(2019).

    [46] Huo W, Cheung G, Xin L et al. Depth map super-resolution using synthesized view matching for depth-image-based rendering[C]. //IEEE International Conference on Multimedia & Expo Workshops, July 9-13, 2012, Melbourne, VIC, Australia., 12935944(2012).

    [47] Bravo G, Do L, Zinger S et al. Real-time free-viewpoint DIBR on GPUs for 3DTV systems[C]. //2011 IEEE International Conference on Consumer Electronics-Berlin (ICCE-Berlin), September 6-8, 2011, Berlin, Germany., 1-4(2011).

    [48] Wang L H, Hou C P, Lei J J et al. View generation with DIBR for 3D display system[J]. Multimedia Tools and Applications, 74, 9529-9545(2015).

    [49] Fan Y C, Chen Y C, Chou S Y. Vivid-DIBR based 2D-3D image conversion system for 3D display[J]. Journal of Display Technology, 10, 887-898(2014).

    [50] Li S, Zhu C, Sun M T. Hole filling with multiple reference views in DIBR view synthesis[J]. IEEE Transactions on Multimedia, 20, 1948-1959(2018).

    [51] Yao L, Han Y D, Li X M. Virtual viewpoint synthesis using CUDA acceleration[C]. //Proceedings of the 22nd ACM Conference on Virtual Reality Software and Technology, November 2, 2016, Munich, Germany, 367-368(2016).

    [52] Lin J P, Wang W X, Yao J M et al. Fast multi-view image rendering method based on reverse search for matching[J]. Optik, 180, 953-961(2019).

    [53] Xing S J, Sang X Z, Cao L C et al. A real-time super multiview rendering pipeline for wide viewing-angle and high-resolution 3D displays based on a hybrid rendering technique[J]. IEEE Access, 8, 85750-85759(2020).

    [54] Muftuler L T, Nalcioglu O. Improvement of temporal resolution in fMRI using slice phase encode reordered 3D EPI[J]. Magnetic Resonance in Medicine, 44, 485-490(2000).

    [55] Halle M. Multiple viewpoint rendering[C]. //SIGGRAPH’98: Proceedings of the 25th Annual Conference on Computer Graphics and Interactive Techniques, 243-254(1998).

    [56] Guan Y X, Sang X Z, Xing S J et al. Parallel multi-view polygon rasterization for 3D light field display[J]. Optics Express, 28, 34406-34421(2020).

    [57] van Berkel C. Image preparation for 3D LCD[J]. Proceedings of SPIE, 3639, 84-91(1999).

    [58] Lee S, Park J, Heo J et al. Autostereoscopic 3D display using directional subpixel rendering[J]. Optics Express, 26, 20233(2018).

    [59] Li D X, Zang D N, Qiao X T et al. 3D synthesis and crosstalk reduction for lenticular autostereoscopic displays[J]. Journal of Display Technology, 11, 939-946(2015).

    [60] Yamamoto K, Ichihashi Y, Senoh T et al. Simplified homography matrix for a large-scale camera array system[J]. Applied Optics, 50, H203-H210(2011).

    [61] Xing S J, Liu S, Sang X Z. Multi-projector three-dimensional display for 3D Geographic Information System[J]. Optik, 139, 385-396(2017).

    [62] Ruppert R, Atashband F. UDP broadcast for user interface in a download and configuration gaming method: US8260946B1[P](2010).

    [63] Martin T. The NFS lite CE installation on OSG[EB/OL]. (2016-12-19)[2020-03-14]. https://www.cac.cornell.edu/wiki/index.php?title=OSG_Cluster

    Shujun Xing, Liangcai Cao, Xinzhu Sang, Xunbo Yu, Guofan Jin. Overview of Virtual Stereo Content Generation Technology for Super Multi-View Light Field[J]. Chinese Journal of Lasers, 2021, 48(15): 1509001
    Download Citation