Meta Light Field Event Imaging System (Invited)

Yu Meng; Manchao Bao; Tao Yue; Xuemei Hu

doi:10.3788/LOP241380

[1] Ng R[M]. Digital light field photography(2006).

[2] Fan Q B, Xu W Z, Hu X M et al. Trilobite-inspired neural nanophotonic light-field camera with extreme depth-of-field[J]. Nature Communications, 13, 2130(2022).

[3] Raghavendra R, Yang B, Raja K B et al. A new perspective: face recognition with light-field camera[C](2013).

[4] Liu G C, Huang S, Wei G M et al. Airport bird target detection based on light field statistics[J]. Laser & Optoelectronics Progress, 60, 1410002(2023).

[5] Zhou J W, Yang D, Cui Z L et al. LRFNet: an occlusion robust fusion network for semantic segmentation with light field[C], 1178-1168(2021).

[6] Zhang Q, Li H D, Wang X et al. 3D scene reconstruction with an un-calibrated light field camera[J]. International Journal of Computer Vision, 129, 3006-3026(2021).

[7] Hu X J, Wang C C, Pan Y X et al. 4DLFVD: a 4D light field video dataset[C], 287-292(2021).

[8] Prevedel R, Yoon Y G, Hoffmann M et al. Simultaneous whole-animal 3D imaging of neuronal activity using light-field microscopy[J]. Nature Methods, 11, 727-730(2014).

[9] Zhang Z K, Bai L, Cong L et al. Imaging volumetric dynamics at high speed in mouse and zebrafish brain with confocal light field microscopy[J]. Nature Biotechnology, 39, 74-83(2021).

[10] Illgner K, Restrepo J, Jaiswal S et al. Lightfield imaging for industrial applications[J]. Proceedings of SPIE, 11525, 1152526(2020).

[11] Liang D, Zhang H M, Qiu J. Self-supervised learning for spatial-domain light-field super-resolution imaging[J]. Laser & Optoelectronics Progress, 61, 0411007(2024).

[12] Xu X Y, Deng H P, Xiang S et al. Light field image super-resolution based on feature interaction fusion and attention mechanism[J]. Laser & Optoelectronics Progress, 60, 1410017(2023).

[13] Zhao Z C, Liu C Y, Xu M L et al. Deblurring of light field images based on local maximum gradient and minimum intensity priors[J]. Laser & Optoelectronics Progress, 61, 2037002(2024).

[14] Wu J M, Guo Y D, Deng C et al. An integrated imaging sensor for aberration-corrected 3D photography[J]. Nature, 612, 62-71(2022).

[15] Zeng A, Song S R, Nießner M et al. 3DMatch: learning local geometric descriptors from RGB-D reconstructions[C], 199-208(2017).

[16] Mortensen E N, Deng H L, Shapiro L. A SIFT descriptor with global context[C], 184-190(2005).

[17] Bonaque-González S, Trujillo-Sevilla J M, Velasco-Ocaña M et al. The optics of the human eye at 8.6 µm resolution[J]. Scientific Reports, 11, 23334(2021).

[18] Brandli C, Berner R, Yang M H et al. A 240 × 180 130 dB 3 µs latency global shutter spatiotemporal vision sensor[J]. IEEE Journal of Solid-State Circuits, 49, 2333-2341(2014).

[19] Amir A, Taba B, Berg D et al. A low power, fully event-based gesture recognition system[C], 7388-7397(2017).

[20] Tulyakov S, Bochicchio A, Gehrig D et al. Time lens: event-based frame interpolation with parametric nonlinear flow and multi-scale fusion[C], 17734-17743(2022).

[21] Luo X L, Luo K M, Luo A et al. Learning optical flow from event camera with rendered dataset[C], 9813-9823(2023).

[22] Yang Y X, Han J, Liang J X et al. Learning event guided high dynamic range video reconstruction[C], 13924-13934(2023).

[23] Muglikar M, Bauersfeld L, Moeys D P et al. Event-based shape from polarization[C], 1547-1556(2023).

[24] Bajestani S E M, Beltrame G. Event-based RGB sensing with structured light[C], 5447-5456(2023).

[25] Mascarenas D L, Green A, da Silva M F et al. An event-driven light field, digital coded exposure imager architecture for per-pixel image regeneration in post processing[J]. Proceedings of SPIE, 12693, 1269312(2023).

[26] Kong F P, Lambert A, Joubert D et al. Shack-Hartmann wavefront sensing using spatial-temporal data from an event-based image sensor[J]. Optics Express, 28, 36159-36175(2020).

[27] Bao Y H, Sun L, Ma Y Q et al. Improving fast auto-focus with event polarity[J]. Optics Express, 31, 24025-24044(2023).

[28] Sandamirskaya Y, Kaboli M, Conradt J et al. Neuromorphic computing hardware and neural architectures for robotics[J]. Science Robotics, 7, eabl8419(2022).

[29] Baldwin R W, Liu R X, Almatrafi M et al. Time-ordered recent event (TORE) volumes for event cameras[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 45, 2519-2532(2023).

[30] Osorio D. Spam and the evolution of the fly’s eye[J]. BioEssays, 29, 111-115(2007).

[31] Sherman S M, Koch C. The control of retinogeniculate transmission in the mammalian lateral geniculate nucleus[J]. Experimental Brain Research, 63, 1-20(1986).

[32] Collins R T. A space-sweep approach to true multi-image matching[C], 358-363(1996).

[33] Hu Y H, Liu S C, Delbruck T. v2e: from video frames to realistic DVS events[C], 1312-1321(2021).

[34] Joubert D, Marcireau A, Ralph N et al. Event camera simulator improvements via characterized parameters[J]. Frontiers in Neuroscience, 15, 702765(2021).

[35] Michels T, Petersen A, Palmieri L et al. Simulation of plenoptic cameras[C](2018).

[36] Lumsdaine A, Georgiev T. The focused plenoptic camera[C](2009).

[37] Liu Q S, Xie X F, Zhang X Z et al. Stepwise calibration of plenoptic cameras based on corner features of raw images[J]. Applied Optics, 59, 4209-4219(2020).

[38] Yan C D, Wang X, Zhang X et al. Adaptive event address map denoising for event cameras[J]. IEEE Sensors Journal, 22, 3417-3429(2022).

[39] Feng Y, Lv H Y, Liu H L et al. Event density based denoising method for dynamic vision sensor[J]. Applied Sciences, 10, 2024(2020).

[40] Khodamoradi A, Kastner R. O(N)O(N)-space spatiotemporal filter for reducing noise in neuromorphic vision sensors[J]. IEEE Transactions on Emerging Topics in Computing, 9, 15-23(2021).

微信扫一扫：分享

微信扫一扫：分享