FourierCam: a camera for video spectrum acquisition in a single shot

Chengyang Hu; Honghao Huang; Minghua Chen; Sigang Yang; Hongwei Chen

doi:10.1364/PRJ.412491

[1] J. N. Mait, G. W. Euliss, R. A. Athale. Computational imaging. Adv. Opt. Photon., 10, 409-483(2018).

[2] J. Liang, L. V. Wang. Single-shot ultrafast optical imaging. Optica, 5, 1113-1127(2018).

[3] G. Gallego, T. Delbruck, G. M. Orchard, C. Bartolozzi, B. Taba, A. Censi, S. Leutenegger, A. Davison, J. Conradt, K. Daniilidis, D. Scaramuzza. Event-based vision: a survey. IEEE Trans. Pattern Anal. Mach. Intell.(2021).

[4] Z. W. Wang, V. Vineet, F. Pittaluga, S. N. Sinha, O. Cossairt, S. B. Kang. Privacy-preserving action recognition using coded aperture videos. IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), 1-10(2019).

[5] T. Ouni, W. Ayedi, M. Abid. New low complexity DCT based video compression method. International Conference on Telecommunications, 202-207(2009).

[6] W. Wang, J. Yang, W. Gao. Modeling background and segmenting moving objects from compressed video. IEEE Trans. Circuits Syst. Video Technol., 18, 670-681(2008).

[7] D.-M. Tsai, W.-Y. Chiu. Motion detection using Fourier image reconstruction. Pattern Recogn. Lett., 29, 2145-2155(2008).

[8] T.-H. Oh, J.-Y. Lee, I. S. Kweon. Real-time motion detection based on discrete cosine transform. 19th IEEE International Conference on Image Processing, 2381-2384(2012).

[9] K. Xu, M. Qin, F. Sun, Y. Wang, Y.-K. Chen, F. Ren. Learning in the frequency domain. IEEE/CVF Conference on Computer Vision and Pattern Recognition, 1740-1749(2020).

[10] D. Doherty, G. Hewlett. 10.4: phased reset timing for improved digital micromirror device (DMD) brightness. SID Symp. Dig. Tech. Papers, 29, 125-128(1998).

[11] S. Ojha, S. Sakhare. Image processing techniques for object tracking in video surveillance: a survey. International Conference on Pervasive Computing (ICPC), 1-6(2015).

[12] I. Ishii, S. Takemoto, T. Takaki, M. Takamoto, K. Imon, K. Hirakawa. Real-time laryngoscopic measurements of vocal-fold vibrations. Annual International Conference of the IEEE Engineering in Medicine and Biology Society, 6623-6626(2011).

[13] A. Davis, M. Rubinstein, N. Wadhwa, G. J. Mysore, F. Durand, W. T. Freeman. The visual microphone: passive recovery of sound from video. ACM Trans. Graph., 33, 79(2014).

[14] A. Davis, K. L. Bouman, J. G. Chen, M. Rubinstein, F. Durand, W. T. Freeman. Visual vibrometry: estimating material properties from small motion in video. IEEE/CVF Conference on Computer Vision and Pattern Recognition, 5335-5343(2015).

[15] G. Wallace. The JPEG still picture compression standard. IEEE Trans. Consum. Electron., 38, xviii-xxxiv(1992).

[16] Z. Zhang, X. Wang, G. Zheng, J. Zhong. Fast Fourier single-pixel imaging via binary illumination. Sci. Rep., 7, 12029(2017).

[17] L. Bian, J. Suo, X. Hu, F. Chen, Q. Dai. Efficient single pixel imaging in Fourier space. J. Opt., 18, 085704(2016).

[18] B. E. Bayer. Color imaging array. U.S. patent(1976).

[19] H. S. Malvar, L.-W. He, R. Cutler. High-quality linear interpolation for demosaicing of Bayer-patterned color images. IEEE International Conference on Acoustics, Speech, and Signal Processing, iii-485-8(2004).

[20] R. Ramanath, W. E. Snyder, G. L. Bilbro, W. A. Sander. Demosaicking methods for Bayer color arrays. J. Electron. Imaging, 11, 306-315(2002).

[21] W. Chen, J. Wilson, S. Tyree, K. Q. Weinberger, Y. Chen. Compressing convolutional neural networks in the frequency domain. 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 1475-1484(2016).

[22] H.-S. Choi, J.-H. Kim, J. Huh, A. Kim, J.-W. Ha, K. Lee. Phase-aware speech enhancement with deep complex U-Net. International Conference on Learning Representations, 1-20(2019).

[23] T. Baltrušaitis, C. Ahuja, L.-P. Morency. Multimodal machine learning: a survey and taxonomy. IEEE Trans. Pattern Anal. Mach. Intell., 41, 423-443(2019).

[24] S. Ri, M. Fujigaki, T. Matui, Y. Morimoto. Accurate pixel-to-pixel correspondence adjustment in a digital micromirror device camera by using the phase-shifting Moiré method. Appl. Opt., 45, 6940-6946(2006).

[25] G. Bub, M. Tecza, M. Helmes, P. Lee, P. Kohl. Temporal pixel multiplexing for simultaneous high-speed, high-resolution imaging. Nat Methods, 7, 209-211(2010).

[26] K. Daniilidis, D. Hutchison, P. Maragos, T. Kanade, J. Kittler, N. Paragios, J. M. Kleinberg, F. Mattern, J. C. Mitchell, M. Naor, O. Nierstrasz, C. Pandu Rangan, B. Steffen, M. Sudan, D. Terzopoulos, D. Tygar, M. Y. Vardi, G. Weikum, M. Gupta, A. Agrawal, A. Veeraraghavan, S. G. Narasimhan. Flexible voxels for motion-aware videography. Computer Vision—ECCV, 6311, 100-114(2010).

CLP Journals