• Journal of Innovative Optical Health Sciences
  • Vol. 16, Issue 1, 2230017 (2023)
Chengqiang Yi*, Lanxin Zhu*, Dongyu Li*, and Peng Fei**
Author Affiliations
  • School of Optical and Electronic Information-Wuhan National Laboratory for Optoelectronics, Huazhong University of Science and Technology, Wuhan 430074, P. R. China
  • show less
    DOI: 10.1142/S1793545822300178 Cite this Article
    Chengqiang Yi, Lanxin Zhu, Dongyu Li, Peng Fei. Light field microscopy in biological imaging[J]. Journal of Innovative Optical Health Sciences, 2023, 16(1): 2230017 Copy Citation Text show less
    References

    [1] T. Schrödel, R. Prevedel, K. Aumayr, M. Zimmer, A. Vaziri. Brain-wide 3D imaging of neuronal activity in Caenorhabditis elegans with sculpted light. Nat. Meth., 10, 1013-1020(2013).

    [2] J. P. Nguyen, F. B. Shipley, A. N. Linder, G. S. Plummer, M. Liu, S. U. Setru, J. W. Shaevitz, A. M. Leifer. Whole-brain calcium imaging with cellular resolution in freely behaving Caenorhabditis elegans. Proc. Natl. Acad. Sci., 113, E1074-E1081(2016).

    [3] A. T. Ritter, Y. Asano, J. C. Stinchcombe, N. M. G. Dieckmann, B.-C. Chen, C. Gawden-Bone, S. van Engelenburg, W. Legant, L. Gao, M. W. Davidson, E. Betzig, J. Lippincott-Schwartz, M. G. Gillian. Actin depletion initiates events leading to granule secretion at the immunological synapse. Immunity, 42, 864-876(2015).

    [4] M. Mickoleit, B. Schmid, M. Weber, F. O. Fahrbach, S. Hombach, S. Reischauer, J. Huisken. High-resolution reconstruction of the beating zebrafish heart. Nat. Meth., 11, 919-922(2014).

    [5] V. Voleti, K. B. Patel, W. Li, C. Perez Campos, S. Bharadwaj, H. Yu, C. Ford, M. J. Casper, R. W. Yan, W. Liang, C. Wen, K. D. Kimura, K. L. Targoff, E. M. C. Hillman. Real-time volumetric microscopy of in vivo dynamics and large-scale samples with SCAPE 2.0. Nat. Meth., 16, 1054-1062(2019).

    [6] Z. Wang, L. Zhu, H. Zhang, G. Li, C. Yi, Y. Li, Y. Yang, Y. Ding, M. Zhen, S. Gao, T. K. Hsiai, P. Fei. Real-time volumetric reconstruction of biological dynamics with light-field microscopy and deep learning. Nat. Meth., 18, 551-556(2021).

    [7] W. Denk, J. H. Strickler, W. W. Webb. Two-photon laser scanning fluorescence microscopy. Science, 248, 73-76(1990).

    [8] N. G. Horton, K. Wang, D. Kobat, C. G. Clark, F. W. Wise, C. B. Schaffer, C. Xu. In vivo three-photon microscopy of subcortical structures within an intact mouse brain. Nat Photon., 7, 205-209(2013).

    [9] J. Huisken, J. Swoger, F. Del Bene, J. Wittbrodt, E. H. Stelzer. Optical sectioning deep inside live embryos by selective plane illumination microscopy. Science, 305, 1007-1009(2004).

    [10] T. A. Planchon, L. Gao, D. E. Milkie, M. W. Davidson, J. A. Galbraith, C. G. Galbraith, E. Betzig. Rapid three-dimensional isotropic imaging of living cells using Bessel beam plane illumination. Nat. Meth., 8, 417-423(2011).

    [11] B.-C. Chen, W. R. Legant, K. Wang, L. Shao, D. E. Milkie, M. W. Davidson, C. Janetopoulos, X. S. Wu, J. A. Hammer, Z. Liu, B. P. English, Y. Mimori-Kiyosue, D. P. Romero, A. T. Ritter, J. Lippincott-Schwartz, L. Fritz-Laylin, R. D. Mullins, D. M. Mitchell, J. N. Bembenek, A.-C. Reymann, R. Böhme, S. W. Grill, J. T. Wang, G. Seydoux, U. S. Tulu, D. P. Kiehart, E. Betzig. Lattice light-sheet microscopy: Imaging molecules to embryos at high spatiotemporal resolution. Science, 346, 1257998(2014).

    [12] S. Abrahamsson, J. Chen, B. Hajj, S. Stallinga, A. Y. Katsov, J. Wisniewski, G. Mizuguchi, P. Soule, F. Mueller, C. D. Darzacq, X. Darzacq, C. Wu, C. I. Bargmann, D. A. Agard, M. Dahan, M. G. L. Gustafsson. Fast multicolor 3D imaging using aberration-corrected multifocus microscopy. Nat. Meth., 10, 60-63(2013).

    [13] J. Rosen, G. Brooker. Non-scanning motionless fluorescence three-dimensional holographic microscopy. Nat. Photon., 2, 190-195(2008).

    [14] K. Yanny, N. Antipa, W. Liberti, S. Dehaeck, K. Monakhova, F. L. Liu, K. Shen, R. Ng, L. Waller. Miniscope3D: Optimized single-shot miniature 3D fluorescence microscopy. Light: Sci. Appl., 9, 171(2020).

    [15] N. Antipa, G. Kuo, R. Heckel, B. Mildenhall, E. Bostan, R. Ng, L. Waller. DiffuserCam: Lensless single-exposure 3D imaging. Optica, 5, 1-9(2018).

    [16] R. Prevedel, Y.-G. Yoon, M. Hoffmann, N. Pak, G. Wetzstein, S. Kato, T. Schrödel, R. Raskar, M. Zimmer, E. S. Boyden. Simultaneous whole-animal 3D imaging of neuronal activity using light-field microscopy. Nat. Meth., 11, 727-730(2014).

    [17] M. Levoy, R. Ng, A. Adams, M. Footer, M. Horowitz. Light field microscopy. ACM Trans. Graph., 25, 924-934(2006).

    [18] J. Wu, Z. Lu, D. Jiang, Y. Guo, H. Qiao, Y. Zhang, T. Zhu, Y. Cai, X. Zhang, K. Zhanghao, H. Xie, T. Yan, G. Zhang, X. Li, Z. Jiang, X. Lin, L. Fang, B. Zhou, P. Xi, J. Fan, L. Yu, Q. Dai. Iterative tomography with digital adaptive optics permits hour-long intravital observation of 3D subcellular dynamics at millisecond scale. Cell, 184, 3318–3332.e17(2021).

    [19] X. Hua, W. Liu, S. Jia. High-resolution Fourier light-field microscopy for volumetric multi-color live-cell imaging. Optica, 8, 614-620(2021).

    [20] L. Zhu, C. Yi, G. Li, Y. Zhao, P. Fei. Deep-learning based dual-view light-field microscopy enabling high-resolution 3D imaging of dense signals. Proc. Biophotonics Congr. C. M. K. H. C. W. M. Q. K. S.-K. M. D. N. E. D. C. F. O. L. E. V. M. O.Boudoux, E. Buckley, DTh2A.3(2021).

    [21] Z. Zhang, L. Bai, L. Cong, P. Yu, T. Zhang, W. Shi, F. Li, J. Du, K. Wang. Imaging volumetric dynamics at high speed in mouse and zebrafish brain with confocal light field microscopy. Nat. Biotechnol., 39, 74-83(2021).

    [22] R. Prevedel, Y.-G. Yoon, M. Hoffmann, N. Pak, G. Wetzstein, S. Kato, T. Schrödel, R. Raskar, M. Zimmer, E. S. Boyden, A. Vaziri. Simultaneous whole-animal 3D imaging of neuronal activity using light-field microscopy. Nat. Meth., 11, 727-730(2014).

    [23] N. Wagner, N. Norlin, J. Gierten, G. de Medeiros, B. Balázs, J. Wittbrodt, L. Hufnagel, R. Prevedel. Instantaneous isotropic volumetric imaging of fast biological processes. Nat. Meth., 16, 497-500(2019).

    [24] L. Cong, Z. Wang, Y. Chai, W. Hang, C. Shang, W. Yang, L. Bai, J. Du, K. Wang, Q. Wen. Rapid whole brain imaging of neural activity in freely behaving larval zebrafish (Danio rerio). eLife, 6, e28158(2017).

    [25] N. Wagner, F. Beuttenmueller, N. Norlin, J. Gierten, J. C. Boffi, J. Wittbrodt, M. Weigert, L. Hufnagel, R. Prevedel, A. Kreshuk. Deep learning-enhanced light-field imaging with continuous validation. Nat. Meth., 18, 557-563(2021).

    [26] M. Levoy, Z. Zhang, I. McDowall. Recording and controlling the 4D light field in a microscope using microlens arrays. J. Microsc., 235, 144-162(2009).

    [27] M. Broxton, L. Grosenick, S. Yang, N. Cohen, A. Andalman, K. Deisseroth, M. Levoy. Wave optics theory and 3-D deconvolution for the light field microscope. Opt. Exp., 21, 25418-25439(2013).

    [28] N. Cohen, S. Yang, A. Andalman, M. Broxton, L. Grosenick, K. Deisseroth, M. Horowitz, M. Levoy. Enhancing the performance of the light field microscope using wavefront coding. Opt. Exp., 22, 24817-24839(2014).

    [29] Y.-T. Lim, J.-H. Park, K.-C. Kwon, N. Kim. Resolution-enhanced integral imaging microscopy that uses lens array shifting. Opt. Exp., 17, 19253-19263(2009).

    [30] Y. Sung. Snapshot projection optical tomography. Phys. Rev. Appl., 13, 054048(2020).

    [31] K. He, X. Wang, Z. W. Wang, H. Yi, N. F. Scherer, A. K. Katsaggelos, O. Cossairt. Snapshot multifocal light field microscopy. Opt. Exp., 28, 12108-12120(2020).

    [32] S. Madaan, K. Keomanee-Dizon, M. Jones, C. Zhong, A. Nadtochiy, P. Luu, S. E. Fraser, T. V. Truong. Single-objective selective-volume illumination microscopy enables high-contrast light-field imaging. Opt. Lett., 46, 2860-2863(2021).

    [33] T. V. Truong, D. B. Holland, S. Madaan, A. Andreev, K. Keomanee-Dizon, J. V. Troll, D. E. S. Koo, M. J. McFall-Ngai, S. E. Fraser. High-contrast, synchronous volumetric imaging with selective volume illumination microscopy. Commun. Biol., 3, 74(2020).

    [34] Z. Lu, J. Wu, H. Qiao, Y. Zhou, T. Yan, Z. Zhou, X. Zhang, J. Fan, Q. Dai. Phase-space deconvolution for light field microscopy. Opt. Exp., 27, 18131-18145(2019).

    [35] A. Stefanoiu, J. Page, P. Symvoulidis, G. G. Westmeyer, T. Lasser. Artifact-free deconvolution in light field microscopy. Opt. Exp., 27, 31644-31666(2019).

    [36] T. Nöbauer, O. Skocek, A. J. Pernía-Andrade, L. Weilguny, F. M. Traub, M. I. Molodtsov, A. Vaziri. Video rate volumetric Ca2+ imaging across cortex using seeded iterative demixing (SID) microscopy. Nat. Meth., 14, 811-818(2017).

    [37] Y. Zhang, Z. Lu, J. Wu, X. Lin, D. Jiang, Y. Cai, J. Xie, Y. Wang, T. Zhu, X. Ji, Q. Dai. Computational optical sectioning with an incoherent multiscale scattering model for light-field microscopy. Nat. Commun., 12, 6391(2021).

    [38] Y. Zhang, B. Xiong, Y. Zhang, Z. Lu, J. Wu, Q. Dai. DiLFM: An artifact-suppressed and noise-robust light-field microscopy through dictionary learning. Light Sci. Appl., 10, 152(2021).

    [39] J. He, Y. Cai, J. Wu, Q. Dai. Spatial-temporal low-rank prior for low-light volumetric fluorescence imaging. Opt. Exp., 29, 40721-40733(2021).

    [40] C. Guo, W. Liu, X. Hua, H. Li, S. Jia. Fourier light-field microscopy. Opt. Exp., 27, 25573-25594(2019).

    [41] W. Zhao, S. Zhao, L. Li, X. Huang, S. Xing, Y. Zhang, G. Qiu, Z. Han, Y. Shang, D.-E. Sun, C. Shan, R. Wu, L. Gu, S. Zhang, R. Chen, J. Xiao, Y. Mo, J. Wang, W. Ji, X. Chen, B. Ding, Y. Liu, H. Mao, B.-L. Song, J. Tan, J. Liu, H. Li, L. Chen. Sparse deconvolution improves the resolution of live-cell super-resolution fluorescence microscopy. Nat. Biotechnol., 40, 606-617(2022).

    [42] K. Zhang, W. Zuo, Y. Chen, D. Meng, L. Zhang. Beyond a gaussian denoiser: Residual learning of deep cnn for image denoising. IEEE Trans. Image Process., 26, 3142-3155(2017).

    [43] C. Ledig, L. Theis, F. Huszár, J. Caballero, A. Cunningham, A. Acosta, A. Aitken, A. Tejani, J. Totz, Z. Wang. Photo-realistic single image super-resolution using a generative adversarial network. Proc. IEEE Conf. Computer Vision and Pattern Recognition, 4681-4690(2017).

    [45] H. Zhang, C. Fang, X. Xie, Y. Yang, W. Mei, D. Jin, P. Fei. High-throughput, high-resolution deep learning microscopy based on registration-free generative adversarial network. Biomed. Opt. Exp., 10, 1044-1063(2019).

    [46] M. Weigert, U. Schmidt, T. Boothe, A. Müller, A. Dibrov, A. Jain, B. Wilhelm, D. Schmidt, C. Broaddus, S. Culley, M. Rocha-Martins, F. Segovia-Miranda, C. Norden, R. Henriques, M. Zerial, M. Solimena, J. Rink, P. Tomancak, L. Royer, F. Jug, E. W. Myers. Content-aware image restoration: pushing the limits of fluorescence microscopy. Nat. Meth., 15, 1090-1097(2018).

    [47] Y. Zhao, M. Zhang, W. Zhang, Y. Zhou, L. Chen, Q. Liu, P. Wang, R. Chen, X. Duan, F. Chen, H. Deng, Y. Wei, P. Fei, Y.-H. Zhang. Isotropic super-resolution light-sheet microscopy of dynamic intracellular structures at subsecond timescales. Nat. Meth., 19, 359-369(2022).

    [48] C. Qiao, D. Li, Y. Guo, C. Liu, T. Jiang, Q. Dai, D. Li. Evaluation and development of deep neural networks for image super-resolution in optical microscopy. Nat. Meth., 18, 194-202(2021).

    [49] Y. Wu, Y. Rivenson, H. Wang, Y. Luo, E. Ben-David, L. A. Bentolila, C. Pritz, A. Ozcan. Three-dimensional virtual refocusing of fluorescence microscopy images using deep learning. Nat. Meth., 16, 1323-1331(2019).

    [50] L. Huang, H. Chen, Y. Luo, Y. Rivenson, A. Ozcan. Recurrent neural network-based volumetric fluorescence microscopy. Light Sci. Appl., 10, 62(2021).

    [51] H. Zhang, Y. Zhao, C. Fang, G. Li, M. Zhang, Y.-H. Zhang, P. Fei. Exceeding the limits of 3D fluorescence microscopy using a dual-stage-processing network. Optica, 7, 1627-1640(2020).

    [52] L. Kong, C. Lian, D. Huang, Y. Hu, Q. Zhou. Breaking the dilemma of medical image-to-image translation. Adv. Neural Inf. Process. Syst., 34, 1-15(2021).

    [53] X. Li, G. Zhang, J. Wu, Y. Zhang, Z. Zhao, X. Lin, H. Qiao, H. Xie, H. Wang, L. Fang, Q. Dai. Reinforcing neuron extraction and spike inference in calcium imaging using deep self-supervised denoising. Nat. Meth., 18, 1395-1400(2021).

    [54] F. Wang, C. Wang, M. Chen, W. Gong, Y. Zhang, S. Han, G. Situ. Far-field super-resolution ghost imaging with a deep neural network constraint. Light Sci. Appl., 11, 1(2022).

    [55] V. Eisner, M. Picard, G. Hajnóczky. Mitochondrial dynamics in adaptive and maladaptive cellular stress responses. Nat. Cell Biol., 20, 755-765(2018).

    [56] D. Jiang, Z. Jiang, D. Lu, X. Wang, H. Liang, J. Zhang, Y. Meng, Y. Li, D. Wu, Y. Huang, Y. Chen, H. Deng, Q. Wu, J. Xiong, A. Meng, L. Yu. Migrasomes provide regional cues for organ morphogenesis during zebrafish gastrulation. Nat. Cell Biol., 21, 966-977(2019).

    [57] Y. C. Wong, S. Kim, W. Peng, D. Krainc. Regulation and function of mitochondria–lysosome membrane contact sites in cellular homeostasis. Trends Cell Biol., 29, 500-513(2019).

    [58] K. M. Dean, P. Roudot, E. S. Welf, G. Danuser, R. Fiolka. Deconvolution-free subcellular imaging with axially swept light sheet microscopy. Biophys. J., 108, 2807-2815(2015).

    [59] B. Gao, L. Gao, F. Wang. Single-cell volumetric imaging with light field microscopy: Advances in systems and algorithms. J. Innov. Opt. Health Sci., 2230008. https://doi.org/10.1142/S17935458223000872230008-1

    [60] H. Li, C. Guo, D. Kim-Holzapfel, W. Li, Y. Altshuller, B. Schroeder, W. Liu, Y. Meng, J. B. French, K.-I. Takamaru, M. A. Frohman, S. Jia. Fast, volumetric live-cell imaging using high-resolution light-field microscopy. Biomed. Opt. Exp., 10, 29-49(2019).

    [61] J. Bakkers. Zebrafish as a model to study cardiac development and human cardiac disease. Cardiovasc. Res., 91, 279-288(2011).

    [62] P. J. Babin, C. Goizet, D. Raldúa. Zebrafish models of human motor neuron diseases: Advantages and limitations. Prog. Neurobiol., 118, 36-58(2014).

    [63] M. C. K. Leung, P. L. Williams, A. Benedetto, C. Au, K. J. Helmcke, M. Aschner, J. N. Meyer. Caenorhabditis elegans: An emerging model in biomedical and environmental toxicology. Toxicol. Sci., 106, 5-28(2008).

    [64] J. V. Cramer, B. Gesierich, S. Roth, M. Dichgans, M. Düring, A. Liesz. In vivo widefield calcium imaging of the mouse cortex for analysis of network connectivity in health and brain disease. NeuroImage, 199, 570-584(2019).

    [65] T. Zhu, L. Zhu, Y. Li, X. Chen, M. He, G. Li, H. Zhang, S. Gao, P. Fei. High-speed large-scale 4D activities mapping of moving C. elegans by deep-learning-enabled light-field microscopy on a chip. Sens. Actuators B, Chem., 348, 130638(2021).

    [66] Z. Wang, Y. Ding, S. Satta, M. Roustaei, P. Fei, T. K. Hsiai. A hybrid of light-field and light-sheet imaging to study myocardial function and intracardiac blood flow during zebrafish development. PLoS Comput. Biol., 17, e1009175(2021).

    [67] O. Skocek, T. Nöbauer, L. Weilguny, F. Martínez Traub, C. N. Xia, M. I. Molodtsov, A. Grama, M. Yamagata, D. Aharoni, D. D. Cox, P. Golshani, A. Vaziri. High-speed volumetric imaging of neuronal activity in freely moving rodents. Nat. Meth., 15, 429-432(2018).

    [70] W. Williem, I. K. Park. Robust light field depth estimation for noisy scene with occlusion. Proc. IEEE Conf. Computer Vision and Pattern Recognition, 4396-4404(2016).

    [71] Y. Wang, J. Yang, Y. Guo, C. Xiao, W. An. Selective light field refocusing for camera arrays using bokeh rendering and superresolution. IEEE Signal Process. Lett., 26, 204-208(2018).

    [72] D. Li, H. Zhang, L. L. Streich, Y. Wang, P. Lu, L. Wang, R. Prevedel, J. Qian. AIE-nanoparticle assisted ultra-deep three-photon microscopy in the in vivo mouse brain under 1300 nm excitation. Mater. Chem. Front., 5, 3201-3208(2021).

    [73] D. Wang, S. Xu, P. Pant, E. Redington, S. Soltanian-Zadeh, S. Farsiu, Y. Gong. Hybrid light-sheet and light-field microscope for high resolution and large volume neuroimaging. Biomed. Opt. Exp., 10, 6595-6610(2019).

    [74] J. Lim, K. Lee, K. H. Jin, S. Shin, S. Lee, Y. Park, J. C. Ye. Comparative study of iterative reconstruction algorithms for missing cone problems in optical diffraction tomography. Opt. Exp., 23, 16933-16948(2015).

    [75] J. L. Fan, J. A. Rivera, W. Sun, J. Peterson, H. Haeberle, S. Rubin, N. Ji. High-speed volumetric two-photon fluorescence imaging of neurovascular dynamics. Nat. Commun., 11, 1-12(2020).

    Chengqiang Yi, Lanxin Zhu, Dongyu Li, Peng Fei. Light field microscopy in biological imaging[J]. Journal of Innovative Optical Health Sciences, 2023, 16(1): 2230017
    Download Citation