• Photonics Research
  • Vol. 2, Issue 3, 87 (2014)
Juanjuan Zheng1, Peng Gao1、2, Baoli Yao1、*, Tong Ye3, Ming Lei1, Junwei Min1, Dan Dan1, Yanlong Yang1, and and Shaohui Yan1
Author Affiliations
  • 1State Key Laboratory of Transient Optics and Photonics, Xi’an Institute of Optics and Precision Mechanics, Chinese Academy of Sciences, Xi’an 710119, China
  • 2Institut fur Technische Optik, Universitat Stuttgart, Pfaffenwaldring 9, 70569 Stuttgart, Germany
  • 3Department of Bioengineering, Clemson University, Clemson-MUSC Bioengineering Program, Charleston, South Carolina 29425, USA
  • show less
    DOI: 10.1364/PRJ.2.000087 Cite this Article Set citation alerts
    Juanjuan Zheng, Peng Gao, Baoli Yao, Tong Ye, Ming Lei, Junwei Min, Dan Dan, Yanlong Yang, and Shaohui Yan, "Digital holographic microscopy with phase-shift-free structured illumination," Photonics Res. 2, 87 (2014) Copy Citation Text show less

    Abstract

    When structured illumination is used in digital holographic microscopy (DHM), each direction of the illumination fringe is required to be shifted at least three times to perform the phase-shifting reconstruction. In this paper, we propose a scheme for spatial resolution enhancement of DHM by using the structured illumination but without phase shifting. The structured illuminations of different directions, which are generated by a spatial light modulator, illuminate the sample sequentially in the object plane. The formed object waves interfere with a reference wave in an off-axis configuration, and a CCD camera records the generated hologram. After the object waves are reconstructed numerically, a synthetic aperture is performed by an iterative algorithm to enhance the spatial resolution. The resolution improvement of the proposed method is proved and demonstrated by both simulation and experiment.

    1. INTRODUCTION

    Digital holographic microscopy (DHM) can provide real-time quantitative phase contrast imaging and has become one of the most extensively used tools in the life and material sciences and industries [15]. Usually in DHM, the specimen is illuminated by a plane wave, and the spatial resolution is limited by the wavelength (λ) and the numerical aperture (NA) of the objective lens [6]. The improvement of the spatial resolution of DHM can be done by using a short wavelength, although it presents possible photo-damage and photo-toxicity to certain types of specimens (e.g., biological tissues) [7]. Another approach is to synthesize a larger hologram through moving the sensor [8], scanning the object [9], or inserting a diffraction grating between object and sensor [1012]. Off-axis illumination can also improve the resolution by synthesizing a large effective NA. For the off-axis illumination, full spatial frequency coverage is usually achieved by illuminating the object sequentially with different directions of plane waves [1315]. Another possibility is to use simultaneous illumination with multiple beams with polarization multiplexing [16], or by using vertical cavity surface emitting lasers (VCSEL) [17]. Speckle field illumination was also proposed to improve the resolution of DHM, and the resolution enhancement has been achieved by averaging the object waves under hundreds of different speckle illuminations [18]. Furthermore, the spatial resolution of microscopy can also be improved by projecting a periodic pattern onto the object to be investigated and shifting the illumination patterns three times [19,20]. Usually, such structured illumination is used to obtain resolution improvement for intensity-modulated objects. Recently, Mudassar and Hussain [21,22] applied a scheme for phase imaging by illuminating the object with patterns generated by interference between the beams delivered by two fibers. Ma et al. [23] generated the structured illumination by using a diffraction grating and applied it to DHM. Compared with the off-axis and speckle illumination [1318], structured illumination is more compatible with the inline DHM due to the ease of phase-shifting operation, which can be realized by laterally shifting the structured illumination. Nowadays, the invention and advance of spatial light modulators (SLMs) and digital micromirror devices (DMDs) enable one to generate and shift the structured illuminations without mechanical movement, opening up the possibility for high-speed and high-resolution synthetic aperture imaging.

    In our recent paper [24], we also presented the structured illumination generated by SLM for resolution enhancement and autofocusing in DHM. In order to separate the information carried by the ±1st diffraction orders of structured illumination, each direction of the illumination fringes is required to be shifted laterally at least three times. The quantity shifted has to be controlled precisely in order to perform the phase shifting in the reconstruction. This requirement increases the cost of the setup and also retards the fast imaging. In this paper, we propose a scheme for structured illumination without phase shifting in DHM for resolution enhancement. An iterative algorithm is used to synthesize a larger NA among these object waves under different structured illuminations.

    2. PRINCIPLE AND METHOD

    The setup used for our investigation is schematically shown in Fig. 1. A laser diode with the wavelength 635 nm is used as the light source. The laser beam is expanded and directed onto a SLM to generate the structured illumination. A series of one-dimensional binary phase gratings with orientation rotated by m×π/M (m=0,1,2,M1, here M is the number of gratings) are loaded sequentially on the SLM. The light modulated by the SLM is de-magnified and projected onto the object plane by the relay optics (L1MO1), which allows for passing only the 0th, ±1st orders produced by each binary grating, and thus the filtered patterns projected on the object are sinusoidal. Under these illuminations, the object waves are magnified by a telescope system composed of the microscopic objective MO2 and the tube lens L2. The magnified object waves interfere with the off-axis reference wave to form off-axis holograms, which are recorded by the CCD camera.

    Schematic of DHM with structured illumination.

    Figure 1.Schematic of DHM with structured illumination.

    For convenience of description, we denote the complex amplitude of the ith illumination field with Aillumi, the off-axis reference wave with R, and the intensity distribution of the ith recorded hologram without specimen by Iillumi=|R+Aillumi|2, respectively. When a specimen is inserted and illuminated by the field Aillumi, we denote the wave transmitting through the specimen with AOi and the corresponding hologram with Ioi=|R+AOi|2. Provided that the sample is located in such a way that its image plane has a distance Δz from the CCD camera, the object waves can be numerically reconstructed by using the angular spectrum propagation: Here FT{·} and FT1{·} denote the Fourier transform and its inverse, respectively. H=exp{ikΔz[1(λξ)2(λη)2]1/2}, ξ and η are the spatial coordinates in the frequency domain. The window function Wf(ξ,η) is used to select the frequency spectrum of the primary lobe. It is worth mentioning that the defocus distance Δz can be determined numerically by searching the minimal difference between the reconstructions Oi(Δz)=Aoi/Aillumi and Oj(Δz)=Aoj/Aillumj with respect to different propagation distance Δz [24].

    The schematic for the resolution improvement of DHM by the structured illumination is shown in Fig. 2. Each structured illumination can be seen as a superposition of two plane waves, which propagates along the ±1st diffraction orders of the illumination. The two plane waves shift the specimen spectrum in two different directions in the Fourier plane, as shown in Fig. 2(a), middle. Usually, some high frequency components of the object [see the four black dots in Fig. 2(a), left], which are beyond the system aperture, will be cut off by the imaging system aperture under the on-axis plane wave illumination. But under the structured illumination, these high frequency components are downshifted and pass through the system [see the three dots in Fig. 2(a), right]. After these frequency components are shifted back to their original positions, the resolution of the DHM imaging can be improved accordingly. In our experiment, we use the structured illumination that is generated by the 0th, +1st, and 1st diffraction orders of the loaded binary grating. The above analysis on the resolution improvement, as well as the following iteration-based spectrum synthesis method, is still applicable for the structured illumination with 0th, ±1st diffraction orders, and even higher diffraction orders (e.g., ±2nd, ±3rd), which will in turn provide an additional spatial resolution improvement.

    Resolution enhancement of DHM by the structured illumination. (a) Spectrum evolvement of the object wave during the imaging process. (b) Flowchart of the iteration process for resolution enhancement. The black dots denote high frequency components of the object; the red-dashed circles denote the NA of the optical system.

    Figure 2.Resolution enhancement of DHM by the structured illumination. (a) Spectrum evolvement of the object wave during the imaging process. (b) Flowchart of the iteration process for resolution enhancement. The black dots denote high frequency components of the object; the red-dashed circles denote the NA of the optical system.

    The iterative reconstruction and the spectrum evolvement are sketched in Fig. 2(b). The first reconstruction with resolution improvement is obtained by averaging all the reconstructions along different directions of structured illuminations, i.e., O=(1/M)i=1MAoi/Aillumi. The averaging operation is mainly used to improve the image quality. Although averaging the object waves under hundreds of different speckle illuminations [18] has been reported, it requires that each speckle illumination has an equal weight for its different frequency spectra. Within our method, the spatial resolution of the reconstruction is improved by the following iterative algorithm.

    Structured illumination is simulated by multiplying the object wave O by the ith structured illumination Aillumi, and the object wave spectrum is duplicated and shifted into two opposite directions (carried by the ±1st order of the illumination). In this calculated spectrum FT{O×Aillumi}, the frequency components of O locate both inside and outside the NA of the system [see Fig. 2(b)]. The spectrum FT{O×Aillumi} has less frequency component inside the NA circle compared to that of FT{AOi} that is reconstructed directly from the hologram. Thus, the calculated spectrum is improved by replacing the central part (inside the NA circle) of FT{O×Aillumi} with that of FT{AOi}. After an inverse Fourier transform on the obtained spectrum, the resolution enhancement of the reconstructed object wave can be achieved. In implementation, the iteration process takes the following steps:

    Initialize the object wave by an averaging of O=(1/M)i=1MAoi/Aillumi.

    Multiply O with the ith structured illumination Aillumi to get the wave Asyni=O×Aillumi.

    Make the Fourier transform on Asyni, and replace its central part with that of the spectrum of AOi. We denote the obtained spectrum as FT{·}.

    Make the inverse Fourier transform on the obtained spectrum. We get the improved object wave Aimprovedi.

    The reconstruction with resolution improved can be obtained by Oimproved=Aimprovedi/Aillumi.

    The iterative process is continued by replacing the initial object wave O with the newly improved object wave Oimproved. Furthermore, the object waves reconstructed from different groups of structured-illuminated holograms are averaged in order to reduce the noise. The resolution enhancement on the reconstruction is determined by the illumination angle θillum of the ±1st diffraction orders of the structured illumination. The spatial resolution that can be obtained by using structured illumination is The constant factor κ1 is determined by the experimental parameters, such as coherent noise level, signal-to-noise ratio of the detector, and so on [25]. Equation (2) describes an enhancement in spatial resolution, compared with the on-axis plane wave illumination where θillum=0. The maximal resolution is δ=κ1λ/(NAMO1+NA), when sinθillum=NAMO1 with NAMO1 being the NA of the objective MO1. Note that this method enhances the spatial resolution and maintains a large field-of-view and long working distance at the same time. Compared to [21,22], where two fibers were used to generate the structured illumination, here we use a SLM to generate and change the structured illuminations without mechanical movement; thus high speed and high repeatability of phase imaging are achieved. It is worth mentioning that the proposed iterative spectrum synthesis method works only for thin samples. For thick samples, a selective synthesis operation, which synthesizes the spectrum with small z-component, can be applied [26,27].

    3. SIMULATION

    Simulation has been carried out to verify the feasibility of the proposed method. A specimen is simulated with the amplitude and phase distributions shown in Figs. 3(a) and 3(b), respectively. Six structured illuminations Aillumi with the period of 6 pixels and their fringe orientations rotated by m×π/6(i=0,1,2,3,4,5) are simulated, of which one amplitude distribution is shown in Fig. 3(c). The complex amplitude of the simulated object is multiplied sequentially by the six structured illuminations. The spectrum of the obtained object wave is then low-pass filtered by a aperture that truncates the high frequency spectrum over the quantity of 1/(5pixel) in the Fourier domain in order to simulate limited aperture of the imaging system. Finally, the off-axis holograms for both the illumination waves and the object waves are simulated by |Aillumi+R|2 and |AOi+R|2, respectively. Here R represents the reference wave with a linear carrier phase due to the off-axis propagation. The complex amplitudes of Aillumi and AOi in the image plane are reconstructed by using Eq. (1). The image along the ith illumination is reconstructed by Oi=Aoi/Aillumi. For comparison, the imaging process of an on-axis plane wave illumination is also simulated. The reconstructed amplitude images by using the on-axis plane wave illumination and different orientations of structured illumination (reconstructed by the iterative method) are given in Figs. 3(d) and 3(e). The comparison result shows that the reconstruction in Fig. 3(e) has higher spatial resolution than that in Fig. 3(d), which verifies the feasibility of the proposed method.

    Simulation results for resolution enhancement by structured illuminations. (a) Amplitude and (b) phase distributions of the simulated specimen. (c) Intensity distribution of the structured illumination along horizontal orientation. (d) and (e) Reconstructed amplitude images by using on-axis plane wave illumination and by structured illuminations with the proposed iterative method, respectively.

    Figure 3.Simulation results for resolution enhancement by structured illuminations. (a) Amplitude and (b) phase distributions of the simulated specimen. (c) Intensity distribution of the structured illumination along horizontal orientation. (d) and (e) Reconstructed amplitude images by using on-axis plane wave illumination and by structured illuminations with the proposed iterative method, respectively.

    4. EXPERIMENT

    An experiment has been carried out based on the setup described in Fig. 1. Twelve binary phase gratings rotated by m×π/12(m=0,1,2,3,11) are loaded sequentially on the SLM (Holoeye LCR-2500, 1024×768 pixels, pixel size 19 μm) to generate the structured illumination. Four of these binary gratings are schematically shown in Fig. 4(a). A transparent glass plate (1cm×1cm) was used as a sample, which had different scales of phase structures on the plate. In our experiment, two lenses are used instead of the objective lenses MO1 and MO2 in order to image such a large sample. A telescope system MO2L2 with a magnification of M=3 and a low NA=0.021 is used to image the sample onto the CCD plane. After interfering with an off-axis reference wave, the generated holograms under different orientations of structured illumination are recorded, and one of them is shown in Fig. 4(b). We can see that the object is modulated by both the carrier fringes (along the horizontal direction) and the structured illumination fringes (along the diagonal direction). The telescope system MO2L2 limits the resolution of the setup to δ=0.61λ/NA=18μm for the on-axis plane wave illumination. The illumination angle of the ±1st diffraction orders of the structured illumination is θillum=arcsin(M1λ/Λ)=0.018rad in the object plane. Here M1 denotes the magnification of the telescope system L1MO1, and Λ denotes the period of the structured illumination in the SLM. According to Eq. (2), the theoretical resolution obtained by using the structured illumination is δstr=10μm.

    Experimental results for resolution enhancement by structured illuminations. (a) Four phase gratings with different orientations loaded on SLM to generate structured illuminations. (b) Recorded hologram under one structured illumination. (c) and (d) The reconstructed phase images by using the on-axis plane wave illumination and by using the proposed iteration method, respectively.

    Figure 4.Experimental results for resolution enhancement by structured illuminations. (a) Four phase gratings with different orientations loaded on SLM to generate structured illuminations. (b) Recorded hologram under one structured illumination. (c) and (d) The reconstructed phase images by using the on-axis plane wave illumination and by using the proposed iteration method, respectively.

    The complex amplitudes of each illumination Aillumi and object wave AOi are reconstructed by using Eq. (1). The resolution improvement was performed by using the abovementioned iterative method. For comparison, the phase images reconstructed by using the traditional on-axis plane wave illumination and by using the proposed method are compared in Figs. 4(c) and 4(d), respectively. It is seen that the resolution target in the third column (from the right side) with line-width 12.5 μm, which is not distinguishable in Fig. 4(c), is clearly resolved in Fig. 4(d). This implies that the proposed iterative method improves the spatial resolution of the phase imaging. The number of illumination is chosen to have a compromise between the measurement time and the isotropic resolution improvement (in different directions) with low noise level. In our experiment, we used 12 structured illuminations to improve the spatial resolution of the reconstruction. Fewer structured illuminations (but no less than four) with the orientations evenly distributed on a ring can be used for resolution improvement in despite of a certain degree of noise. Although a low NA of objective was used in the experiment, it can be extended to a higher NA of objective.

    5. CONCLUSION

    The structured illuminations with different orientations, which are generated by a SLM, are used to illuminate the specimen sequentially in DHM. An iterative method enables the reconstruction with spatial resolution enhancement for all orientations without phase shifting on the structured illuminations. The use of the SLM allows for generating and changing quickly the structured illumination without mechanical movement.

    References

    [1] J. W. Goodman, R. W. Lawrence. Digital image formation from electronically detected holograms. Appl. Phys. Lett., 11, 77-79(1967).

    [2] J. Schwider, R. Burow, K.-E. Elssner, J. Grzanna, R. Spolaczyk, K. Merkel. Digital wave-front measuring interferometry: some systematic error sources. Appl. Opt., 22, 3421-3432(1983).

    [3] E. Cuche, P. Marquet, C. Depeursinge. Spatial filtering for zero-order and twin-image elimination in digital off-axis holography. Appl. Opt., 39, 4070-4075(2000).

    [4] B. Kemper, G. von Bally. Digital holographic microscopy for live cell applications and technical inspection. Appl. Opt., 47, A52-A61(2008).

    [5] P. Gao, B. Yao, N. Lindlein, K. Mantel, I. Harder, E. Geist. Phase-shift extraction for generalized phase-shifting interferometry. Opt. Lett., 34, 3553-3555(2009).

    [6] M. Born, E. Wolf. Principles of Optics(1999).

    [7] A. Faridian, D. Hopp, G. Pedrini, U. Eigenthaler, M. Hirscher, W. Osten. Nanoscale imaging using deep ultraviolet digital holographic microscopy. Opt. Express, 18, 14159-14164(2010).

    [8] V. Micó, C. Ferreira, J. García. Surpassing digital holography limits by lensless object scanning holography. Opt. Express, 20, 9382-9395(2012).

    [9] F. Le Clerc, M. Gross, L. Collot. Synthetic-aperture experiment in the visible with on-axis digital heterodyne holography. Opt. Lett., 26, 1550-1552(2001).

    [10] L. Granero, V. Micó, Z. Zalevsky, J. García. Superresolution imaging method using phase-shifting digital lensless Fourier holography. Opt. Express, 17, 15008-15022(2009).

    [11] M. Paturzo, P. Ferraro. Correct self-assembling of spatial frequencies in super-resolution synthetic aperture digital holography. Opt. Lett., 34, 3650-3652(2009).

    [12] M. Paturzo, F. Merola, S. Grilli, S. De Nicola, A. Finizio, P. Ferraro. Super-resolution in digital holography by a two-dimensional dynamic phase grating. Opt. Express, 16, 17107-17118(2008).

    [13] C. J. Schwarz, Y. Kuznetsova, S. R. J. Brueck. Imaging interferometric microscopy. Opt. Lett., 28, 1424-1426(2003).

    [14] S. A. Alexandrov, T. R. Hillman, T. Gutzler, D. D. Sampson. Synthetic aperture Fourier holographic optical microscopy. Phys. Rev. Lett., 97, 168102(2006).

    [15] V. Mico, Z. Zalevsky, J. García. Superresolution optical system by common-path interferometry. Opt. Express, 14, 5168-5177(2006).

    [16] C. Yuan, G. Situ, G. Pedrini, J. Ma, W. Osten. Resolution improvement in digital holography by angular and polarization multiplexing. Appl. Opt., 50, B6-B11(2011).

    [17] L. Granero, Z. Zalevsky, V. Micó. Single-exposure two-dimensional superresolution in digital holography using a vertical cavity surface-emitting laser source array. Opt. Lett., 36, 1149-1151(2011).

    [18] Y. Park, W. Choi, Z. Yaqoob, R. Dasari, K. Badizadegan, M.-S. Feld. Speckle-field digital holographic microscopy. Opt. Express, 17, 12285-12292(2009).

    [19] M. G. L. Gustafsson. Surpassing the lateral resolution limit by a factor of two using structured illumination microscopy. J. Microsc., 198, 82-87(2000).

    [20] M. G. L. Gustafsson. Nonlinear structured-illumination microscopy: wide-field fluorescence imaging with theoretically unlimited resolution. Proc. Natl. Acad. Sci. USA, 102, 13081-13086(2005).

    [21] A.-A. Mudassar, A. Hussain. Super-resolution of active spatial frequency heterodyning using holographic approach. Appl. Opt., 49, 3434-3441(2010).

    [22] A. Hussain, A.-A. Mudassar. Holography based super resolution. Opt. Commun., 285, 2303-2310(2012).

    [23] J. Ma, C. Yuan, G. Situ, G. Pedrini, W. Osten. Resolution enhancement in digital holographic microscopy with structured illumination. Chin. Opt. Lett., 11, 090901(2013).

    [24] P. Gao, G. Pedrini, W. Osten. Structured illumination for resolution enhancement and autofocusing in digital holographic microscopy. Opt. Lett., 38, 1328-1330(2013).

    [25] W. Osten, N. Reingand. Optical Imaging and Metrology(2010).

    [26] K. Lee, H.-D. Kim, K. Kim, Y. Kim, T. R. Hillman, B. Min, Y. Park. Synthetic Fourier transform light scattering. Opt. Express, 21, 22453-22463(2013).

    [27] R. Hillman, T. Gutzler, S. A. Alexandrov, D. D. Sampson. High-resolution, wide-field object reconstruction with synthetic aperture Fourier holographic optical microscopy. Opt. Express, 17, 7873-7892(2009).

    Juanjuan Zheng, Peng Gao, Baoli Yao, Tong Ye, Ming Lei, Junwei Min, Dan Dan, Yanlong Yang, and Shaohui Yan, "Digital holographic microscopy with phase-shift-free structured illumination," Photonics Res. 2, 87 (2014)
    Download Citation