• Photonics Research
  • Vol. 8, Issue 12, 1818 (2020)
Jiaji Li1、2, Alex Matlock3, Yunzhe Li3, Qian Chen1, Lei Tian3、4, and Chao Zuo1、2、*
Author Affiliations
  • 1School of Electronic and Optical Engineering, Nanjing University of Science and Technology, Nanjing 210094, China
  • 2Smart Computational Imaging Laboratory (SCILab), Nanjing University of Science and Technology, Nanjing 210094, China
  • 3Department of Electrical and Computer Engineering, Boston University, Boston, Massachusetts 02215, USA
  • 4e-mail: leitian@bu.edu
  • show less
    DOI: 10.1364/PRJ.403873 Cite this Article Set citation alerts
    Jiaji Li, Alex Matlock, Yunzhe Li, Qian Chen, Lei Tian, Chao Zuo, "Resolution-enhanced intensity diffraction tomography in high numerical aperture label-free microscopy," Photonics Res. 8, 1818 (2020) Copy Citation Text show less

    Abstract

    We propose label-free and motion-free resolution-enhanced intensity diffraction tomography (reIDT) recovering the 3D complex refractive index distribution of an object. By combining an annular illumination strategy with a high numerical aperture (NA) condenser, we achieve near-diffraction-limited lateral resolution of 346 nm and axial resolution of 1.2 μm over 130 μm×130 μm×8 μm volume. Our annular pattern matches the system’s maximum NA to reduce the data requirement to 48 intensity frames. The reIDT system is directly built on a standard commercial microscope with a simple LED array source and condenser lens adds-on, and promises broad applications for natural biological imaging with minimal hardware modifications. To test the capabilities of our technique, we present the 3D complex refractive index reconstructions on an absorptive USAF resolution target and Henrietta Lacks (HeLa) and HT29 human cancer cells. Our work provides an important step in intensity-based diffraction tomography toward high-resolution imaging applications.

    1. INTRODUCTION

    The refractive index (RI) of biological cells and tissues plays a crucial role in biomedical imaging as it captures the physiological characteristics and morphological features of a sample [13]. Imaging 3D biological samples with high resolution, however, remains a challenging task. Fluorescence-based 3D imaging methods, such as confocal microscopy [4] and multiphoton microscopy [5], already provide excellent optical sectioning and enable super-resolution 3D volume imaging of nanoscale subcellular structures. Unfortunately, the exogenous labels (e.g., dyes and fluorophores) in these techniques can be phototoxic and cause photobleaching due to the absorption of the excitation light [6] and can artificially alter the sample’s behavior and cellular structure [7]. Here, we introduce a resolution-enhanced intensity diffraction tomographic (reIDT) technique based on a conventional bright-field microscope and a high-density LED array illumination unit with sparse annular illumination. The imaging method is label-free, motion-free, fast, and enables the high-resolution quantitative recovery of 3D intrinsic structural features at the single cell level.

    Quantitative phase imaging (QPI) [3] is an often-used technique to recover biological cells with high contrast in their natural states. QPI reconstructs a quantitative image of the sample-induced two-dimensional (2D) optical path thicknesses or phase delay based on interferometry [811] and noninterferometry [1218] methods. However, these phase maps evaluate the sample’s total optical delay along the integrated direction over a thin layer and provide limited volumetric information about the object’s internal structure. To capture this information and evaluate thicker specimens, tomographic methods recovering 3D information are required. Recently developed 3D RI tomography techniques enable the reconstruction of the sample’s 3D RI distribution to visualize intracellular structures, and the related 3D imaging techniques can be largely categorized into two classes, interferometry-based and intensity-only methods.

    Optical diffraction tomography (ODT) is the most widely used interferometry-based 3D QPI technique [19,20]. Standard implementations of ODT use either a rotating sample [21] or a scanning laser beam [2224] to capture the angle-specific scattering arising from the sample. A 2D complex scattered field containing the object’s phase and amplitude information is directly recorded as digital interferograms under various illumination angles, and a tomographic reconstruction algorithm is applied to recover the sample’s 3D RI distribution. The interferograms are captured using either an off-axis [2024] or common path [2527] holographic microscope, and numerous ODT approaches [2224] have been applied in biomedical imaging for achieving quantitative, high-resolution 3D imaging. Hence, ODT can avoid the complex sample-preparation protocol and photobleaching effects of fluorescence while still recovering a sample’s 3D morphology, and this label-free 3D reconstruction method has found great success in visualizing individual unlabeled cells with quantitative refractive indices.

    For intensity-only techniques, existing IDT techniques involve taking multiple defocused intensity images under symmetric [2831] or asymmetric [32,33] illuminations, and the 3D RI map is recovered using deconvolution [34]. Techniques such as differential interference contrast acquire through-focus intensity stacks to extract the 2D phase information at multiple focus planes, and the 3D RI distribution is reconstructed using gradient phase information [35]. Recent works further incorporate modulated partially coherent sources (e.g., annular shape and Gaussian shape) to enhance the response of the 3D transfer function for noise-robust 3D tomographic results [30,31]. However, these methods often require sample or objective mechanical scanning along the axial direction to capture a through-focus intensity stack. This scanning limits the setup’s acquisition speed and requires large datasets with hundreds of intensity frames for object recovery. Alternatively, IDT approaches have been developed allowing 3D RI information recovery using angled illumination-only intensity measurements without any mechanical scanning [3642]. These methods apply single-scattering approximation-based models enabling direct 3D object reconstruction with a closed-form solution [3941]. Iterative algorithms based on multiple scattering models using the multislice beam propagation method have also been developed to recover strongly scattering samples [37,43,44]. One drawback of most of these existing techniques is the large number of required intensity measurements that consist of hundreds of intensity images per volume. The iterative reconstruction algorithm further prolongs the whole 3D imaging process and can become computationally expensive.

    Here, we present a reIDT setup that utilizes a high-density LED array hardware and a high numerical aperture condenser to significantly improve the achievable resolution of the single-scattering-based IDT technique using a larger objective (NAobj=0.9). Compared to existing single-scattering-based IDT techniques [3941], we improve the imaging resolution to near-diffraction-limited lateral resolution of 346 nm. Specifically, the achievable axial resolution is extended from 3.4 μm to 1.2 μm enabling single-cell-level 3D structure imaging. By introducing a condenser lens to the setup, reIDT improves the illumination efficiency and reduces the system’s required exposure time. The annular illumination pattern optimally fitted with the circular microscope pupil also reduces the image requirement to improve the system’s speed. Finally, we show that the present technique provides high-resolution, volumetric, subcellular information and morphology analysis on multiple biological samples. We recover macroscale cellular membrane structures, subcellular organelles, and micro-organism tissues to demonstrate that our technique has potential as a fast and high-resolution 3D imaging tool for biological samples.

    2. THEORY AND METHOD

    A. Principle of reIDT

    As depicted in Fig. 1(a), the proposed reIDT imaging system contains a high-density LED array illumination unit and an Abbe condenser attached to a commercial bright-field microscope. By placing the LED array in the front focal plane of the condenser lens, each LED source located at the condenser aperture diaphragm provides spatially partially coherent illumination in the form of a plane wave at a unique illumination angle on the sample. The annular pattern is displayed on the LED array, and ring-shape illumination (radius R, illumination numerical aperture NAillum) is matched with the objective lens’s pupil aperture NAobj properly (i.e., NAillumNAobj), as illustrated in Fig. 1(b). The specimen is placed in the objective’s focal plane and illuminated by each LED in the ring array. The intensity from each illumination is recorded on a camera which captures the interference of the object scattered field and the unperturbed illuminating field under the single-scattering approximation [Fig. 1(c)].

    System illustration of reIDT technique. (a) Photograph of reIDT setup. The setup consists of a standard microscope equipped with a high-density LED array and a high numerical aperture condenser. (b) LED array illumination unit is placed in the front focal plane of the condenser lens. The radius R of the annular pattern is tuned such that the illumination angle is approximately matched with the objective NA. (c) Each IDT image measures the interference between the scattered and the unperturbed fields. (d) The absorption and phase transfer functions at various illumination angles and sample depths. (e) Intensity images are taken by varying the illumination angle. Captured Fourier spectrum of the raw data exhibits two shifted circles, whose shift is set by the LED illumination angle on the annular pattern. (f) Frequency support region of 3D TFs in k-space. 2D cross-section plot of 3D TFs to illustrate the missing cone issue and cutoff frequency along lateral and axial directions.

    Figure 1.System illustration of reIDT technique. (a) Photograph of reIDT setup. The setup consists of a standard microscope equipped with a high-density LED array and a high numerical aperture condenser. (b) LED array illumination unit is placed in the front focal plane of the condenser lens. The radius R of the annular pattern is tuned such that the illumination angle is approximately matched with the objective NA. (c) Each IDT image measures the interference between the scattered and the unperturbed fields. (d) The absorption and phase transfer functions at various illumination angles and sample depths. (e) Intensity images are taken by varying the illumination angle. Captured Fourier spectrum of the raw data exhibits two shifted circles, whose shift is set by the LED illumination angle on the annular pattern. (f) Frequency support region of 3D TFs in k-space. 2D cross-section plot of 3D TFs to illustrate the missing cone issue and cutoff frequency along lateral and axial directions.

    By quantifying the Fourier space information under the first Born approximation, the phase and absorption transfer functions (TFs) of the IDT linear model can be derived [39], and the object’s complex permittivity distribution can be linearly related to the measured intensity spectrum. The 4D TFs in Fig. 1(d) contain slice-wise (2D) phase and absorption transfer functions at different depths for each illumination angle, and the exact form of the TFs can be found in Eq. (5) and Eq. (6). Importantly, since the TFs are confined to each slice, the scattering information from different sample slices is decoupled. This decoupling allows us to use a computationally efficient, slice-based deconvolution procedure to reconstruct the cross-sectional RI distribution one slice at a time. The raw intensity image set is captured by varying the illumination angles, and each intensity spectrum of the obliquely illuminated images exhibits a pair of circular Fourier regions. The pupil function filters the incoming scattered field to this circular shape, while the oblique illumination’s transverse frequency and its conjugate translate the scattered field in opposite directions in the frequency domain [Fig. 1(e)]. The lateral cutoff frequency envelope is indicated by the white dashed circle with the LED source’s illumination angle (kcutoff=2NAobj/λ) in Fig. 1(e). By combining the LED position self-calibration algorithm, the accurate transverse frequency of incident illumination can be obtained and used for modeling the 4D TFs. Finally, a fast and efficient slice-wise 3D deconvolution algorithm with a closed-form solution [Eqs. (7) and (8)] is implemented to recover the sample’s complex 3D RI distribution. Since the IDT model is only valid for bright-field measurements, the system still suffers from the missing cone problem in the axial direction, resulting in the axial elongation present in the reconstruction. Figure 1(f) illustrates the frequency support region of the proposed reIDT method in k-space.

    In practice, using a high-NA objective and illumination scheme cannot assume paraxial imaging conditions. As proposed by Sheppard and Gu et al. [4547], high-angle microscope systems usually incorporate an apodization function introduced by the system satisfying the sine condition. Thus, the investigation of the objective aperture function P(u) modified with an apodization function P(θ)=P(u)cosθ instead of ideal step function should be our future work.

    B. LED Position Self-Calibration

    When reconstructing the object, the illumination angles of the ring geometry setup must be known exactly to generate a 4D TF stack matching the acquired dataset. Any small alignment variations in the experimental setup deviating from the expected illumination angles will misalign the Fourier spectrum information and induce poor-quality reconstructions. Especially for high-NA imaging situations [48], inaccurate estimations of illumination angles will degrade the final imaging resolution and axial reconstruction depth range under higher-NA objective with smaller depth of focus (DOF). To prevent this, we first perform a numerical self-calibration procedure to obtain the incident illumination’s transverse spatial frequency. We first adjust the radius of annular pattern R on the LED array to approximately match the objective pupil, and 48 intensity images are captured under each illumination angle in the annular pattern. A self-calibration algorithm is then required to correctly obtain the illumination angles from the initial estimate.

    This self-calibration process utilizes a previously developed algorithm [49] with geometric constraints for accurate object recovery. The LEDs are assumed to be equally spaced on a rectangular matrix and obey a pre-defined annular geometry. With these constraints, the positions of LEDs on the annular pattern can be expressed as {xi2+yi2R2xi2+yi2>(R1)2,xi,yi[818],where (xi,yi) define the ith LED’s position on each row and column of the matrix; R denotes the objective pupil aperture’s effective radius in the LED illumination plane (condenser diagram plane), and the value of R is initially estimated as a normalized parameter. Additionally, we correct the pincushion distortion of the Abbe condenser lens using a second-order parabolic model. Then, the annular LED pattern’s position is converted to the Fourier domain and distributed as ui=xi(1k1Rik2Ri2)RNAobjλ,vi=yi(1k1Rik2Ri2)RNAobjλ,where Ri is the radius of each LED, Ri=xi2+yi2. The initial positions are obtained manually, and the uncalibrated spatial frequency positions (ui, vi) of all LEDs are plotted in the blue stars in Fig. 2(a).

    Demonstration of the proposed self-calibration method on an LED matrix with annular illumination pattern. (a), (b) The LED positions from manual alignment (termed uncalibrated, marked in blue star), initial guess of calibration (termed Init-calibrated, marked in red dot), and calibrated spatial frequency positions of LEDs (green triangle), plotted in the spatial frequency coordinates. (c), (d) 1D abscissa and the ordinate spatial illumination frequency plots of each LED on the annular pattern. Uncalibrated spatial frequency positions u, v (marked in blue line); Init-calibrated spatial frequency positions u, v (marked in red line); and calibrated spatial frequency positions u, v (marked in green line). (e) Calibrated numerical aperture of each LED element. (f)–(i) Captured Fourier spectrum using the corresponding LED (marked with arrows) along with calibrated pupil positions (marked by circles).

    Figure 2.Demonstration of the proposed self-calibration method on an LED matrix with annular illumination pattern. (a), (b) The LED positions from manual alignment (termed uncalibrated, marked in blue star), initial guess of calibration (termed Init-calibrated, marked in red dot), and calibrated spatial frequency positions of LEDs (green triangle), plotted in the spatial frequency coordinates. (c), (d) 1D abscissa and the ordinate spatial illumination frequency plots of each LED on the annular pattern. Uncalibrated spatial frequency positions u, v (marked in blue line); Init-calibrated spatial frequency positions u, v (marked in red line); and calibrated spatial frequency positions u, v (marked in green line). (e) Calibrated numerical aperture of each LED element. (f)–(i) Captured Fourier spectrum using the corresponding LED (marked with arrows) along with calibrated pupil positions (marked by circles).

    From these angle estimates, our algorithm obtains a better initial guess (uiinit,viinit) from the algorithm in Ref. [49] to provide initial LED position estimates shown as the red dots in Fig. 2(a). In practice, the algorithm in Ref. [49] is subject to noise and angle mismatches that can place LEDs outside of the square grid of the LED matrix. We define the following global factors to determine the positions of the LED pattern elements: rotation factor Δθ; shift factors Δu and Δv along u, v; effective radius of objective aperture R; and pincushion distortion factors k1 and k2. By substituting Eq. (2), the final calibrated LED positions uical and vical are parameterized as uical=Δu+[uicos(Δθ)+visin(Δθ)],vical=Δv+[uisin(Δθ)+vicos(Δθ)].Next, we incorporate the geometric matrix constraints to refine the LED positions by applying a nonlinear fitting algorithm and solving the optimization problem minuical,vicali=124[(uicaluiinit)2+(vicalviinit)2].As shown in the green triangles in Fig. 2(b), all position alignment factors can be obtained to provide accurate spatial frequencies at high illumination angles with this process. Furthermore, the abscissa and ordinate line plots of the calibrated illumination spatial frequencies are illustrated in Figs. 2(b) and 2(c). Any abnormal LED spatial frequency positions are fixed and refined to the geometric constraints of the LED matrix. The final calibrated numerical aperture values of each LED element are illustrated in Fig. 2(e). The values reveal that the illumination numerical aperture is not uniformly distributed when implementing an annular geometry in an LED matrix. Due to position misalignment and mismatches between the annular pattern and the condenser lens, the effective illumination numerical aperture in our experiments (0.85) is smaller than the maximum numerical aperture of the Abbe condenser lens. We also provide the experimentally captured intensity Fourier spectra and their corresponding LED’s spatial frequency position in Figs. 2(f)–2(i). The shifted objective pupil is marked by the circle in the raw intensity Fourier spectrum images (uncalibrated pupil marked in blue, calibrated pupil marked in green).

    C. Reconstruction Algorithm

    After calibrating the illumination, the reconstruction algorithm combines all the intensity images to estimate the sample’s 3D complex permittivity contrast (i.e., phase and absorption). In the IDT forward model, a 3D sample is discretized into a stack of 2D sample slices. Following the IDT derivation [3941], the 3D phase and absorption TFs can be derived slice-by-slice as a function of the illumination angle. The absorption and phase transfer functions (ATF and PTF, respectively) both contain a pair of circular Fourier regions describing the scattered field’s information and its complex conjugate [Fig. 1(d)]. The analytical expression of the phase TF (HP) and absorption TF (HA) can be expressed as HP(u)=iΔzk022{P(uρs)exp{i[η(uρs)ηs]z}η(uρs)P(u+ρs)exp{i[η(u+ρs)ηs]z}η(u+ρs)},and HA(u)=Δzk022{P(uρs)exp{i[η(uρs)ηs]z}η(uρs)+P(u+ρs)exp{i[η(u+ρs)ηs]z}η(u+ρs)},respectively, where Δz denotes the step size between 2D sample slices, k0 is the wavenumber, P is the microscope’s pupil function, u is the 2D spatial frequency variable, ρs is the illumination spatial frequency, η(u)=km1λ2u2 is the axial frequency with wavenumber in medium, and z is the sample’s axial location. The objective pupil is shifted by the oblique illumination such that the two pupil areas are next to each other. By varying the illumination angle, the location of the pupil position changes accordingly. The two circular regions contain minimal overlap to ensure optimal simultaneous low- and high-frequency information recovery. Together, our annular illumination scheme captures both phase and absorption information in 3D using a small number of intensity-only measurements.

    To achieve 3D RI reconstruction, reIDT solves an inverse problem through deconvolution. First, each intensity image is processed to remove the background. Next, the Tikhonov regularized deconvolution is performed to reconstruct the object’s real and imaginary RI. The main idea of this slice-wise deconvolution process is to replace the continuous integration along the axial direction by a discrete sum over the slice index [39]. The slice spacing Δz is chosen to match the DOF of the imaging system during the computation. The achieved axial resolution is characterized by analyzing the reconstructed stack and is found to approximately match with the diffraction limit, set by λ/(nmnm2NAobj2) corresponding full period resolution at the Nyquist–Shannon sampling limit, where nm is the RI of the surrounding medium. For the high-NA situation in this work, the reconstruction depth range limitation is smaller than the DOF of a lower-NA objective due to the smaller DOF of the higher-objective NA and more sensitive to high-angle illumination misalignment. These closed-form solutions for phase ΔεRe and absorption ΔεIm at each axial slice are ΔεRe[m]=F1{1A{[l|HA(l,m)|2+β][lHP*(l,m)g˜[l]][lHP*(l,m)HA(l,m)][lHA*(l,m)g˜[l]]}},and ΔεIm[m]=F1{1A{[l|HP(l,m)|2+α][lHA*(l,m)g˜[l]][lHP(l,m)HA*(l,m)][lHP*(l,m)g˜[l]]}},where F1 denotes the 2D inverse Fourier transform; A is a normalization term [l|HP(l,m)|2+α][l|HA(l,m)|2+β][lHP(l,m)HA*(l,m)][lHP*(l,m)HA(l,m)]; [m] indexes the mth sample slice and [l] the lth intensity image; HA(l,m) and HP(l,m) are the 4D ATFs and PTFs for the mth slice from the lth illumination; denotes element-wise multiplication between two matrices; α and β are the regularization parameters for the phase and absorption; and g˜[l] is the Fourier spectrum of the pre-processed intensity image, respectively.

    3. EXPERIMENTAL SETUP

    Our reIDT system consists of an upright bright-field microscope (E200, Nikon) with a commercial high-density surface-mounted LED array in the front focal plane of the condenser as the illumination source shown in Figs. 1(a) and 1(b). The green source’s semiconductor die is located in the LED’s center position with a size of 150 μm. Thus, the LED source can be approximated as a spatially coherent source, and the light emitted from the condenser lens for a single LED can be nearly treated as a plane wave. Each LED can be controlled individually to illuminate the sample from a unique angle and approximately provides spatially coherent quasi-monochromatic illumination with central wavelength λ=530  nm, 20  nm bandwidth. The distance between LED elements is 1.25 mm, and the original resolution of this commercial LED array is 64×64. Due to the limited diameter of the circular condenser aperture, only a fraction of the whole array (19×19) is used in the experiment. The LED array’s center is aligned with the microscope’s optical axis and the annular illumination ring is matched with the perimeter of the objective lens’ numerical aperture.

    All experiments in this work were conducted using a 100× microscope objective (0.9 NA, CFI Plan Fluor, Nikon). Images were taken with an sCMOS camera (PCO.Panda 4.2, 6.5 μm pixel size), which is synchronized with the LED source to provide camera-limited acquisition speed. Moreover, the LED array is driven dynamically using an LED controller board built in-house using a field-programmable gate array (FPGA, EP4CE10E144) unit. For the image acquisition and data processing time, we capture 48 intensity images with 1000×1000 pixels (2 pixels binning for 6.5 μm pixel size) and a 20 ms exposure time. This exposure time can be shortened and the total LED number can be downsampled to further improve acquisition speeds depending on the experiment. All the experimental data is processed in MATLAB (MATLAB 2018b) with a personal computer (Intel Core i77820×, 3.6 GHz, 128 GB DDR4 RAM). The required time to reconstruct a 1000×1000×21 RI voxel stack is approximately 20 s.

    4. RESULTS

    A. 3D Absorption Reconstruction of USAF Target

    We first demonstrate the imaging performance of our reIDT platform experimentally by measuring a 1951 USAF resolution target (Ready Optics Company, USA). The 3D absorption reconstruction of the resolution target is shown in Fig. 3. Even though the target was placed horizontally on the sample stage of the microscope, the lateral and axial imaging ability can be characterized using resolution elements and the axial full width at half-maximum (FWHM). Figure 3(a) shows the raw full field-of-view (FOV) image of the absorption USAF object under oblique illumination from the annular LED with the central features (white box) extracted and shown in Figs. 3(b) and 3(c). For the raw intensity images, the theoretically achievable resolution is limited by the incoherent diffraction limit (half-period width 151 nm, effective NAillum0.85, and NAobj 0.9) which is larger than the camera pixel size (130 nm at the object plane), and thus we do not need to consider pixel aliasing effects. This intensity dataset was used to implement 3D tomography based on reIDT, and Figs. 3(b) and 3(c) present the smallest elements (Groups 10 and 11) in the central slice of the 3D absorption stack of the USAF target. The subregion of resolution gratings in Group 11, horizontal Element 4 is enlarged revealing that the highest resolution achieved is 346 nm of full periodic grating pattern distance according to the standard resolution metric reported in Ref. [50] (bar width 173 nm, Group 11, horizontal Element 4).

    3D absorption reconstruction of the USAF target. (a) Raw full-FOV image of the absorption USAF object under oblique illumination from the annular LED. (b), (c) Enlarged central groups of resolution features in the central slice of the 3D absorption stack of the USAF target. (e) Multiple axial sections of USAF 3D absorption reconstruction at different planes and cross-section intensity profile plot of the recovered USAF target. (f) 3D volume-rendered view of the reconstructed absorption distribution. Additional cross-sectional reconstruction and 3D volume rendering from different perspectives of view are shown in Visualization 1.

    Figure 3.3D absorption reconstruction of the USAF target. (a) Raw full-FOV image of the absorption USAF object under oblique illumination from the annular LED. (b), (c) Enlarged central groups of resolution features in the central slice of the 3D absorption stack of the USAF target. (e) Multiple axial sections of USAF 3D absorption reconstruction at different planes and cross-section intensity profile plot of the recovered USAF target. (f) 3D volume-rendered view of the reconstructed absorption distribution. Additional cross-sectional reconstruction and 3D volume rendering from different perspectives of view are shown in Visualization 1.

    Moreover, three different depth slices are also demonstrated in the imaging capability of our method, and Fig. 3(d) shows the recovered absorption images. The central slice can provide the best absorption contrast, but the absorption information vanished at defocused reconstruction planes because the observed object is a thin layer on the in-focus plane. These results together with the corresponding line profiles shown in Fig. 3(d) confirm the achievable lateral resolution (Group 11, horizontal Element 4, indicated by the white arrows). We also evaluated the depth sectioning capability of the reIDT technique by providing axial sections at different planes, as shown in Figs. 3(e) and 3(f). The object information is completely indistinguishable when the defocus distance is 0.6 μm and the FWHM of the cross-section intensity profile plot is about 1.2 μm in Fig. 3(e6), confirming a depth resolution within the 1.2 μm range (in accordance with the theoretical prediction 0.95 μm). In addition, we provide more axial sections at different planes, as shown in Figs. 3(e1)–3(e5). Figure 3(f) and supplementary Visualization 1 show the volume-rendered absorption images and absorption sections for different axial planes. We further determine the DOF of the proposed reIDT platform to be 1.2  μm without significantly compromising the lateral resolution. The results shown in supplementary Visualization 1 demonstrate that out-of-focus features can be successfully rejected to reconstruct only the desired in-focus features. In the reIDT absorption reconstruction, the recovered imaging resolution is lower when compared to the system’s theoretical lateral resolution of 302 nm. Since the annular illumination on the LED array is not a perfect annular geometry, the illumination NA of each LED cannot always achieve incoherent illumination resolution limits. Accordingly, the recovered Fourier spectrum cannot cover the high-frequency region located at the edge of objective pupil, while the axial imaging resolution does not have too much difference with the theoretical value of the axial imaging resolution limit.

    B. RI Tomography on HeLa Cell

    To illustrate the biological applications of reIDT, we imaged unstained HeLa cells and achieved high-resolution RI tomography over an FOV of 130μm×130μm. Figure 4(a) shows the quantitative RI map of HeLa cells at the central plane in the reconstruction volume with 21 slices. Depth-coded projections of our reconstructions are also illustrated in Fig. 4(b) where the volumetric RI distribution is shown as a color-coded depth projection. The cell boundary and body are displayed in blue and green while the nuclear envelope and nucleolus are shown in hot colors. As shown in Figs. 4(c)–4(e), three subregions show high-resolution filopodia and other subcellular features are recovered without resolution loss. We observe cellular membrane folds, cell boundaries, microtubules, and intracellular features with high resolution [Figs. 4(c)–4(e), circles]. The nucleoli [Figs. 4(c)–4(e), arrows] inside the cell have higher RI value compared to the average index of cytoplasm, and the rendered 3D RI image provides much clearer information about the HeLa cell structure. The results shown in Figs. 4(c)–4(e) reveal that we can clearly image the details of the 3D structures of a single cell throughout its entire volume and can quantify the RI at subcellular levels. The full HeLa cell reconstruction is shown in Visualization 2, and the results show that reIDT resolves internal features of biological samples.

    Single-cell RI tomography of unstained HeLa cell clusters. (a) Recovered RI slice located at 0.4 μm z plane. The full HeLa cell volumetric reconstruction is shown in Visualization 2. (b) Depth color coding of 3D RI measurements of the sample in the field of view. (c)–(e) Reconstructed square subregions RI cross sections demonstrate the sectioning capability. Cellular membrane folds, cell boundaries, microtubules, and intracellular features are distinguishable (indicated by the white circles). The outlines of the nuclear envelope and nucleolus are recovered across multiple axial slices (indicated by the white arrows).

    Figure 4.Single-cell RI tomography of unstained HeLa cell clusters. (a) Recovered RI slice located at 0.4 μm z plane. The full HeLa cell volumetric reconstruction is shown in Visualization 2. (b) Depth color coding of 3D RI measurements of the sample in the field of view. (c)–(e) Reconstructed square subregions RI cross sections demonstrate the sectioning capability. Cellular membrane folds, cell boundaries, microtubules, and intracellular features are distinguishable (indicated by the white circles). The outlines of the nuclear envelope and nucleolus are recovered across multiple axial slices (indicated by the white arrows).

    C. Tomographic Characterization of HT29

    We also demonstrated reIDT’s high-resolution volumetric imaging capabilities on human colon adenocarcinoma cells (HT29). Within the RI image of 100× FOV at 0  μm z plane in Fig. 5(a), fine structures are recovered and could include microfilaments, large vacuolated mitochondria, dark granules, and lipid droplets. These dark granules can also be distinguished in the absorption slice, as shown in Fig. 5(b). We expand two regions of the reconstructed RI in Figs. 5(c) and 5(d) highlighting our depth-sectioned and high-resolution reconstructions. Dark granules ultrastructural features reported for HT29 cells include microvilli, large vacuolated mitochondria with dark granules, smooth and rough endoplasmic reticulum with free ribosomes, lipid droplets, and few primary and many secondary lysosomes [51,52]. Line profiles across multiple reconstructed slices in Figs. 5(c) and 5(d) demonstrate near-diffraction-limited lateral resolution of 346 nm. As clearly illustrated in Visualization 3, the reconstructed 2D cross sections of the complex RI slices provide resolution-enhanced optical sectioning and demonstrate the tomographic capacity of reIDT on label-free cells. Furthermore, quantifying volumetric morphological changes of cellular and subcellular information also has significant utility in oncology, both for differentiating cancer types and evaluating their response to drug and therapy treatments.

    Tomographic characterization of unstained HT29. (a),(b) RI and absorption reconstruction of HT29 in 100× FOV at 0 μm z plane. Dark granules inside the cell contain highly absorbing features (indicated by the black circles). (c), (d) RI distribution of HT29 cell at different z planes for different square subregions. (e),(f) Line profiles across subcellular structures to quantify the reconstructed lateral resolution. Additional complex RI examples are shown in Visualization 3.

    Figure 5.Tomographic characterization of unstained HT29. (a),(b) RI and absorption reconstruction of HT29 in 100× FOV at 0 μm z plane. Dark granules inside the cell contain highly absorbing features (indicated by the black circles). (c), (d) RI distribution of HT29 cell at different z planes for different square subregions. (e),(f) Line profiles across subcellular structures to quantify the reconstructed lateral resolution. Additional complex RI examples are shown in Visualization 3.

    5. CONCLUSION AND DISCUSSION

    In summary, we demonstrated a label-free and scan-free intensity-only resolution-enhanced quantitative imaging method on an LED array microscope. This technique is particularly attractive for commercial microscopy, since it can achieve rapid scanning of angles by LED array illumination. By using a condenser lens, the illumination angle and efficiency are significantly increased to enable improved data acquisition. We demonstrated the technique on various samples with complex RI distributions, including the USAF target and human cancer cells, and performed 3D absorption reconstructions and quantitative characterizations of biological samples. We believe this method will set an excellent foundation for other research projects and applications, and the reIDT has the potential as a tool of great biological interest by showing its use in monitoring cell morphology and dynamics in noninvasive fast measurements.

    This reIDT setup still suffers from some limitations. The 3D volume’s maximum axial resolution is limited to the objective’s DOF and can be hindered by misalignments in the LED array. Moreover, reIDT’s setup exhibits resolution limits below the diffraction limit due to mismatches between the annular array and the condenser lens. Other artifact-inducing features, such as optical aberrations and source coherence, could also be reducing the resolution limits. These factors will be evaluated in future work to provide a more accurate imaging setup. In addition, the reconstruction may be improved by more advanced algorithms, such as multiple scattering models [37,43,44] and deep learning-based 3D tomography approaches [5358].

    References

    [1] Y. Park, M. Diez-Silva, G. Popescu, G. Lykotrafitis, W. Choi, M. S. Feld, S. Suresh. Refractive index maps and membrane dynamics of human red blood cells parasitized by Plasmodium falciparum. Proc. Natl. Acad. Sci. USA, 105, 13730-13735(2008).

    [2] S. Lee, K. Kim, A. Mubarok, A. Panduwirawan, K. Lee, S. Lee, H. Park, Y. Park. High-resolution 3-D refractive index tomography and 2-D synthetic aperture imaging of live phytoplankton. J. Opt. Soc. Korea, 18, 691-697(2014).

    [3] Y. Park, C. Depeursinge, G. Popescu. Quantitative phase imaging in biomedicine. Nat. Photonics, 12, 578-589(2018).

    [4] R. M. Zucker. Whole insect and mammalian embryo imaging with confocal microscopy: morphology and apoptosis. Cytometry Part A, 69, 1143-1152(2006).

    [5] W. R. Zipfel, R. M. Williams, W. W. Webb. Nonlinear magic: multiphoton microscopy in the biosciences. Nat. Biotechnol., 21, 1369-1377(2003).

    [6] S. Wäldchen, J. Lehmann, T. Klein, S. Van De Linde, M. Sauer. Light-induced cell damage in live-cell super-resolution microscopy. Sci. Rep., 5, 15348(2015).

    [7] D. J. Stephens, V. J. Allan. Light microscopy techniques for live cell imaging. Science, 300, 82-86(2003).

    [8] P. Ferraro, D. Alferi, S. De Nicola, L. De Petrocellis, A. Finizio, G. Pierattini. Quantitative phase-contrast microscopy by a lateral shear approach to digital holographic image reconstruction. Opt. Lett., 31, 1405-1407(2006).

    [9] B. Kemper, G. Von Bally. Digital holographic microscopy for live cell applications and technical inspection. Appl. Opt., 47, A52-A61(2008).

    [10] Z. Wang, L. Millet, M. Mir, H. Ding, S. Unarunotai, J. Rogers, M. U. Gillette, G. Popescu. Spatial light interference microscopy (SLIM). Opt. Express, 19, 1016-1026(2011).

    [11] Y. Baek, K. Lee, S. Shin, Y. Park. Kramers-Kronig holographic imaging for high-space-bandwidth product. Optica, 6, 45-51(2019).

    [12] L. Waller, L. Tian, G. Barbastathis. Transport of intensity phase-amplitude imaging with higher order intensity derivatives. Opt. Express, 18, 12552-12561(2010).

    [13] L. Tian, L. Waller. Quantitative differential phase contrast imaging in an LED array microscope. Opt. Express, 23, 11394-11403(2015).

    [14] J. A. Rodrigo, T. Alieva. Rapid quantitative phase imaging for partially coherent light microscopy. Opt. Express, 22, 13472-13483(2014).

    [15] Y. Bao, T. K. Gaylord. Quantitative phase imaging method based on an analytical nonparaxial partially coherent phase optical transfer function. J. Opt. Soc. Am. A, 33, 2125-2136(2016).

    [16] C. Zuo, J. Sun, J. Li, J. Zhang, A. Asundi, Q. Chen. High-resolution transport-of-intensity quantitative phase microscopy with annular illumination. Sci. Rep., 7, 7654(2017).

    [17] J. Li, Q. Chen, J. Zhang, Y. Zhang, L. Lu, C. Zuo. Efficient quantitative phase microscopy using programmable annular led illumination. Biomed. Opt. Express, 8, 4687-4705(2017).

    [18] C. Zuo, J. Li, J. Sun, Y. Fan, J. Zhang, L. Lu, R. Zhang, B. Wang, L. Huang, Q. Chen. Transport of intensity equation: a tutorial. Opt. Lasers Eng., 106187(2020).

    [19] V. Lauer. New approach to optical diffraction tomography yielding a vector equation of diffraction tomography and a novel tomographic microscope. J. Microsc., 205, 165-176(2002).

    [20] W. Choi, C. Fang-Yen, K. Badizadegan, S. Oh, N. Lue, R. R. Dasari, M. S. Feld. Tomographic phase microscopy. Nat. Methods, 4, 717-719(2007).

    [21] A. Kuś, M. Dudek, B. Kemper, M. Kujawińska, A. Vollmer. Tomographic phase microscopy of living three-dimensional cell cultures. J. Biomed. Opt., 19, 046009(2014).

    [22] Y. Sung, W. Choi, C. Fang-Yen, K. Badizadegan, R. R. Dasari, M. S. Feld. Optical diffraction tomography for high resolution live cell imaging. Opt. Express, 17, 266-277(2009).

    [23] Y. Cotte, F. Toy, P. Jourdain, N. Pavillon, D. Boss, P. Magistretti, P. Marquet, C. Depeursinge. Marker-free phase nanoscopy. Nat. Photonics, 7, 113-117(2013).

    [24] K. Kim, J. Yoon, S. Shin, S. Lee, S.-A. Yang, Y. Park. Optical diffraction tomography techniques for the study of cell pathophysiology. J. Biomed. Photonics Eng., 2, 2994(2016).

    [25] T. Kim, R. Zhou, M. Mir, S. Babacan, P. Carney, L. Goddard, G. Popescu. White-light diffraction tomography of unlabelled live cells. Nat. Photonics, 8, 256-263(2014).

    [26] Y. Kim, H. Shim, K. Kim, H. Park, J. H. Heo, J. Yoon, C. Choi, S. Jang, Y. Park. Common-path diffraction optical tomography for investigation of three-dimensional structures and dynamics of biological cells. Opt. Express, 22, 10398-10407(2014).

    [27] K. Kim, Z. Yaqoob, K. Lee, J. W. Kang, Y. Choi, P. Hosseini, P. T. So, Y. Park. Diffraction optical tomography using a quantitative phase imaging unit. Opt. Lett., 39, 6935-6938(2014).

    [28] J. A. Rodrigo, J. M. Soto, T. Alieva. Fast label-free microscopy technique for 3D dynamic quantitative imaging of living cells. Biomed. Opt. Express, 8, 5507-5517(2017).

    [29] J. M. Soto, J. A. Rodrigo, T. Alieva. Optical diffraction tomography with fully and partially coherent illumination in high numerical aperture label-free microscopy. Appl. Opt., 57, A205-A214(2018).

    [30] J. Li, Q. Chen, J. Sun, J. Zhang, J. Ding, C. Zuo. Three-dimensional tomographic microscopy technique with multi-frequency combination with partially coherent illuminations. Biomed. Opt. Express, 9, 2526-2542(2018).

    [31] J. M. Soto, J. A. Rodrigo, T. Alieva. Partially coherent illumination engineering for enhanced refractive index tomography. Opt. Lett., 43, 4699-4702(2018).

    [32] S. B. Mehta, C. J. Sheppard. Quantitative phase-gradient imaging at high resolution with asymmetric illumination-based differential phase contrast. Opt. Lett., 34, 1924-1926(2009).

    [33] M. Chen, L. Tian, L. Waller. 3D differential phase contrast microscopy. Biomed. Opt. Express, 7, 3940-3950(2016).

    [34] M. H. Jenkins, T. K. Gaylord. Three-dimensional quantitative phase imaging via tomographic deconvolution phase microscopy. Appl. Opt., 54, 9213-9227(2015).

    [35] T. H. Nguyen, M. E. Kandel, M. Rubessa, M. B. Wheeler, G. Popescu. Gradient light interference microscopy for 3D imaging of unlabeled specimens. Nat. Commun., 8, 210(2017).

    [36] L. Tian, J. Wang, L. Waller. 3D differential phase-contrast microscopy with computational illumination using an LED array. Opt. Lett., 39, 1326-1329(2014).

    [37] L. Tian, L. Waller. 3D intensity and phase imaging from light field measurements in an LED array microscope. Optica, 2, 104-111(2015).

    [38] R. Horstmeyer, J. Chung, X. Ou, G. Zheng, C. Yang. Diffraction tomography with Fourier ptychography. Optica, 3, 827-835(2016).

    [39] R. Ling, W. Tahir, H.-Y. Lin, H. Lee, L. Tian. High-throughput intensity diffraction tomography with a computational microscope. Biomed. Opt. Express, 9, 2130-2141(2018).

    [40] J. Li, A. Matlock, Y. Li, Q. Chen, C. Zuo, L. Tian. High-speed in vitro intensity diffraction tomography. Adv. Photonics, 1, 066004(2019).

    [41] A. Matlock, L. Tian. High-throughput, volumetric quantitative phase imaging with multiplexed intensity diffraction tomography. Biomed. Opt. Express, 10, 6432-6448(2019).

    [42] C. Zuo, J. Sun, J. Li, A. Asundi, Q. Chen. Wide-field high-resolution 3D microscopy with Fourier ptychographic diffraction tomography. Opt. Lasers Eng., 128, 106003(2020).

    [43] S. Chowdhury, M. Chen, R. Eckert, D. Ren, F. Wu, N. Repina, L. Waller. High-resolution 3D refractive index microscopy of multiple-scattering samples from intensity images. Optica, 6, 1211-1219(2019).

    [44] M. Chen, D. Ren, H.-Y. Liu, S. Chowdhury, L. Waller. Multi-layer born multiple-scattering model for 3D phase microscopy. Optica, 7, 394-403(2020).

    [45] C. Sheppard, M. Gu, Y. Kawata, S. Kawata. Three-dimensional transfer functions for high-aperture systems. J. Opt. Soc. Am. A, 11, 593-598(1994).

    [46] Y. Sung, C. J. Sheppard. Three-dimensional imaging by partially coherent light under nonparaxial condition. J. Opt. Soc. Am. A, 28, 554-559(2011).

    [47] M. Gu. Advanced Optical Imaging Theory, 75(2000).

    [48] X. Ou, R. Horstmeyer, G. Zheng, C. Yang. High numerical aperture Fourier ptychography: principle, implementation and characterization. Opt. Express, 23, 3472-3491(2015).

    [49] R. Eckert, Z. F. Phillips, L. Waller. Efficient illumination angle self-calibration in Fourier ptychography. Appl. Opt., 57, 5434-5442(2018).

    [50] R. Horstmeyer, R. Heintzmann, G. Popescu, L. Waller, C. Yang. Standardizing the resolution claims for coherent microscopy. Nat. Photonics, 10, 68-71(2016).

    [51] C. Huet, C. Sahuquillo-Merino, E. Coudrier, D. Louvard. Absorptive and mucus-secreting subclones isolated from a multipotent intestinal cell line (ht-29) provide new models for cell polarity and terminal differentiation. J. Cell Biol., 105, 345-357(1987).

    [52] X. Dai, J. Liu, Y. Nian, M.-H. Qiu, Y. Luo, J. Zhang. A novel cycloartane triterpenoid from Cimicifuga induces apoptotic and autophagic cell death in human colon cancer HT-29 cells. Oncol. Rep., 37, 2079-2086(2017).

    [53] U. S. Kamilov, I. N. Papadopoulos, M. H. Shoreh, A. Goy, C. Vonesch, M. Unser, D. Psaltis. Learning approach to optical tomography. Optica, 2, 517-522(2015).

    [54] Y. Li, Y. Xue, L. Tian. Deep speckle correlation: a deep learning approach toward scalable imaging through scattering media. Optica, 5, 1181-1190(2018).

    [55] Y. Xue, S. Cheng, Y. Li, L. Tian. Reliable deep-learning-based phase imaging with uncertainty quantification. Optica, 6, 618-629(2019).

    [56] G. Barbastathis, A. Ozcan, G. Situ. On the use of deep learning for computational imaging. Optica, 6, 921-943(2019).

    [57] Y. Rivenson, Y. Zhang, H. Günaydn, D. Teng, A. Ozcan. Phase recovery and holographic image reconstruction using deep learning in neural networks. Light: Sci. Appl., 7, 17141(2018).

    [58] S. Feng, Q. Chen, G. Gu, T. Tao, L. Zhang, Y. Hu, W. Yin, C. Zuo. Fringe pattern analysis using deep learning. Adv. Photonics, 1, 025001(2019).

    Jiaji Li, Alex Matlock, Yunzhe Li, Qian Chen, Lei Tian, Chao Zuo, "Resolution-enhanced intensity diffraction tomography in high numerical aperture label-free microscopy," Photonics Res. 8, 1818 (2020)
    Download Citation