
- Advanced Imaging
- Vol. 2, Issue 3, 032001 (2025)
Abstract
Keywords
1. Introduction
Since its invention in the 1600s, the optical microscope has experienced ongoing development and has become a commonly used instrument to render small objects visible in biomedicine, material science, chemistry, and other areas[1]. Currently, microscopy remains an active research field due to the rapidly increasing demands for providing higher spatial and temporal resolution, higher contrast, longer penetration depth, and more accurate quantitative capabilities. Quantitative phase imaging (QPI)[2,3] is emerging as a powerful label-free microscopy approach to visualizing cells and tissues with nanoscale sensitivity to morphology. Fourier ptychographic microscopy (FPM)[4,5] is a superior computational imaging technique to achieve high space-bandwidth product (SBP) QPI, which bypasses the trade-off between the field of view (FOV) and spatial resolution. Here, we review the context of QPI based on FPM (FPM-QPI), the theoretical basis of FPM-QPI, the advances of FPM-QPI, and the representative applications in biomedicine and topography measurement. We also discuss the emerging challenges and opportunities that will shape future development.
In an optical microscope, light works as the carrier of the sample information and is projected onto human eyes or digital image sensors to form intensity images. For human observation, a high-quality image must be presented with varying degrees of light intensity and colors in the visible spectrum. This requirement implies that spatial resolution and contrast are two central metrics in microscopy. In 1873, Abbe proposed the first theory of image formation of the microscope: the ultimate image is formed by the superposition of light waves propagating at different angles from the sample[6], determining that the accessible spatial resolution is
Alternatively, QPI enables label-free quantification of optical path differences by measuring the phase shift distribution across the entire FOV, establishing itself as a powerful tool for both biomedical characterization and industrial inspection. In biomedical applications, the quantitative phase map correlates with fundamental cellular properties, providing non-invasive measurements of dry mass distribution[14,15,20], cell growth[16,17], and dynamics of intracellular transport[18,19]. For industrial metrology, this technique has demonstrated exceptional sensitivity in microstructural height profiling and surface topography reconstruction. Among existing QPI modalities, FPM has garnered significant attention due to its unique capability to transcend inherent trade-offs in conventional microscopy.
Sign up for Advanced Imaging TOC. Get the latest issue of Advanced Imaging delivered right to you!Sign up now
The foremost advantage of FPM lies in its ability to overcome the coherent diffraction limit of a low numerical aperture (NA) objective, achieving high-resolution (HR) phase mapping while retaining the inherently wide FOV characteristic of a low-NA system[4]. This breakthrough is accomplished through a computational synthesis of angle-varied illuminations rather than mechanical scanning. Furthermore, FPM exhibits three distinctive merits compared to conventional interferometric QPI: 1) Adaptive aberration correction with algorithmic processing[50,54] enables accurate QPI under spatially and temporally varied aberration; 2) high compatibility with commercial microscope platforms enables easy implementation and concise configuration; and 3) partially coherent illumination with a light-emitting diode (LED) array enables speckle-free high-quality imaging. These attributes together enable FPM to provide robust phase quantification in diverse scenarios ranging from live-cell imaging to semiconductor wafer and glass inspection.
In this review, we first introduce the underlying principle of FPM-QPI implementation, mainly focusing on the basic forward imaging model and phase retrieval algorithm. Subsequently, we trace the advances in algorithms and imaging models developed to address the limitations of the original FPM-QPI. Finally, we highlight the application in biomedicine and topography measurements and three key ongoing research trends that will facilitate the process of deploying the FPM-QPI method in commercial platforms in the future.
2. Underlying Principles of FPM-QPI
2.1 Non-interference quantitative phase imaging
When it comes to phase measurement or QPI, interferometry will automatically occur for many people. Since the invention of lasers in 1960, most phase measurement methods have been gradually established based on interferometry. Nowadays, interferometry has become a prominent role in optical metrology. A high-precision interferometer can produce an extremely sensitive phase measurement with the optical path accuracy up to
In recent years, low-coherence interferometric microscopy has gradually attracted researchers. They combine broadband illumination with a common-path configuration to address the speckle noise and improve the stability of mechanical vibration and air fluctuation. Many techniques have emerged and have shown their powerful performance of QPI, such as spatial light interference microscopy (SLIM)[30], quadriwave lateral shearing interferometry (QWLSI)[31], and white-light diffraction phase microscopy (wDPM)[32]. However, most of them still require complicated systems that are not compatible with commercial microscopes, hindering their widespread use in clinical diagnosis and life science.
Indeed, interference is not the only way to convert the unmeasurable phase information into measurable intensity variation. Propagation of light fields and asymmetric illumination are also two common approaches to achieving the phase-to-intensity conversion. Based on the propagation approach, the transport of intensity equation (TIE)[33–35] provides a non-interferometric way to obtain quantitative phase information by measuring the intensity variation from focused to defocused planes. Through asymmetric illumination, differential phase contrast (DPC)[36–38] can retrieve quantitative phase information by capturing intensity images under multiple asymmetric and complementary illuminations. To recover the loss phase information from intensity measurements, whether TIE or DPC, they need to model the forward physical process of intensity image formation and seek the solution by inverting the model, i.e., solve the inverse problem. Such non-interferometric QPI techniques are called phase retrieval[39,40]. However, due to the competition between spatial resolution and imaging FOV, the SBP[41] of the two methods is limited to around megapixels. They can provide either a QPI image with a small FOV and fine details or an image with a wide FOV and coarse details.
To break the intrinsic trade-off of FOV and spatial resolution, FPM-QPI introduces another innovation in classical optics: synthetic aperture imaging[42]. Synthetic aperture imaging was first designed for large radio telescopes, aiming to bypass the resolution limit of a single telescope. Since the resolution of an imaging system is proportional to the lens aperture size, the radio imaging resolution can be significantly improved by synthesizing images from several telescopes. Stitching these images together is possible because the full complex field (amplitude and phase) can be directly recorded at radio wavelengths. However, no phase information is directly measured in the visible wavelength. Instead, FPM-QPI indirectly recovers the missing phase information from intensity measurements during an iterative phase retrieval process. The elegance of FPM-QPI lies in that it achieves synthetic aperture naturally along with the phase retrieval process. As a result, FPM-QPI can use an objective with low NA to achieve QPI with high resolution and maintain the original wide FOV.
To realize accurate FPM-QPI, the key points are basically the same as those in other phase retrieval techniques: 1) model a more accurate forward physical process of intensity image formation; 2) seek more accurate phase retrieval algorithms to solve the inverse problem. The two points have stimulated the development of multiple FPM-QPI branches over the past 12 years, as shown in Fig. 1. After introducing the underlying principles, we conclude the primary approaches that have had a significant impact on modern FPM-QPI methods or have the potential to solve current challenges: phase retrieval algorithms, intensity diffraction tomography (IDT), and artificial intelligence (AI).
Figure 1.FPM-QPI has evolved into three branches stimulated by advances in the forward imaging model and the phase retrieval algorithm. Schematic of the three main branches: phase retrieval algorithm, intensity diffraction tomography, and deep learning are indicated. The progress of the main events is listed in the timeline. The citations are showcased as follows: Phase retrieval algorithm: sequential Gerchberg–Saxton[
2.2. Forward imaging model
FPM is inherently a phase retrieval algorithm, where the missing phase information is converted into intensity variation in recorded images. To retrieve the phase information, the first step is to model the physical model of the optical system and use the model to depict the intensity image formation mathematically. The schematic diagram of a typical FPM system configuration is shown in Fig. 2(a). The system can be built by replacing the condenser of a commercial microscope with a programmed LED array[4]. The LED elements are successively lit up to illuminate the sample from different angles. At each angle, the image sensor records a low-resolution (LR) intensity image.
Figure 2.Forward imaging model of FPM-QPI for thin samples. (a) Schematic diagram of system configuration. (b) Color high-resolution FPM intensity image of a thin blood smear. (c) The complex transmittance function consists of amplitude and phase at 630 nm wavelength. (d) Low-pass filtered spectrum at the pupil plane. (e) Captured intensity image on the image sensor.
In original FPM, the sample is assumed to thin infinitely [e.g., the blood smear in Fig. 2(b)] and is described by a two-dimensional (2D) complex transmittance function
The physical process of an intensity image formation is shown in Figs. 2(d) and 2(e). In the FPM system, the distance between the LED array and the sample is adjusted to be large enough so that the illumination wave emitted from the
According to the forward model, one LED illumination can generate one intensity image whose spectrum contains information of a shifted and low-pass filtered sample spectrum. In the following sections, we use the word “sub-spectrum” as shorthand for the shifted and low-pass filtered sample spectrum. FPM uses
2.3. Phase retrieval process
After the intensity image data are collected, FPM performs an iterative phase retrieval process to obtain sample information. The phase retrieval process is to recover the complex transmittance function
The original FPM algorithm is developed from a sequential Gerchberg–Saxton method[39,40], which is a type of alternating projection applied for spatial ptychography[46,47]. In contrast to ptychography, which records diffraction pattern diversity by scanning an aperture-limited illumination “probe” wavefront in the spatial domain, FPM introduces intensity image diversity by angle-varied illumination, where the finite pupil aperture (“probe”) of the optical system scans in the Fourier domain. The reciprocity between the two techniques allows for algorithm exchange by switching the quantities in the Fourier and spatial domains.
Figure 3 shows the iterative phase retrieval process of FPM, which is composed of five steps. The first step is to initialize the sample, where the amplitude can be set as the up-sampled LR image under normal illumination or the mean of all LR measurements, and the phase can be set as zero everywhere. Second, the current sample spectrum is shifted and constrained with the pupil function based on the forward imaging model to generate an estimated image for the
Figure 3.Iterative phase retrieval process of FPM-QPI.
3. Advances of FPM-QPI
3.1. Phase retrieval algorithm
The original FPM algorithm is a type of alternating projection. It can work well if the constructed forward imaging model matches the experimental system rigorously. Unfortunately, system errors, such as aberration, LED position misalignment, and noise, are generally unpredictable. In this case, the algorithm often falls into a local minimum or even fails to converge. The problem can be solved from the perspective of optimization. The core is to construct a suitable cost function that can accurately reflect the difference between the measurements and estimations. The inverse problem can be formulated as the following optimization:
The sample spectrum
Upon comparing the right-hand side of Eq. (4) with the direction of steepest descent given by Eq. (6), it is obvious that the update step of the original FPM algorithm can be considered as a type of gradient descent algorithm.
Inspired by advances in optimization strategies, many improved algorithms have been proposed during the past 12 years. Some representative algorithms are categorized into two groups in terms of their motivation and are summarized in Table 1.
Class of Algorithm | Example | |
Correct system errors | Aberration | Zernike coefficient search[ |
LED misalignment | Simulated annealing[ | |
Noise | Wirtinger flow[ | |
High-speed imaging | Fast capturing | Multiplexed illumination[ |
Low redundancy | Annular illumination[ |
Table 1. Representative Phase Retrieval Algorithms of FPM-QPI.
The first group seeks to correct various system errors, including pupil aberration, LED misalignment, and noise. Three representative methods for pupil aberration correction are summarized in Table 1. The first viable method is to directly search for the Zernike coefficients that can maximize the convergence metric[49]. However, the search process embedded within iterative recovery will be exceedingly time-consuming when the number of desired coefficients is large. The second way is to jointly recover both the sample and the pupil function during the iterative process. Similar to the sample spectrum, we can calculate the gradient of the cost function with respect to
Following the gradient descent algorithm, we can obtain the updating formula for the pupil function:
It is noted that, when updating the sample spectrum and the pupil function simultaneously, Eqs. (4) and (8) will not be applied directly because the signal-to-noise ratio (SNR) of high-frequency components of the measured spectrum is extremely lower than that of low-frequency components. Inspired by the extended ptychographic iterative engine (ePIE) used in spatial ptychography, the first joint updating formula is proposed by multiplying a spatially varying step size, named the embedded pupil function recovery (EPRY)[50]:
Notice that the step size is relevant to the normalized amplitude of spectrum or the normalized amplitude of pupil function, providing a longer step size where the amplitude is higher and decreasing the step size of pixels that are higher-frequency components and may have a low SNR. The step size is a crucial factor affecting the ultimate solution. Some improved algorithms were proposed by designing different step sizes[51–53].
Recovering aberrations with Eq. (9) is effective when the raw data are highly redundant. If the data redundancy is reduced, a prior knowledge of common optical aberrations can be introduced to the iterative recovery process. Field-dependent pupil recovery introduced the Zernike polynomials and field-dependent aberration polynomials to express pupil aberration for a full FOV[54]. Therefore, the degrees of freedom in solution space are reduced from a 2D matrix to a small number of coefficients. The idea is also adopted in high-speed QPI where only 6 images are recorded[55].
To correct the LED misalignment (i.e., the positional mismatch of sub-spectra), a mechanical alignment procedure is generally satisfactory if the LED arrays have a well-defined arrangement pitch[56,57]. However, the alignment process is often time-consuming and labor-intensive. Correcting the misalignment using phase retrieval algorithms is desirable, and many algorithms have been proposed. Table 1 summarizes some of these developments. For minor misalignment, search methods with a fine initial guess are enough to refine the positions of sub-spectra[58–60]. For large-scale misalignment, physics-based calibration strategies[61,62] tend to outperform search methods. The effect of position misalignment can be relaxed with the feature-domain recovery algorithm, where the cost function is modified as a gradient-based cost function[63,129].
Noise is a common problem in FPM, especially for darkfield imaging. Table 1 summarizes three kinds of algorithms to improve the robustness against noise. If we have information about the statistics of the noise, we can model the noise and use it for optimization[64–66]. If no prior knowledge about noise statistics is known, the adaptive step size strategy for updating can be a good choice to ensure a stable convergence[52]. In addition, one can also suppress the noise by regularizing based on the sample sparsity prior[67,68].
The second group of phase retrieval algorithms concentrates on high-speed imaging (see Table 1). Typically, FPM requires hundreds of intensity images to provide sufficient data redundancy. This process can take tens of seconds to record, hindering real-time observation of live cells. The multiplexed phase retrieved algorithm has enabled multiple-LED illumination at one time[51], improving both the capturing and imaging speeds. The combination of DPC initialization illumination with four semicircle patterns and darkfield multiplexing illumination strategies extremely reduced the capturing time down to
Despite the rapid advancement in phase retrieval algorithms, the phase retrieval accuracy of FPM is sometimes unsatisfactory due to the loss of phase information in low-frequency components. This issue arises from the non-uniform phase transfer function (PTF) inherent in asymmetric-illumination microscopy[73]. For example, when imaging a phase sample with a linear phase ramp,
3.2. Intensity diffraction tomography
The original FPM was developed for 2D thin sample imaging, which is not applicable when the sample is thicker than the objective’s depth-of-field (DOF). On the one hand, the 2D imaging method considers the sample an infinitely thin layer. The sample information outside the DOF is not considered and, therefore, cannot be effectively recovered. On the other hand, the fact that the phase recovered with the 2D method is a product of thickness and average RI may potentially result in inaccurate characterization of samples with complex three-dimensional (3D) structures. To obtain more accurate 3D morphological information, FPM has been advanced to include 3D thick sample imaging. This method does not recover the phase delay caused by the sample; instead, it reconstructs the 3D RI distribution from captured intensity images. In this manuscript, we refer to these techniques as intensity diffraction tomography (IDT).
According to the forward imaging models, FPM-based IDT techniques can be divided into two types. The first type is Fourier ptychographic diffraction tomography (FPDT), which integrates principles of FPM and the Fourier diffraction theorem[74] to achieve 3D QPI. As shown in Fig. 4(a), the Fourier diffraction theorem constructs the bridge linking the 2D Fourier transform of the measurement to the 3D Fourier transform of the scattering potential of the sample under the weak scattering approximation. FPDT was first demonstrated with brightfield measurements[75]. High-angle darkfield illumination was then introduced to extend the accessible spatial frequencies[76]. The method allowed FPDT to achieve lateral resolutions beyond the diffraction limit of the objective (e.g., 390 nm with a 0.4 NA objective). To accelerate the capturing and reconstructing process, FPDT with sparse annular LED illuminations was proposed, reducing the data requirement by more than 40 times[77]. To address the missing cone problem resulting in a poor axial resolution several times worse than the lateral one[78], opposite illumination FPDT combined transmissive angle-scanning and reflective wavelength scanning to obtain near-isotropic resolution (
Figure 4.Forward imaging model of 3D FPM-QPI. (a) Forward imaging model of Fourier ptychographic diffraction tomography, where the scattering potential is used to describe the 3D sample, which is a function of refraction index (RI). (b) Forward imaging model of multi-slice beam propagation, where RI is used to describe the sample that is discretized as multiple infinitely thin slices with equivalent intervals.
The second IDT technique has evolved significantly through the integration of the multi-slice beam propagation (MSBP) model shown in Fig. 4(b), enabling HR reconstruction of volumetric RI and polarization-sensitive properties in complex scattering samples. Early advancement[81] established a foundation by combining light field refocusing with MSBP to correct diffraction artifacts and recover 3D intensity and phase distributions, achieving lateral resolution beyond the diffraction limit of low-NA objectives. The iterative algorithm leveraged angular diversity from LED arrays to resolve thick biological samples slice by slice, demonstrating the feasibility of 3D FPM without weak scattering approximations. Subsequent work extended MSBP to address multiple scattering in optically dense samples, employing a nonlinear optimization framework to reconstruct HR 3D RI maps of multicellular organisms like C. elegans[82]. Further refinements introduced the multi-layer Born (MLB) model[83], which improved accuracy for high-angle illumination and backward scattering by decomposing the sample into slabs and iteratively applying first Born scattering. MLB retained computational efficiency while resolving axial resolution trade-offs inherent in MSBP, enabling gigavoxel-scale reconstructions of thick tissues. Recently, polarization-sensitive intensity diffraction tomography (PS-IDT)[84] integrated vectorial MSBP to recover 3D Jones matrices in anisotropic samples, addressing both isotropic and anisotropic scattering through polarization-modulated illumination. These developments underscore a trajectory toward multi-modal 3D imaging, balancing computational efficiency, physical accuracy, and versatility for diverse biological and material systems.
To better understand the advantages and disadvantages of traditional FPM and IDT, we compare them in Table 2.
Criteria | Traditional FPM | IDT |
Sample category | Thin samples (e.g., unstained slides | Both thin and thick samples (e.g., tissues or embryos) |
Recovered physical quantity | 2D phase delay | 3D refractive index |
Raw data volume | Tens of intensity images | Hundreds of intensity images |
Recovery speed | Tens of seconds (gigapixel recovery using a 4090 GPU) | Several hours (gigavoxel recovery using a 4090 GPU) |
Imaging Robustness | High robustness to system errors using correction algorithms | Low robustness to system errors |
Imaging throughput | 0.23 gigapixels[ | 2.3 gigavoxels[ |
Table 2. Comparison Between Traditional FPM and IDT.
3.3. Artificial intelligence
In recent years, the rapid advancement of computing power and the accumulation of high-quality data have driven explosive developments in AI. Among these advancements, automatic differentiation tools and deep learning methods have become foundational elements, with theories continually being refined and expanded through practical applications. Their widespread adoption across numerous fields has significantly promoted research in areas of FPM-QPI.
Traditional FPM-QPI methods depend heavily on accurate physical modeling, precise system alignment, extensive prior information, and intricate analytical differential calculations. The quality of the imaging results tends to degrade significantly when actual imaging conditions deviate from theoretical modeling assumptions. In contrast, AI-based methods simplify these issues through implicit modeling approaches. Based on their modeling strategies, we categorize AI-based FPM-QPI methods into three main groups: end-to-end deep learning methods, physics-based neural network methods, and physics-based automatic differentiation methods, as shown in Fig. 5.
Figure 5.Modeling strategies for three categories of AI-based FPM-QPI methods. (a) End-to-end deep learning. (b) Physics-based neural network. (c) Physics-based automatic differentiation.
End-to-end deep learning methods utilize deep learning models to establish direct mappings from multi-angle LR intensity measurements to HR complex field distributions, leveraging pre-prepared datasets to learn nonlinear relationships[85,86], as shown in Fig. 5(a). Unlike traditional FPM-QPI, the approaches do not update parameters during the imaging process, enabling rapid inference and intrinsic noise suppression capabilities. PtychNet[85] was the first work to reconstruct the image using an end-to-end deep learning neural network. Afterward, a study[86] proposed a conditional generative adversarial network (cGAN) for dynamic live-cell FPM video reconstruction, achieving high-fidelity phase recovery with minimal training data. The research in Ref. [87] developed a multiscale deep residual network to synthesize complex fields from intensity images, demonstrating exceptional computational efficiency and robustness. To address uncertainties in deep learning predictions, Bayesian CNN frameworks[88] have also been proposed to quantify model and data reliability, enhancing practical applicability in time-series experiments.
Unlike end-to-end methods, physics-based neural network approaches introduce neural networks during optimization or forward modeling without requiring additional training data, as shown in Fig. 5(b). Network parameters are updated during a single imaging process to reconstruct high-quality images. Deep image priors (DIPs)[89] first demonstrated that randomly initialized convolutional neural networks can act as handcrafted priors to achieve remarkable reconstruction results. Applying DIP algorithms to subsampled FPM imaging can improve the reconstruction performance under conditions of low subsampling rates and high noise[90]. The method was extended to separately reconstruct phase, amplitude, pupil aberrations, and illumination variations by employing four parallel untrained neural networks[91], demonstrating significantly better image quality, particularly in phase retrieval, compared to traditional iterative algorithms. Additionally, the physics-informed neural network (PINN) approach integrates neural networks closely with physical imaging models, ensuring robust reconstruction even from limited data. By explicitly embedding physical constraints into neural network optimization, the PINN guides the optimization trajectory, thus reducing dependence on extensive experimental datasets. PhysenNet[92], for example, combined traditional U-Net structures with imaging physics, interactively optimizing between neural networks and physical models to jointly learn network weights and biases, significantly reducing data requirements and exhibiting superior generalization. A sparse FPM-PINN method[93] further integrated DIPs and physical models to achieve high-quality phase reconstruction under sparse sampling conditions without extra training data or labels. A hybrid framework[94] has recently combined the data-driven priors and denoising capabilities of deep learning models with the generalization advantages of physical models, proposing a novel reconstruction approach capable of achieving high-quality image reconstruction comparable to traditional methods while reducing the required LR images by 90%.
Physics-based automatic differentiation methods utilize common automatic differentiation tools from deep learning frameworks (e.g., PyTorch, TensorFlow) to construct physical models explicitly[95,96]. These methods incorporate physical parameters such as pupil functions, illumination variations, and LED positional errors into differentiable layers, simultaneously optimizing hardware parameters and reconstruction quality through gradient backpropagation, as shown in Fig. 5(c). An early implementation[97] designed feedforward neural networks to simulate the FPM forward model using the point spread function or coherent transfer function, optimizing sample reconstruction by minimizing loss functions. Subsequent research FPMN[98] introduced multiparameter networks embedding systematic errors such as pupil aberrations, illumination fluctuations, and LED positional deviations into network layers to achieve robust reconstructions. An unsupervised adaptive illumination framework[99] incorporated a dedicated illumination pattern layer to dynamically optimize LED activation sequences, significantly reducing the number of required LR images by up to 80% and accelerating real-time data acquisition. An uncertainty-aware Fourier ptychography (UA-FP) method[100] simultaneously addressed optical aberrations, misalignments, and low-quality data through differentiable optimization, enabling robust, high-quality imaging without the need for precise calibration. In addition, the batch-FPM scheme[101] proposed a GPU-parallelized automatic differentiation framework based on random batching, enabling rapid and efficient image reconstruction for subsequent research and applications. Due to its unique robustness, one can perform image acquisition with uniform exposure time for both brightfield and darkfield imaging.
In addition, the recovered phase of FPM can be further processed with deep learning approaches to generate required image data in clinical diagnosis and digital pathology. A learned sensing approach[102] co-optimized programmable LED illumination patterns and classification networks, enhancing disease detection accuracy. The method can automatically identify malaria-infected cells with up to 5%–10% greater accuracy than standard and alternative microscope lighting designs. A virtual staining method[103] addressed FPM’s limitations in color fidelity by implementing unsupervised CycleGAN-based frameworks, effectively reducing coherent artifacts and enabling HR imaging without paired training data. Recently, a phase-to-color virtual restaining framework[104] was proposed to restore H&E stain in faded slides. One interesting thing is that the method employed near-infrared illumination to overcome absorption variations between faded and stained samples, avoiding absorption differences between samples with various degrees of fading. The method reminds us that a straightforward visual staining technique from an unstained section to H&E or immunohistochemistry (IHC) staining may become feasible using multi-channel (visible, ultraviolet, and infrared) FPM imaging.
In summary, deep learning has redefined FPM-QPI by balancing speed, robustness, and adaptability. End-to-end methods enable fast phase retrieval with strong noise resistance, and they require little to no physical model construction. However, these methods may not always yield satisfactory results when the feature distribution of test samples significantly deviates from that of the training dataset. Physics-based neural network methods offer a promising approach to addressing data scarcity by appropriately incorporating physical principles. They exhibit strong noise resistance without necessitating highly accurate physical models. However, their reconstruction time typically range from minutes to hours. Physics-based automatic differentiation methods ensure physical consistency for any samples but require the construction of an accurate physical process. Compared to end-to-end methods, they generally require longer reconstruction time, ranging from seconds to minutes, and are more sensitive to noise. The emerging applications in clinical diagnostics and computational pathology highlight the transformative potential of these hybrid methods. We believe that the future development of these methods will focus on enhancing the real-time performance, interpretability, and generalization across various imaging systems, further consolidating FPM-QPI as a cornerstone technology in biomedical and industrial imaging[105].
4. Applications of FPM-QPI
4.1. Label-free live-cell monitoring and analysis
Live-cell monitoring and analysis play a pivotal role in advancing biological research, enabling non-invasive observation of dynamic cellular processes and drug responses at subcellular resolution. FPM-QPI has emerged as a promising computational imaging technique in live-cell studies, addressing the inherent trade-off between spatial resolution and FOV in conventional microscopy. Early implementations of FPM utilized sequentially varying angles to illuminate samples, synthesizing gigapixel-scale phase images with both wide FOV and high resolution. However, prolonged acquisition time (minutes) limited its application to dynamic processes. A method introduced a custom high-brightness LED array and fast control circuitry to shorten the exposure time, enabling a full 173-LED scanning illumination under 7 s[69]. The hardware improvement enabled real-time tracking of subcellular dynamics, including mitosis and lipid droplet transport in unstained cells, with automated segmentation and dry mass quantification, as shown in Fig. 6(a). Hybrid illumination schemes combining brightfield DPC and multiplexed darkfield imaging further reduced the capture time of the system to 0.8 s while maintaining 0.8 NA resolution across a
Figure 6.Label-free cell monitoring and analysis with FPM-QPI. (a) Recovered phase images of unlabeled HeLa cells via the high-speed
Besides the high-speed imaging requirement, long-term imaging is also desirable for live-cell monitoring. However, spatially varying aberrations and focus drifts during the process often degrade the performance of long-term imaging. An adaptive optical strategy was developed for FPM-QPI to address the limitation. By employing NA-matched annular illumination and Zernike polynomial-based aberration correction, the method achieved diffraction-limited resolution (655 nm laterally) across
4.2. Digital pathology and clinical diagnosis
In digital pathology, digital images of stained histology slides are acquired and used for diagnostic purposes. Compared with conventional microscopy, the phase images recovered by FPM provide a completely new dimension of information for pathologists. Mining the benefits of phase information for digital pathology and clinical diagnosis is a long-standing research topic. One early study[106] derived tissue scattering properties via spatial variance and gradient variance of phase maps recovered from stained pathological slides to reveal microscale heterogeneity, as shown in Fig. 7(a). Visual staining based on the recovered phase is another attractive research. Although a colorful FPM intensity image can be generated by fusing three-channel RGB images, the coherent artifacts in each channel can reduce the color accuracy compared with the regular incoherent images. To address the limitation, one method[103] used a CycleGAN to translate FPM phase images into virtual brightfield- and fluorescence-stained outputs. A whole-slide virtual IHC staining image with this method is shown in Fig. 7(b). The magnified network outputs are similar to the ground truth captured by a
Figure 7.Digital pathology and clinical diagnosis with FPM-QPI. (a) Large-field complex amplitude images recovered from a stained pathology slide. The recovered phase image shows the phase delays induced by the sample, and the reduced scattering map quantifies how much light has been scattered by the sample, revealing the microscale heterogeneity[
The recovered phase images can also be used for clinical diagnosis. Traditional histological methods relying on chemical staining, although effective, introduce variability due to operator-dependent protocols and potential artifacts from uneven dye distribution. In contrast, QPI can bypass the need for staining while preserving native structural and biophysical information, including optical thickness and RI variations. The research in Ref. [107] has demonstrated that FPM can provide HR phase images without staining and preserve the morphology of tissue structures. Figure 7(c) shows the phase image of an unstained renal slide, where the morphologies of both glomerulus and vasal sections can be observed with tiny details. Based on the morphology information contained in phase images, the integration of phase-derived fractal biomarkers with machine learning algorithms has shown promise in automating disease classification[108].
Polarized microscopes have emerged as a powerful tool in clinical diagnosis by enabling quantitative assessment of optically anisotropic biomarkers associated with pathological conditions[109–111]. The integration of FPM with polarization analysis[112] significantly enhances diagnostic capabilities through HR birefringence mapping across large FOVs. By reconstructing Jones matrices from phase images, polarization-sensitive FPM quantified birefringence parameters (retardation, optic-axis orientation) at submicron resolution, resolving structural details in pathological crystals. Figure 7(d) shows the hemozoin detection in malaria-infected red blood cells. The overlay image simultaneously provides structure information of the normal red blood cells and the precise location of hemozoin crystals.
4.3. Topography measurement
FPM has established itself as a robust technique for quantitative topography measurement, offering distinct advantages in large-area non-contact profiling with high spatial resolution and nanometer-scale accuracy. Unlike conventional interferometry or scanning probe techniques, FPM achieves wide-field measurements without mechanical scanning, combining sub-nanometer vertical sensitivity with millimeter-scale lateral FOV. This unique combination addresses critical challenges in industrial inspection scenarios.
It is noted that the original FPM implementation is demonstrated with a transmission microscope, which is not applicable for opaque industrial samples such as semiconductor wafers and integrated circuits. To address the limitation, FPM has been demonstrated with reflective system configuration[113] and has been further developed for higher NAs[114–118], longer axial measurement arrangements[120,121], and lower wavelengths[53,122–125].
Fourier ptychographic topography (FPT)[117] achieved nanoscale height reconstruction accuracy by synthesizing brightfield and darkfield LED illuminations with reflective configurations. This approach demonstrated a synthetic NA of 0.84 and 750 nm resolution over a
Figure 8.Topography measurement with FPM-QPI. (a) Topography reconstruction of a high-resolution phase-type sample with reflective Fourier ptychographic topography (FPT). The height profiles are compared with the measurement of an optical profilometer, demonstrating the effectiveness of FPT[
If the sample surface contains step-height structures with significant height variations, it can induce a drastic phase change exceeding 2π, which cannot be unwrapped by algorithms that rely on phase continuity[119]. To overcome this limitation, a dual-wavelength FPM-QPI approach was developed[120]. By combining 620 and 633 nm illuminations, the method achieved a synthetic wavelength of 30.19 µm, enabling precise measurement of 1.8 µm steps with
5. Outlook
FPM-QPI has emerged as a powerful tool for HR, large-FOV, and label-free imaging, yet several challenges and research trends must be addressed to fully realize its potential.
5.1. Current challenges
5.1.1 Improving the phase transfer function
The optical transfer function (OTF) consists of the modulation transfer function (MTF) and the PTF. The PTF typically reflects the transfer characteristics of an optical system regarding phase variations at different spatial frequencies. Conventional FPM systems often exhibit non-uniform PTFs under non-ideal illumination conditions, leading to incomplete recovery of low-frequency phase information. This limitation reduces phase measurement accuracy, particularly for specimens with linear phase ramps or uniform phase gradients. Meanwhile, the effective bandwidth of the PTF determines the highest spatial resolution in phase imaging. A non-uniform PTF often results in the loss or distortion of high-frequency phase details, such as the edges of subcellular structures. Currently, approaches such as exploiting the defocused phase contrast to circumvent the stringent requirement on the illumination NA imposed by the matched illumination condition have been proposed. This method effectively addressed the reconstruction quality deterioration and RI underestimation problems in conventional FPDT, allowing for more precise HR tomographic imaging[80]. Another approach attached a flexible, detachable weak-scattering phase modulator to the top of the image sensor, using microparticles on the thin film to spatially encode the complex wavefront of the object. This process converts the phase information into detectable intensity variations, ensuring a uniform frequency response across the entire synthetic bandwidth and correcting RI underestimation issues[73]. In the future, developing simpler and more efficient methods to achieve an ideal PTF remains a fundamental challenge for advancing high-accuracy QPI.
5.1.2. Calibrating the mismatch of the physical model
The forward imaging model of FPM serves as the foundation for achieving HR reconstruction of targets. However, limitations imposed by approximations such as the plane wave approximation for spherical wave illumination, the thin object assumption, and the ideal optical system assumption significantly degrade the quality and accuracy of practical image reconstruction. Although existing methods such as EPRY[50] or full-field pupil recovery[54] can calibrate the aberrations, they do not work well with weak absorption samples under a relatively high aberration level[128]. The feature-domain phase retrieval algorithm[63,129] provided an alternative avenue to perform blind FPM reconstruction by taking advantage of invariance components of images against mismatches of physical models, but the computational time of hundreds of iterations limits its application in real-time computational microscopy. The development of computation-efficient non-convex phase retrieval algorithms for handling these mismatches is highly desired for high-accuracy QPI.
5.2. Research trends
5.2.1. High-speed and long-term imaging
Although advancements in illumination coding[69,93] and adaptive optics[55] have improved the temporal resolution and aberration tolerance of FPM-QPI, the inherent trade-offs between data efficiency and reconstruction fidelity remain unresolved. Strategies to minimize image acquisition often compromise phase accuracy due to sensitivity to illumination misalignment or noise. Additionally, the computational demands of real-time phase retrieval and gigapixel-scale processing limit throughput, especially when scaling to capture datasets required for tracking rare, transient cellular events alongside population-level dynamics. Furthermore, although adaptive aberration correction enhances stability over extended periods, environmental factors such as thermal drift or mechanical vibrations in live-cell cultures still pose risks to long-term imaging consistency, highlighting the need for tighter hardware-software integration. To address these limitations, future efforts could prioritize synergistic innovations in optical systems and computational frameworks. For example, integrating high-speed programmable illumination with deep-learning-based reconstruction algorithms may simultaneously accelerate acquisition, reduce data redundancy, and enhance noise robustness, thereby balancing spatiotemporal resolution without sacrificing the FOV.
5.2.2. Multi-model fusion
Most QPI measurements do not account for the wavelength-dependent RI dispersion of biological samples. Multispectral or hyperspectral FPM could provide valuable insights into phase distributions related to dispersion, enabling more comprehensive sample characterization. In addition, combining FPM with fluorescence or Raman imaging[130] could enrich functional insights while retaining label-free QPI features.
5.2.3. 3D QPI
2D QPI only provides integrated RI information along one direction, limiting its ability to reveal full structural details. 3D QPI, or IDT, is a promising direction. Developing better forward models and inverse reconstruction algorithms, potentially aided by AI-driven approaches, will be critical for advancing 3D QPI.
5.3. Application trends
5.3.1. Life science
FPM-QPI holds great promise for applications in cell dynamics, cell growth, and tissue optics. For instance, the growing demand for label-free cell monitoring in cell and gene therapy (CGT) highlights the need for non-invasive, real-time imaging techniques to track cell states, proliferation, and differentiation without compromising cell viability. CGT requires multiple cell viability measurements, density, and other parameters during cell culture. Traditional methods use fluorescent labeling to obtain these parameters, but the stained cells are already contaminated and cannot be reused, leading to wastage of cells. We anticipate that the high-SBP QPI capability of FPM can completely establish it to replace the fluorescent labeling methods to obtain the desired cell parameters.
5.3.2. Clinical medicine
To achieve clinical deployment, FPM-based QPI must meet additional requirements such as high throughput and cost-effectiveness. Emerging applications in drug screening[131] and tissue diagnosis[108,112] show potential, but challenges remain in understanding tissue optical properties. Current limitations include the lack of experimental methods to measure cell and tissue optical properties and the variability of refractive indices across different organs and within tissues. Ideal measurements should provide scattering properties from the organelle to organ scales, a goal that has yet to be fully realized.
5.3.3. Surface metrology
Current FPM-based QPI systems for topographic metrology remain constrained by fundamental trade-offs between spatial/axial resolution, temporal stability, and operational practicality. While synthetic aperture strategies enhance lateral resolution, their reliance on sequential illumination scanning inherently limits temporal resolution and introduces vibration sensitivity in industrial environments. The extended DOF capabilities achieved through computational refocusing conversely amplify phase retrieval ambiguities near steep edges. Future progress may exploit hybrid interferometric-FPM architectures with spectrally engineered illumination to decouple sensitivity from mechanical scanning, potentially enabling simultaneous
References
[1] J. Mertz. Introduction to Optical Microscopy(2019).
[7] J. Goodman. Introduction to Fourier Optics(2005).
[8] M. Abramowitz. Contrast Methods in Microscopy: Transmitted Light(1987).
[11] R. Allen, G. Davida, G. Nomarski. The Zeiss-Nomarski differential interference equipment for transmitted-light microscopy. Z. Wiss. Mikrosk, 69, 193(1969).
[29] M. Born et al. Principles of Optics: Electromagnetic Theory of Propagation, Interference and Diffraction of Light(1999).
[39] R. Gerchberg, W. Saxton. Phase determination for image and diffraction plane pictures in the electron microscope. Optik, 34, 275(1971).
[85] A. Kappeler et al. Ptychnet: CNN based Fourier ptychography, 1712(2017).
[89] D. Ulyanov, A. Vedaldi, V. Lempitsky. Deep image prior, 9446(2018).
[96] N. Chen, D. Brady, E. Lam. Differentiable Imaging: Progress, Challenges, and Outlook(2025).
[101] R. Sun et al. Batch-FPM: random batch-update multi-parameter physical Fourier ptychography neural network(2024).
[105] Y. Su et al. Advancing tumor budding detection with Fourier ptychography microscopy(2025).
[124] C. Gu et al. Enhanced EUV mask imaging using Fourier ptychographic microscopy, 31424(2025).

Set citation alerts for the article
Please enter your email address