• Acta Photonica Sinica
  • Vol. 51, Issue 7, 0751408 (2022)
An PAN1、2、*, Yuting GAO1、2, Aiye WANG1、2, Huiqin GAO1、2, Caiwen MA1、2, and Baoli YAO1、2
Author Affiliations
  • 1Xi'an Institute of Optics and Precision Mechanics,Chinese Academy of Sciences,Xi'an 710119,China
  • 2University of Chinese Academy of Sciences,Beijing 100094,China
  • show less
    DOI: 10.3788/gzxb20225107.0751408 Cite this Article
    An PAN, Yuting GAO, Aiye WANG, Huiqin GAO, Caiwen MA, Baoli YAO. High-throughput Full-color Fourier Ptychographic Microscopy for the Next Generation of Digital Pathologic Imager and Analyser(Invited)[J]. Acta Photonica Sinica, 2022, 51(7): 0751408 Copy Citation Text show less

    Abstract

    Fourier Ptychographic Microscopy (FPM) is a promising computational imaging technique, which tackles the intrinsic trade-off between high resolution and large wide Field Of View (FOV) with a combination of Synthetic Aperture Radar (SAR) and optical phase retrieval. In brief, an LED array beneath the microscope provides illumination of the object from different incident angles. The range of light that can be collected is determined by the Numerical Aperture (NA) of the objective, while parts of the scattering light with a high-angle illumination can also be collected because of light-matter interaction. The low resolution intensity images recorded at each illumination angle are then synthesized in the Fourier domain, thus the object’s high-frequency information can be modulated into the passband of the objective. After an iterative phase reconstruction process, the synthesized information generates a high resolution object image including both intensity and phase properties. Additionally, it preserves the original large FOV as a low-NA objective is used to stitch low resolution images together. Given its flexible setup without mechanical scanning and interferometric measurement, FPM has developed rapidly, which not only acts as a tool to obtain both HR and large FOV but is also regarded as a paradigm to solve a series of trade-off problems, say, the trade-off between angular resolution and spatial resolution in light field imaging. And it may inspire to solve the trade-off between spectral resolution and spatial resolution in imaging spectrometer in the future.In this paper, we comprehensively summarized the development trend of FPM technique in 9 aspects, including high-precision imaging, high-throughput imaging, high-speed or single shot imaging, 3D or tomography imaging, mixed state decoupling, spectral dimension (color imaging to hyperspectral imaging), high dynamic range, system extension, and typical applications. Among them, digital pathology is one of the earliest and the most successful applications of FPM. Distinguished from other reviews, we focused on introducing the development process and recent advances in the direction of digital pathology, and divided it into “0-1”, “1-10”, and “10-100” three periods and several stages. Several typical results are also provided. Specifically, the “0-1” refers to the birth of FPM, which breaks the mutual restrictions between FOV and spatial resolution. The “1-10” refers to the exploration period, where the accuracy and stability, limits and bottlenecks, and the efficiency of FPM have been successively discussed and improved. The stage of “10-100” refers to the industrialization period. During this period, researchers focus on market-oriented requirements including acquisition and analysis of color, since full-color imaging is of critical importance for analyzing labeled tissue sections.We point out that FPM has entered the industrialization stage of “10-100” in this application direction.The current task is to build a prototype or product based on FPM. We expect that the product can obtain a spatial resolution of around 200 nm~1 000 nm, a FOV of around 10 mm (2× objective) or 5 mm (4× objective) diameter full-color FPM reconstructed image within 4 s at the DOF of around 0.3~0.5 mm stably and efficiently. We estimate that it can be capable of automation and batch scanning within the next 1~2 years. We analyzed the industry development situations of digital pathology and related market requirements, and discussed the potential of FPM for large-scale socio-economic benefits. We demonstrated that the full-color images with high quality and content and quantitative phase images produced by FPM may play a role of promotion in wide fields, including intraoperative pathology, quantitative Artificial Intelligence (AI) diagnosis, three-dimensional reconstruction, telepathology, teaching and standardized industry criteria. It should also be clarified that as a typical interdisciplinary field, even if the instrument is successfully invented, it only solves issues in the imaging section of the whole process of digital pathology, and there still remain a series of tough tasks to complete. We discussed and classified related scientific problems, technical problems, engineering problems, and industrial problems in detail, whose successful and perfect resolution relies on joint efforts of various parties and constructive introduction of several potential approaches. By combining the FPM solution with the upstream and downstream advanced methods, including the virtual staining, multimodal fusion imaging, label-free observation in situ, non-destructive three-dimensional reconstruction, preliminary screening, and recognition with AI, etc., we believe that the industry problems will eventually be overcome or alleviated.
    [o]kx,ky=ox,y=ox,ye-jxkx+ykydxdy

    View in Article

    Im,nx,y=-1ox,yejxkx,m,n,jyky,m,nPkx,ky2=-1Okx-kx,m,n,ky-ky,m,nPkx,ky2

    View in Article

    kx,m,n=2πλxm,n-x0xm,n-x02+ym,n-y02+h2ky,m,n=2πλym,n-y0xm,n-x02+ym,n-y02+h2

    View in Article

    minOkx,kyε=minOkx,kym,nx,yIm,nx,y--1Okx-kx,m,n,ky-ky,m,nPkx,ky2

    View in Article

    I01+ejksinθ1x+e-jksinθ1x=I01+2cosksinθ1x

    View in Article

    Im,nx,y=wm,n-1Okx-kx,m,n-Δkx,m,n,ky-ky,m,n-Δky,m,ne(jkxΔx,jkyΔy)Pkx,kyejϕ2+IN,m,n

    View in Article

    An PAN, Yuting GAO, Aiye WANG, Huiqin GAO, Caiwen MA, Baoli YAO. High-throughput Full-color Fourier Ptychographic Microscopy for the Next Generation of Digital Pathologic Imager and Analyser(Invited)[J]. Acta Photonica Sinica, 2022, 51(7): 0751408
    Download Citation