• High Power Laser and Particle Beams
  • Vol. 33, Issue 8, 081004 (2021)
Zhiguang Zhang, Huizhen Yang*, Jinlong Liu, Songheng Li, Hang Su, Yuxiang Luo, and Xiewen Wei
Author Affiliations
  • School of Electrical Engineering, Jiangsu Ocean University, Lianyungang, 222005, China
  • show less
    DOI: 10.11884/HPLPB202133.210295 Cite this Article
    Zhiguang Zhang, Huizhen Yang, Jinlong Liu, Songheng Li, Hang Su, Yuxiang Luo, Xiewen Wei. Research progress in deep learning based WFSless adaptive optics system[J]. High Power Laser and Particle Beams, 2021, 33(8): 081004 Copy Citation Text show less
    Perceptron artificial neural network for phase retrieval[18]
    Fig. 1. Perceptron artificial neural network for phase retrieval[18]
    Modified Inception v3CNN model for predicting Zernike coefficients[20]
    Fig. 2. Modified Inception v3CNN model for predicting Zernike coefficients[20]
    Zernike coefficients predicting results of focused target[23]
    Fig. 3. Zernike coefficients predicting results of focused target[23]
    Zernike coefficients predicting results of overexposed target[23]
    Fig. 4. Zernike coefficients predicting results of overexposed target[23]
    WFSless system architecture[26]
    Fig. 5. WFSless system architecture[26]
    Architecture of CNN[26]
    Fig. 6. Architecture of CNN[26]
    Data flow of training and predictions[29]
    Fig. 7. Data flow of training and predictions[29]
    Residual wavefront RMS with and without compensation under different turbulence levels[29]
    Fig. 8. Residual wavefront RMS with and without compensation under different turbulence levels[29]
    Zernike coefficients prediction results by models trained with dataset of different turbulence levels[31]
    Fig. 9. Zernike coefficients prediction results by models trained with dataset of different turbulence levels[31]
    Trained neural network is optimized by TensorRT to build the inference engine for implementation[35]
    Fig. 10. Trained neural network is optimized by TensorRT to build the inference engine for implementation[35]
    Wavefront Net (WFNet)[36]
    Fig. 11. Wavefront Net (WFNet)[36]
    CNN architecture[38]
    Fig. 12. CNN architecture[38]
    Standard deviation of phase before and after phase aberration revision[38]
    Fig. 13. Standard deviation of phase before and after phase aberration revision[38]
    An object irrelevant wavefront sensing scheme using LSTM neural network[41]
    Fig. 14. An object irrelevant wavefront sensing scheme using LSTM neural network[41]
    Image restoration results based on wavefront error inferred by LSTM[41]
    Fig. 15. Image restoration results based on wavefront error inferred by LSTM[41]
    Prediction results of the next 5 frames wavefront made by LSTM[44]
    Fig. 16. Prediction results of the next 5 frames wavefront made by LSTM[44]
    Reinforcement Learning(RL) of WFSless AO[47]
    Fig. 17. Reinforcement Learning(RL) of WFSless AO[47]
    Intensity distribution of point target with wavefront error and that after restoration by deep RL[47]
    Fig. 18. Intensity distribution of point target with wavefront error and that after restoration by deep RL[47]
    PSD of different vibration frequency[51]
    Fig. 19. PSD of different vibration frequency[51]
    Residual phase[51]
    Fig. 20. Residual phase[51]
    Principle of aberration correction in high resolution optical microscopes[59]
    Fig. 21. Principle of aberration correction in high resolution optical microscopes[59]
    Schematic diagram of MAL-WSAO-SS-OCT system[63]
    Fig. 22. Schematic diagram of MAL-WSAO-SS-OCT system[63]
    Zernike coefficients
    in-focusoverexposuredefocusscatter
    point source0.142±0.0320.036±0.0130.040±0.0160.057±0.018
    extended source0.288±0.0240.214±0.0510.099±0.0640.195±0.064
    Table 1. Accuracy of Zernike coefficients (RMS) with overexposure, defocus and scattering preprocessing[23]
    dataset No.$ D/{r}_{0} $$ D/{r}_{0} $ interval data volume/ interval total data volume $D/{r}_{0}$ interval data volume/intervaltotal data volume
    training datasettest dataset
    1510015000101500
    21510015000101500
    31-151100150001101500
    Table 2. Dataset of three different turbulence levels[31]
    $ D/{r}_{0} $NPMSRMS/λ
    $ 20 $0.00670.1307
    $ 15 $0.00410.0909
    $ 10 $0.00290.0718
    $ 6 $0.00250.0703
    Table 3. Simulation results of wavefront restoration error under different turbulence levels (NPMS: Normalized Pixel Mean Square; RMS: Root Mean Square)[32]
    $ D/{r}_{0} $NPMSRMS/λrunning time/ms
    $ 20 $0.00660.1304~12
    Table 4. Wavefront restoration error and time consumption of experiments (NPMS: Normalized Pixel Mean Square; RMS: Root Mean Square)[32]
    networkfocal model/msdefocused model/msPD model/ms
    PD-CNN2.24952.29892.5591
    Xception10.46910.110810.469
    Table 5. Comparison of inference time of PD-CNN with that of Xception[34]
    modelbefore acceleration/msafter acceleration/msacceleration ratio
    focal model2.24950.46784.8091
    defocused model2.29890.44065.2178
    PD model2.55910.49095.2135
    Table 6. Comparison of inference time with and without optimization by TensorRT[34]
    AO simulation tooldeep learning framework
    Soapy:Simulation ‘OptiqueAdaptative’ with Python    HCIPy:High Contrast Imaging for Python OOMAO:Object-Oriented MATLAB Adaptive Optics Toolbox    YAO:Yorick Adaptive Optics DASP: Durham Adaptive Optics Simulation Platform
    Soapy[21]PyTorch (www.pytorch.org)
    HCIPy[52]Keras (www.keras.io)
    OOMAO[54]TensorFlow (www.tensorflow.org)
    YAO[55]MATLAB + Deep Learning Toolbox
    DASP[56]Caffe (https://caffe.berkeleyvision.org/)
    Table 7. WFSless AO simulation software
    Zhiguang Zhang, Huizhen Yang, Jinlong Liu, Songheng Li, Hang Su, Yuxiang Luo, Xiewen Wei. Research progress in deep learning based WFSless adaptive optics system[J]. High Power Laser and Particle Beams, 2021, 33(8): 081004
    Download Citation