• Infrared and Laser Engineering
  • Vol. 50, Issue 12, 20210856 (2021)
Shujun Zheng1, Manhong Yao2, Shengping Wang1, Zibang Zhang1、3, Junzheng Peng1、3, and Jingang Zhong1、3
Author Affiliations
  • 1Department of Optoelectronic Engineering, Jinan University, Guangzhou 510632, China
  • 2School of Optoelectronic Engineering, Guangdong Polytechnic Normal University, Guangzhou 510665, China
  • 3Guangdong Provincial Key Laboratory of Optical Fiber Sensing and Communications, Guangzhou 510632, China
  • show less
    DOI: 10.3788/IRLA20210856 Cite this Article
    Shujun Zheng, Manhong Yao, Shengping Wang, Zibang Zhang, Junzheng Peng, Jingang Zhong. Single-pixel fast-moving object classification based on optical-electronical hybrid neural network (Invited)[J]. Infrared and Laser Engineering, 2021, 50(12): 20210856 Copy Citation Text show less
    Optical configuration of structured detected single-pixel imaging
    Fig. 1. Optical configuration of structured detected single-pixel imaging
    Framework of the fully convolutional neural network
    Fig. 2. Framework of the fully convolutional neural network
    Optical-electronical hybrid neural network
    Fig. 3. Optical-electronical hybrid neural network
    Example of the original training images and corresponding images with random rotation and lateral shift
    Fig. 4. Example of the original training images and corresponding images with random rotation and lateral shift
    Confusion matrix of the classification results on handwritten digit test set (15 kernels)
    Fig. 5. Confusion matrix of the classification results on handwritten digit test set (15 kernels)
    2D convolutional kernel images of the first layer in the fully convolutional neural network
    Fig. 6. 2D convolutional kernel images of the first layer in the fully convolutional neural network
    MNIST test set classification accuracy of networks with different number of convolutional kernels
    Fig. 7. MNIST test set classification accuracy of networks with different number of convolutional kernels
    Optical system. (a) Experimental setup; (b) Layout of the handwritten digits on disk
    Fig. 8. Optical system. (a) Experimental setup; (b) Layout of the handwritten digits on disk
    A pair of binarized convolutional kernel images
    Fig. 9. A pair of binarized convolutional kernel images
    Snapshots of digit "5" in motion at different speeds captured by using a camera
    Fig. 10. Snapshots of digit "5" in motion at different speeds captured by using a camera
    Single-pixel measurements of moving handwritten digits. (a) Single-pixel measurements of handwritten digits passing through the field of view successively in 1.5 s; (b) Partially enlarged view of the single-pixel measurements of the digit "5" in (a); (c) Result of the differential measurement from (b)
    Fig. 11. Single-pixel measurements of moving handwritten digits. (a) Single-pixel measurements of handwritten digits passing through the field of view successively in 1.5 s; (b) Partially enlarged view of the single-pixel measurements of the digit "5" in (a); (c) Result of the differential measurement from (b)
    The ten classes and example images in Fashion-MINST dataset
    Fig. 12. The ten classes and example images in Fashion-MINST dataset
    Fashion-MINST test set classification accuracy of networks with different number of convolutional kernels
    Fig. 13. Fashion-MINST test set classification accuracy of networks with different number of convolutional kernels
    Linear velocity/m·s−1Number of kernelsCorrectTotalCorrect/Total
    1.3645785218135.99%
    1052368176.80%
    1558460796.21%
    20339339100.00%
    2532334693.35%
    3018019592.31%
    2.4505737211034.93%
    1039960565.95%
    1546453586.73%
    2024927191.88%
    2520926379.47%
    3019028766.20%
    4.9265892267933.30%
    1054397355.81%
    1542062567.20%
    2019033257.23%
    2514532644.48%
    3011430137.87%
    Table 1. Experiment classification results of moving handwritten digits
    Classifier nameAccuracy
    Linear classifier [20]88.00%
    SVM [23]98.60%
    6-layer neural network [24]99.65%
    Deep convolutional network [25]99.65%
    Proposed network97.99%
    Table 2. Results of different models on MNIST datasets
    Shujun Zheng, Manhong Yao, Shengping Wang, Zibang Zhang, Junzheng Peng, Jingang Zhong. Single-pixel fast-moving object classification based on optical-electronical hybrid neural network (Invited)[J]. Infrared and Laser Engineering, 2021, 50(12): 20210856
    Download Citation