• Acta Optica Sinica
  • Vol. 39, Issue 2, 0215005 (2019)
Xiaodong Jiang1、*, Jiyan Yu1、*, Jiansen Huang2, and Likun Zhu3
Author Affiliations
  • 1 Minsterial Key Laboratory of ZNDY, Nanjing University of Science and Technology, Nanjing, Jiangsu 210094, China
  • 2 School of Science, Nanjing University of Science and Technology, Nanjing, Jiangsu 210094, China
  • 3 CETHIK Group Institute, CETHIK Group Co. Ltd., Hangzhou, Zhejiang 310012, China
  • show less
    DOI: 10.3788/AOS201939.0215005 Cite this Article Set citation alerts
    Xiaodong Jiang, Jiyan Yu, Jiansen Huang, Likun Zhu. Observation System of Special Vehicle Based on Perspective Display[J]. Acta Optica Sinica, 2019, 39(2): 0215005 Copy Citation Text show less
    Working principle of PSD sensor
    Fig. 1. Working principle of PSD sensor
    Relations of transformation in coordinate system
    Fig. 2. Relations of transformation in coordinate system
    Relation of inertial attitude sensing axis
    Fig. 3. Relation of inertial attitude sensing axis
    Structure of outboard observation system based on visual display
    Fig. 4. Structure of outboard observation system based on visual display
    Design of PSD signal processing circuit
    Fig. 5. Design of PSD signal processing circuit
    Flow of complementary fusion filtering algorithm for helmet attitude angle
    Fig. 6. Flow of complementary fusion filtering algorithm for helmet attitude angle
    Helmet perspective solution principle
    Fig. 7. Helmet perspective solution principle
    Design diagram of optical system for perspective display
    Fig. 8. Design diagram of optical system for perspective display
    Schematic of ZEMAX's equivalent optical design
    Fig. 9. Schematic of ZEMAX's equivalent optical design
    Effect of distortion correction. (a) Image before distortion correction; (b) image after distortion correction
    Fig. 10. Effect of distortion correction. (a) Image before distortion correction; (b) image after distortion correction
    Overall structure diagram of hardware acceleration process of image feature calculation and registration based on Zynq SoC processor
    Fig. 11. Overall structure diagram of hardware acceleration process of image feature calculation and registration based on Zynq SoC processor
    Hardware circuit implementation of Gaussian filtering. (a) Hardware circuit structure; (b) window function of Gaussian filter
    Fig. 12. Hardware circuit implementation of Gaussian filtering. (a) Hardware circuit structure; (b) window function of Gaussian filter
    Original image and effect of Gaussian filtering image. (a) Original image; (b) image filtered by Gaussian filter
    Fig. 13. Original image and effect of Gaussian filtering image. (a) Original image; (b) image filtered by Gaussian filter
    Schematic diagram of Gaussian scale pyramid and differential Gaussian pyramid
    Fig. 14. Schematic diagram of Gaussian scale pyramid and differential Gaussian pyramid
    Schematic of hardware circuit for parallel detection
    Fig. 15. Schematic of hardware circuit for parallel detection
    Effect of image feature points and direction determination. (a) Original image; (b) characteristic image
    Fig. 16. Effect of image feature points and direction determination. (a) Original image; (b) characteristic image
    Flow chart of hardware realization for electronic image stabilization based on image features
    Fig. 17. Flow chart of hardware realization for electronic image stabilization based on image features
    Flow chart of hardware realization for image registration and fusion processing
    Fig. 18. Flow chart of hardware realization for image registration and fusion processing
    Experimental results of hardware realization for image feature matching and fusion. (a) Left image; (b) right image; (c) schematic diagram of image feature matching and fusion
    Fig. 19. Experimental results of hardware realization for image feature matching and fusion. (a) Left image; (b) right image; (c) schematic diagram of image feature matching and fusion
    NumberPreset viewMeasure viewError analysis
    Direction angle /(°)Pitch angle /(°)Direction angle /(°)Pitch angle /(°)Direction angle error /(°)Pitch angle error /(°)
    10.0-35.00.5-34.60.50.4
    245.0-10.045.1-10.40.10.4
    360.0+15.059.6+14.90.40.1
    490.0+27.089.7+27.80.30.8
    5120.0+12.0119.8+12.30.20.3
    6330.0-21.0330.4-21.70.40.7
    7315.0-16.0314.8-16.90.20.9
    8300.0+23.0300.4+23.60.40.6
    9270.0+19.0270.6-19.70.60.7
    10240.0+3.0230.9+3.80.90.8
    Table 1. Experimental results of position detection, attitude sensing and perspective
    NumberPC with opencv 2.4.10Zynq SoCCharacteristic overlap /%
    Number of feature pointsTime consuming /msNumber of feature pointsTime consuming /ms
    15961268.55693.691.68
    27691568.77305.690.65
    34391139.44163.292.34
    Table 2. Experiment results of image feature extraction and time-consuming comparison
    Image typeFeature matching rate of adjacent images≥50% /%Feature matching rate of adjacent images<50% /%
    With electronic image stabilization80.3419.66
    Original image56.3943.61
    Table 3. Experimental results of electronic image stabilization
    Xiaodong Jiang, Jiyan Yu, Jiansen Huang, Likun Zhu. Observation System of Special Vehicle Based on Perspective Display[J]. Acta Optica Sinica, 2019, 39(2): 0215005
    Download Citation