Author Affiliations
School of Electro-Optical Engineering, Changchun University of Science and Technology, Changchun 130022, Jilin , Chinashow less
Fig. 1. Schematic diagram of the system
Fig. 2. Structure of the system
Fig. 3. Feature map attributes predicted by the YOLOv4 network
Fig. 4. Simplified structure of the improved YOLOv4 network
Fig. 5. Connection mode of three network structures. (a) Connection mode 1; (b) connection mode 2; (c) connection mode 3
Fig. 6. Principles of two feature fusion modes. (a) Concatenate; (b) add
Fig. 7. Flow chart of the PID algorithm
Fig. 8. Some images in the data set
Fig. 9. Training results of the beacon spot data set
Fig. 10. Training results of different networks. (a) Loss function; (b) mAP
Fig. 11. Captured alignment result of the UAV. (a) Indoor environment; (b) background glare interference environment; (c) flight status
Count | Category | XTP | XFP | XFN | XTN |
---|
518 | beacon spot | 503 | 2 | 1 | 13 |
|
Table 1. Recognition results of the test set
Data set | Training set | Validation set | Training set +validation set | Test set | Total data set |
---|
Image | Object | Image | Object | Image | Object | Image | Object | Image | Object |
---|
Total | 8218 | 19910 | 8333 | 20148 | 16551 | 40058 | 16492 | 39482 | 33043 | 79540 | PASCAL VOC 2007 | 2501 | 6301 | 2510 | 6207 | 5011 | 12608 | 4952 | 12032 | 9963 | 24640 | PASCAL VOC 2012 | 5717 | 13609 | 5823 | 13841 | 11540 | 27450 | 11540 | 27450 | 23080 | 54900 |
|
Table 2. Statistics of PASCAL VOC 2007 and PASCAL VOC 2012 data sets
Network | Train | mAP /% | FPS |
---|
YOLOv4 | PASCAL VOC 2007+PASCAL VOC 2012 | 76 | 8 | YOLOv4.tiny | PASCAL VOC 2007+PASCAL VOC 2012 | 49 | 47 | Improved YOLOv4 | PASCAL VOC 2007+PASCAL VOC 2012 | 63 | 42 |
|
Table 3. Detection results of different networks on the PASCAL VOC 2007 test set
Parameter | NVIDIA Jetson Xavier NX embedded system |
---|
GPU | NVIDIA Volta architecture with 384 NVIDIA CUDA® cores and 48 Tensor cores | CPU | 6-core NVIDIA Carmel ARM®v8.2 64-bit CPU 6 MB L2 + 4 MB L3 | Memory | 8 GB 128-bit LPDDR4x @ 51.2 Gbit/s | Storage | microSD(128 G) | Mechanical | 103 mm×90.5 mm×34.66 mm |
|
Table 4. Parameters of NVIDIA Jetson Xavier NX embedded system