• Opto-Electronic Engineering
  • Vol. 51, Issue 3, 230317-1 (2024)
Huaiyu Cai1,2, Zhaoqian Yang1,2, Ziyang Cui1,2, Yi Wang1,2, and Xiaodong Chen1,2,*
Author Affiliations
  • 1School of Precision Instrument and Opto-electronics Engineering, Tianjin University, Tianjin 300072, China
  • 2Key Laboratory of Optoelectronic Information Technology Ministry of Education, Tianjin University, Tianjin 300072, China
  • show less
    DOI: 10.12086/oee.2024.230317 Cite this Article
    Huaiyu Cai, Zhaoqian Yang, Ziyang Cui, Yi Wang, Xiaodong Chen. Image-guided and point cloud space-constrained method for detection and localization of abandoned objects on the road[J]. Opto-Electronic Engineering, 2024, 51(3): 230317-1 Copy Citation Text show less

    Abstract

    Abandoned objects on the road significantly impact traffic safety. To address issues such as missed detections, false alarms, and localization difficulties encountered in detecting of small-to-medium-sized abandoned objects, this paper proposes a method for detecting and locating abandoned objects on the road using image guidance and point cloud spatial constraints. The method employs an improved YOLOv7-OD network to process image data, extracting information about two-dimensional target bounding boxes. Subsequently, these bounding boxes are projected onto the coordinate system of the LiDAR sensor to get a pyramidal region of interest (ROI). Under the spatial constraints of the point cloud within the ROI, the detection and localization results of abandoned objects on the road in three-dimensional space are obtained through a combination of point cloud clustering and point cloud generation algorithms. The experimental results show that the improved YOLOv7-OD network achieves recall and average precision rates of 85.4% and 82.0%, respectively, for medium-sized objects, representing an improvement of 6.6% and 8.0% compared to the YOLOv7. The recall and average precision rates for small-sized objects are 66.8% and 57.3%, respectively, with an increase of 5.3%. Regarding localization, for targets located 30-40 m away from the detecting vehicle, the depth localization error is 0.19 m, and the angular localization error is 0.082°, enabling the detection and localization of multi-scale abandoned objects on the road.
    Huaiyu Cai, Zhaoqian Yang, Ziyang Cui, Yi Wang, Xiaodong Chen. Image-guided and point cloud space-constrained method for detection and localization of abandoned objects on the road[J]. Opto-Electronic Engineering, 2024, 51(3): 230317-1
    Download Citation