• Laser & Optoelectronics Progress
  • Vol. 60, Issue 2, 0228011 (2023)
Lu Xiong, Zhenwen Deng, Wei Tian*, and Zhiang Wang
Author Affiliations
  • School of Automotive Studies, Tongji University, Shanghai 201804, China
  • show less
    DOI: 10.3788/LOP220712 Cite this Article Set citation alerts
    Lu Xiong, Zhenwen Deng, Wei Tian, Zhiang Wang. Three-Dimensional Pedestrian Detection by Fusing Image Semantics and Point Cloud Spatial Visibility Features[J]. Laser & Optoelectronics Progress, 2023, 60(2): 0228011 Copy Citation Text show less

    Abstract

    Vehicular light detection and ranging (LiDAR) has become a standard sensor in automotive by offering accurate geometric information of the surrounding region for intelligent driving vehicles. In order to overcome the limited performance of a single sensor for object detection, the geometric and spatial visibility features of LiDAR point clouds are fused with image semantic information in a network framework to achieve accurate three dimensional (3D) pedestrian detection. First, an effective 3D ray-casting algorithm is introduced to produce spatial visibility feature encodings. Second, the image semantic information is incorporated to improve point cloud features. Finally, the impact of added information and related hyperparameters on detection findings are quantitatively and qualitatively examined. Experimental findings demonstrate that compared with the single frame point cloud, the 3D pedestrian detection accuracy is enhanced by 32.63 percentage points after aggregating the last 10 frames of the point cloud in history. By further fusing image semantics and point cloud spatial visibility information, the proposed method's detection accuracy is enhanced by 2.42 percentage points compared with the benchmark approach, and exceeds some standard approaches. Our enhanced approach is more suitable for 3D pedestrian detection in a traffic environment.
    Lu Xiong, Zhenwen Deng, Wei Tian, Zhiang Wang. Three-Dimensional Pedestrian Detection by Fusing Image Semantics and Point Cloud Spatial Visibility Features[J]. Laser & Optoelectronics Progress, 2023, 60(2): 0228011
    Download Citation