• Chinese Optics Letters
  • Vol. 23, Issue 5, 051102 (2025)
Haoran Shen1,2, Puzheng Wang1,2, Ming Lu1,2, Chi Zhang1,2..., Jian Li1,2,** and Qin Wang1,2,*|Show fewer author(s)
Author Affiliations
  • 1Institute of Quantum Information and Technology, Nanjing University of Posts and Telecommunications, Nanjing 210003, China
  • 2Broadband Wireless Communication and Sensor Network Technology, Key Lab of Ministry of Education, Nanjing University of Posts and Telecommunications, Nanjing 210003, China
  • show less
    DOI: 10.3788/COL202523.051102 Cite this Article Set citation alerts
    Haoran Shen, Puzheng Wang, Ming Lu, Chi Zhang, Jian Li, Qin Wang, "Tactile-assisted point cloud super-resolution," Chin. Opt. Lett. 23, 051102 (2025) Copy Citation Text show less

    Abstract

    With the rapid advancement of three-dimensional (3D) scanners and 3D point cloud acquisition technology, the application of 3D point clouds has been increasingly expanding in various fields. However, due to the limitations of 3D sensors, the collected point clouds are often sparse and non-uniform. In this work, we introduce local tactile information into the point cloud super-resolution task to aid in enhancing the resolution of the point cloud using fine-grained local details. Specifically, the local tactile point cloud is denser and more accurate compared to the low-resolution point cloud. By leveraging tactile information, we can obtain better local features. Therefore, we propose a feature extraction module that can efficiently fuse visual information with dense local tactile information. This module leverages the features from both modalities to achieve improved super-resolution results. In addition, we introduce a point cloud super-resolution dataset that includes tactile information. Qualitative and quantitative experiments show that our work performs much better than existing similar works that do not include tactile information, both in terms of handling low-resolution inputs and revealing high-fidelity details.
    Q=f(P,T),

    View in Article

    Fm=MLP[Concat(fti,fi)],

    View in Article

    ff=Deconv[Concat(Fm,fp)].

    View in Article

    C(P,Q)=1|P|pPminqQpq22+1|Q|qQminpPpq22,

    View in Article

    Haoran Shen, Puzheng Wang, Ming Lu, Chi Zhang, Jian Li, Qin Wang, "Tactile-assisted point cloud super-resolution," Chin. Opt. Lett. 23, 051102 (2025)
    Download Citation