A Review of Binocular-Vision Obstacle AvoidanceTechnology for Rotorcraft UAVs

LYU Dongchao; LI Shaobo; PU Ruiqiang; ZHANG Qianfu; CHEN Guanglin; KUANG Huacong

doi:10.3969/j.issn.1671-637x.2023.11.011

[1] MAO X P, XIANG B, LIU Z, et al.Simulation analysis and experimental research on the safety distance of UAV inspection on transmission lines［J］.AIP Advances, 2022, 12(2):025009.

[2] KIM H J, HYUN-KWON N, HWAN K T.Discriminant analysis to detect fire blight infection on pear trees using RGB imagery obtained by a rotary wing drone［J］.Korean Journal of Agricultural Science, 2020, 47(2):349-360.

[5] ZHANG M Y, CAI W Y, XIE Q A, et al.Binocular-vision-based obstacle avoidance design and experiments verification for underwater quadrocopter vehicle［J］.Journal of Marine Science and Engineering, 2022, 10(8):1050-1063.

[6] FU Z J, ZHI Y Y, JI S L, et al.Remote attacks on drones vision sensors:an empirical study［J］.IEEE Transactions on Dependable and Secure Computing, 2022, 19(5):3125-3135.

[7] MARSHALL J A, SUN W, L, AFFLITTO A.A survey of guidance, navigation, and control systems for autonomous multi-rotor small unmanned aerial systems［J］.Annual Reviews in Control, 2021, 52:390-427.

[8] WANG L L, LAN Y B, ZHANG Y L, et al.Applications and prospects of agricultural unmanned aerial vehicle obstacle avoidance technology in China［J］.Sensors, 2019, 19(3):642-656.

[10] DONG Q C, WANG L, FENG J Q.Confidence-based camera calibration with modified census transform［J］.Multimedia Tools and Applications, 2020, 79(31):23093-23109.

[12] WANG L, KANG S B, SHUM H Y, et al.Error analysis of pure rotation-based self-calibration［J］.IEEE Transactions on Pattern Analysis and Machine Intelligence, 2004, 26(2):275-280.

[14] MA X, ZHANG Z C, WANG D F, et al.Adaptive deconvolution-based stereo matching net for local stereo matching［J］.Applied Sciences, 2022, 12(4):2086-2099.

[15] KERKAOU Z, ANSARI M E, MASMOUDI L, et al.Dense spatio-temporal stereo matching for intelligent driving systems［J］.IET Image Processing, 2021, 15(3):715-723.

[16] YOON K J, KWEON I S.Locally adaptive support-weight approach for visual correspondence search［C］//IEEE Computer Society Conference on Computer Vision and Pattern Recognition(CVPR05).San Diego:IEEE, 2005: 924-931.

[17] LING Y H, HE T, MENG H T, et al.Hardware accelerator for an accurate local stereo matching algorithm using binary neural network［J］.Journal of Systems Architecture, 2021, 117:102110.

[18] CHEN S T, ZHANG J L, JIN M.A simplified ICA-based local similarity stereo matching［J］.The Visual Computer, 2021, 37(2):411-419.

[19] KOK K Y, RAJENDRAN P.A local multi-block with various constraints approach for stereo vision in StereoPi［J］.Measurement, 2022, 200:111617.

[20] HU H C, LI B Y, YANG W Y, et al.A novel multispectral line segment matching method based on phase congruency and multiple local homographies［J］.Remote Sensing, 2022, 14(16):3857-3871.

[21] QI J Y, LIU L.The stereo matching algorithm based on an improved adaptive support window［J］.IET Image Processing, 2022, 16(10):2803-2816.

[22] ZHANG Z H, WANG Y Q, HUANG T, et al.A weighting algorithm based on the gravitational model for local stereo matching［J］.Signal, Image and Video Processing, 2020, 14(2):315-323.

[23] HUANG C S, HUANG Y H, CHAN D Y, et al.Shape-reserved stereo matching with segment-based cost aggregation and dual-path refinement［J］.Journal on Image and Video Processing, 2020, 38(1):1-19.

[24] HUANG X, WAN X, PENG D F.Robust feature matching with spatial smoothness constraints［J］.Remote Sensing, 2020, 12(19):3158-3165.

[26] CHONG A X, YIN H, LIU Y T, et al.Multi-hierarchy feature extraction and multi-step cost aggregation for stereo matching［J］.Neurocomputing, 2022, 492:601-611.

[27] HUANG Y, DA F P.Three-dimensional face point cloud hole-filling algorithm based on binocular stereo matching and a B-spline［J］.Frontiers of Information Technology & Electronic Engineering, 2022, 23(3):398-408.

[28] HU P Y, YANG S M, ZHANG G F, et al.High-speed and accurate 3D shape measurement using DIC-assisted phase matching and triple-scanning［J］.Optics and Lasers in Engineering, 2021, 147:106725.

[29] WONG A, FIEGUTH P.Fast phase-based registration of multimodal image data［J］.Signal Processing, 2009, 89(5):724-737.

[30] ZHANG K, LU J B, LAFRUIT G.Cross-based local stereo matching using orthogonal integral images［J］.IEEE Transactions on Circuits and Systems for Video Technology, 2009, 19(7):1073-1079.

[31] LU Z M, WANG J, LI Z W, et al.A resource-efficient pipelined architecture for real-time semi-global stereo matching［J］.IEEE Transactions on Circuits and Systems for Video Technology, 2022, 32(2):660-673.

[32] KARIMI H, DOLATI A, LAYEGHI K.Stereo matching by using a new local descriptor based on sign and order in belief propagation algorithm［J］.Displays, 2022, 75:102300.

[33] KERKAOU Z, ANSARI M E.Support vector machines based stereo matching method for advanced driver assistance systems［J］.Multimedia Tools and Applications, 2020, 79(37):27039-27055.

[34] WU X, LIAN H, BAO X W, et al.Using enhanced reordered census transform for semiglobal stereo matching algorithm［J］.Mobile Information Systems, 2022, 2022:4685700.

[35] PENG Z Y, WU L, XIAO B.High-speed dense matching algorithm for high-resolution aerial image based on CPU-FPGA［J］.The Visual Computer, 2022, 38(9):2658-2671.

[36] LI H, CONG R M, KWONG S, et al.Stereo superpixel:an iterative framework based on parallax consistency and collaborative optimization［J］.Information Sciences, 2021, 556:209-222.

[37] LI Z H, LIU J X, YANG Y, et al.A disparity refinement algorithm for satellite remote sensing images based on mean-shift plane segmentation［J］.Remote Sensing, 2021, 13(10):1903-1915.

[39] KIM S N, KIM S Y, MIN D B, et al.Stereo confidence estimation via locally adaptive fusion and knowledge distillation［J］.IEEE Transactions on Pattern Analysis and Machine Intelligence, 2022, 45(5):6372-6385.

[40] POGGI M, AGRESTI G, TOSI F, et al.Confidence estimation for ToF and stereo sensors and its application to depth data fusion［J］.IEEE Sensors Journal, 2020, 20(3):1411-1421.

[41] XU C L, DU Z J, YAN Z P, et al.Stereo-IA:stereo visual intensity alignment and beyond under radiation variation［J］.Optics Express, 2022, 30(7):11424-11443.

[42] AHMED S, QIU B, AHMAD F, et al.A state-of-the-art analysis of obstacle avoidance methods from the perspective of an agricultural sprayer UAVs operation scenario［J］.Agronomy-Basel, 2021, 11(6):1069-1082.

[43] MARIN-PLAZA P, HUSSEIN A, MARTIN D, et al.Global and local path planning study in a ROS-based research platform for autonomous vehicles［J］.Journal of Advanced Transportation, 2018, 2018:6392697.

[44] LIU H, LI X M, FAN M F, et al.An autonomous path planning method for unmanned aerial vehicle based on a tangent intersection and target guidance strategy［J］.IEEE Transactions on Intelligent Transportation Systems, 2022, 23(4):3061-3073.

[45] ZHANG J, SHENG H, CHEN Q, et al.A four-dimensional space-time automatic obstacle avoidance trajectory planning method for multi-UAV cooperative formation flight［J］.Drones, 2022, 6(8):192-205.

[46] MA L, ZHANG H T, MENG S J, et al.Volcanic ash region path planning based on improved A-star algorithm［J］.Journal of Advanced Transportation, 2022, 2022:9938975.

[47] HE Z B, LIU C G, CHU X M, et al.Dynamic anti-collision A-star algorithm for multi-ship encounter situations［J］.Applied Ocean Research, 2022, 118:102995.

[48] ZHANG J, WU J, SHEN X H, et al.Autonomous land vehicle path planning algorithm based on improved heuristic function of A-star［J］.International Journal of Advanced Robotic Systems, 2021, 18(5):730-740.

[49] LI J, LI C Y, CHEN T, et al.Improved RRT algorithm for AUV target search in unknown 3D environment［J］.Journal of Marine Science and Engineering, 2022, 10(6):826-837.

[50] WANG D, ZHENG S T, REN Y X, et al.Path planning based on the improved RRT algorithm for the mining truck［J］.Computers, Materials & Continua, 2022, 71(2):3571-3587.

[51] PARK J K, MYOUNG C T A I.Boundary-RRT* algorithm for drone collision avoidance and interleaved path re-planning［J］.Journal of Information Processing Systems, 2020, 16(6):1324-1342.

[52] CHU H Y, YI J K, YANG F.Chaos particle swarm optimization enhancement algorithm for UAV safe path planning［J］.Applied Sciences, 2022, 12:8977-1-8977-23.

[53] TIAN S S, LI Y X, KANG Y L, et al.Multi-robot path planning in wireless sensor networks based on jump mechanism PSO and safety gap obstacle avoidance［J］.Future Generation Computer Systems, 2021, 118:37-47.

[54] HE W J, QI X G, LIU L F.A novel hybrid particle swarm optimization for multi-UAV cooperate path planning［J］.Applied Intelligence, 2021, 51(10):7350-7364.

[55] DAI J Y, QIU J, YU H C, et al.Robot static path planning method based on deterministic annealing［J］.Machines, 2022, 10(8):600-615.

[56] SIVARANJANI A, VINOD B.Artificial potential field incorporated deep-Q-network algorithm for mobile robot path prediction［J］.Intelligent Automation and Soft Computing, 2023, 35(1):1135-1150.

[57] WANG N, DAI J Y, YING J.UAV formation obstacle avoidance control algorithm based on improved artificial potential field and consensus［J］.International Journal of Aeronautical and Space Sciences, 2021, 22(6):1413-1427.

[58] JIN X Z, ER M J.Cooperative path planning with priority target assignment and collision avoidance guidance for rescue unmanned surface vehicles in a complex ocean environment［J］.Advanced Engineering Informatics, 2022, 52:101517.

[61] MOON J, LEE B Y, TAHK M J.A hybrid dynamic window approach for collision avoidance of VTOL UAVs［J］.International Journal of Aeronautical and Space Sciences, 2018, 19(4):889-903.

[62] HOSSAIN T, HABIBULLAH H, ISLAM R, et al.Local path planning for autonomous mobile robots by integrating modified dynamic-window approach and improved follow the gap method［J］.Journal of Field Robotics, 2022, 39(4):371-386.

CLP Journals