Visual Guidance Algorithm for AUV Recovery Based on CNN Object Tracking

HAN Ze-kai; ZHU Xing-hua; HAN Xiao-jun; SUN Kai; LIU Xiao-yu

doi:10.11993/j.issn.2096-3920.2022-0031

Volume 30 Issue 6

Dec 2022

Turn off MathJax

Article Contents

Article Navigation > Journal of Unmanned Undersea Systems > 2022 > 30(6): 801-808

HAN Ze-kai, ZHU Xing-hua, HAN Xiao-jun, SUN Kai, LIU Xiao-yu. Visual Guidance Algorithm for AUV Recovery Based on CNN Object Tracking[J]. Journal of Unmanned Undersea Systems, 2022, 30(6): 801-808. doi: 10.11993/j.issn.2096-3920.2022-0031

Citation:

HAN Ze-kai, ZHU Xing-hua, HAN Xiao-jun, SUN Kai, LIU Xiao-yu. Visual Guidance Algorithm for AUV Recovery Based on CNN Object Tracking[J]. Journal of Unmanned Undersea Systems, 2022, 30(6): 801-808. doi: 10.11993/j.issn.2096-3920.2022-0031

Citation:

PDF( 5491 KB)

Visual Guidance Algorithm for AUV Recovery Based on CNN Object Tracking

doi: 10.11993/j.issn.2096-3920.2022-0031

HAN Ze-kai^{1, 2, 3},
ZHU Xing-hua^{1, 2},
HAN Xiao-jun^{1, 2},
SUN Kai^{1, 2},
LIU Xiao-yu^{1, 2}

1.
State Key Laboratory of Robotics, Shenyang Institute of Automation, Chinese Academy of Sciences, Shenyang 110016, China
2.
Institutes for Robotics and Intelligent Manufacturing, Chinese Academy of Sciences, Shenyang 110169, China
3.
University of Chinese Academy of Sciences, Beijing 100049, China

Received Date: 2022-08-01
Rev Recd Date: 2022-11-30

Abstract

Abstract

The development of autonomous undersea vehicle recovery technology is the main approach to solve problems pertaining to energy and information transmission and to enhance the underwater detection and concealment capabilities of unmanned systems. In this study, an underwater visual guidance scheme is designed for recovery with funnel-shaped docking stations in an actual environment. Additionally, an improved detect-by-tracking algorithm based on a convolutional neural network(CNN) is proposed. First, the CNN is trained using a docking station dataset to detect the target. Next, the improved tracking algorithm is combined with the position and attitude spatial information to achieve robust tracking. Finally, based on an improved PnP-P3P position and attitude estimation framework, the problem of insufficient observable beacons under a large offset is solved, and the underwater visual guidance workspace is effectively expanded. The beacon array design and algorithm are validated via workspace simulation, and relevant effective workspace indexes are proposed. An optical guidance experiment is performed in a pool, and acousto–optic joint guidance is performed based on an ultrashort baseline in an actual lake test. The feasibility of the proposed framework for engineering is confirmed by the results obtained.
- autonomous undersea vehicle,
- underwater recovery,
- visual guidance,
- convolutional neural network,
- position and attitude estimation

FullText(HTML)

References(15)

References

[1]	潘光, 宋保维, 黄桥高, 等. 水下无人系统发展现状及其关键技术[J]. 水下无人系统学报, 2017, 25(2): 44-51. Pan Guang, Song Bao-wei, Huang Qiao-gao, et al. Development and Key Techniques of Unmanned Undersea System[J]. Journal of Unmanned Undersea Systems, 2017, 25(2): 44-51.
[2]	Li Y, Jiang Y Q, Cui J, et al. AUV Docking Experiments Based on Vision Positioning Using Two Cameras[J]. Ocean Engineering, 2015, 110(1): 163-173.
[3]	Park J Y, Jun B H, Lee P M, et al. Experiments on Vision Guided Docking of an Autonomous Underwater Vehicle Using One Camera[J]. Ocean Engineering, 2009, 36(1): 48-61. doi: 10.1016/j.oceaneng.2008.10.001
[4]	Palomeras N, Vallicrosa G, Mallios A, et al. AUV Homing and Docking for Remote Operations[J]. Ocean Engineering, 2018, 154(15): 106-120.
[5]	Liu S, Ozay M, Okatani T, et al. Detection and Pose Estimation for Short-range Vision-based Underwater Docking[J]. IEEE Access, 2018, 7: 2720-2749.
[6]	Lin M, Lin R, Yang C, et al. Docking to an Underwater Suspended Charging Station: Systematic Design and Experimental Tests[J]. Ocean Engineering, 2022, 249: 110766. doi: 10.1016/j.oceaneng.2022.110766
[7]	张伟, 潘珺, 宫鹏, 等. 面向UUV回收过程的单目视觉导引灯阵跟踪方法[J]. 水下无人系统学报, 2021, 29(4): 435-441.
[8]	Li C, Quo J, Pang Y, et al. Single Underwater Image Restoration by Blue-green Channels Dehazing and Red Channel Correction[C]//2016 IEEE International Conference on Acoustics, Speech and Signal Processing(ICASSP). Shanghai: IEEE, 2016.
[9]	Pedersen M, Bruslund Haurum J, et al. Detection of Marine Animals in a New Underwater Dataset with Varying Visibility[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. Long Beach, CA, USA: IEEE, 2019: 18-26.
[10]	Lei F, Tang F, Li S. Underwater Target Detection Algorithm Based on Improved YOLOv5[J]. Journal of Marine Science and Engineering, 2022, 10(3): 310. doi: 10.3390/jmse10030310
[11]	Liu S, Xu H, Lin Y, et al. Visual Navigation for Recovering an AUV by Another AUV in Shallow Water[J]. SENSORS, 2019, 19(8): 1-19. doi: 10.1109/JSEN.2019.2897393
[12]	Wojke N, Bewley A, Paulus D. Simple Online and Realtime Tracking with a Deep Association Metric[J]. IEEE, 2017: 3645-3649.
[13]	Lepetit V, Moreno-Noguer F, Fua P. Epnp: An Accurate o (n) Solution to the PnP Problem[J]. International Journal of Computer vision, 2009, 81(2): 155-166. doi: 10.1007/s11263-008-0152-6
[14]	Li S, Xu C, Xie M. A Robust O(n) Solution to the Perspective-n-point Problem[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2012, 34(7): 1444-1450. doi: 10.1109/TPAMI.2012.41
[15]	Han B, Sun Y, Li M, et al. Influence of a Watertight Optical Window with Plain Glass on the Light Distribution of an LED Transmitter for Underwater Wireless Optical Communications[J]. Applied Optics, 2022, 61(13): 3720-3728. doi: 10.1364/AO.454809