Visual Guidance Algorithm for AUV Recovery Based on CNN Object Tracking

HAN Ze-kai; ZHU Xing-hua; HAN Xiao-jun; SUN Kai; LIU Xiao-yu

doi:10.11993/j.issn.2096-3920.2022-0031

Volume 30 Issue 6

Dec 2022

Turn off MathJax

Article Contents

Abstract

References

Article Navigation > Journal of Unmanned Undersea Systems > 2022 > 30(6): 801-808

HAN Ze-kai, ZHU Xing-hua, HAN Xiao-jun, SUN Kai, LIU Xiao-yu. Visual Guidance Algorithm for AUV Recovery Based on CNN Object Tracking[J]. Journal of Unmanned Undersea Systems, 2022, 30(6): 801-808. doi: 10.11993/j.issn.2096-3920.2022-0031

Citation:

HAN Ze-kai, ZHU Xing-hua, HAN Xiao-jun, SUN Kai, LIU Xiao-yu. Visual Guidance Algorithm for AUV Recovery Based on CNN Object Tracking[J]. Journal of Unmanned Undersea Systems, 2022, 30(6): 801-808. doi: 10.11993/j.issn.2096-3920.2022-0031

Citation:

PDF( 5491 KB)

Visual Guidance Algorithm for AUV Recovery Based on CNN Object Tracking

doi: 10.11993/j.issn.2096-3920.2022-0031

HAN Ze-kai^{1, 2, 3},
ZHU Xing-hua^{1, 2},
HAN Xiao-jun^{1, 2},
SUN Kai^{1, 2},
LIU Xiao-yu^{1, 2}

1.
State Key Laboratory of Robotics, Shenyang Institute of Automation, Chinese Academy of Sciences, Shenyang 110016, China
2.
Institutes for Robotics and Intelligent Manufacturing, Chinese Academy of Sciences, Shenyang 110169, China
3.
University of Chinese Academy of Sciences, Beijing 100049, China

Received Date: 2022-08-01
Rev Recd Date: 2022-11-30

Abstract

Abstract

The development of autonomous undersea vehicle recovery technology is the main approach to solve problems pertaining to energy and information transmission and to enhance the underwater detection and concealment capabilities of unmanned systems. In this study, an underwater visual guidance scheme is designed for recovery with funnel-shaped docking stations in an actual environment. Additionally, an improved detect-by-tracking algorithm based on a convolutional neural network(CNN) is proposed. First, the CNN is trained using a docking station dataset to detect the target. Next, the improved tracking algorithm is combined with the position and attitude spatial information to achieve robust tracking. Finally, based on an improved PnP-P3P position and attitude estimation framework, the problem of insufficient observable beacons under a large offset is solved, and the underwater visual guidance workspace is effectively expanded. The beacon array design and algorithm are validated via workspace simulation, and relevant effective workspace indexes are proposed. An optical guidance experiment is performed in a pool, and acousto–optic joint guidance is performed based on an ultrashort baseline in an actual lake test. The feasibility of the proposed framework for engineering is confirmed by the results obtained.
- autonomous undersea vehicle,
- underwater recovery,
- visual guidance,
- convolutional neural network,
- position and attitude estimation

FullText(HTML)

References(15)

References

[1]	潘光, 宋保维, 黄桥高, 等. 水下无人系统发展现状及其关键技术[J]. 水下无人系统学报, 2017, 25(2): 44-51. Pan Guang, Song Bao-wei, Huang Qiao-gao, et al. Development and Key Techniques of Unmanned Undersea System[J]. Journal of Unmanned Undersea Systems, 2017, 25(2): 44-51.
[2]	Li Y, Jiang Y Q, Cui J, et al. AUV Docking Experiments Based on Vision Positioning Using Two Cameras[J]. Ocean Engineering, 2015, 110(1): 163-173.
[3]	Park J Y, Jun B H, Lee P M, et al. Experiments on Vision Guided Docking of an Autonomous Underwater Vehicle Using One Camera[J]. Ocean Engineering, 2009, 36(1): 48-61. doi: 10.1016/j.oceaneng.2008.10.001
[4]	Palomeras N, Vallicrosa G, Mallios A, et al. AUV Homing and Docking for Remote Operations[J]. Ocean Engineering, 2018, 154(15): 106-120.
[5]	Liu S, Ozay M, Okatani T, et al. Detection and Pose Estimation for Short-range Vision-based Underwater Docking[J]. IEEE Access, 2018, 7: 2720-2749.
[6]	Lin M, Lin R, Yang C, et al. Docking to an Underwater Suspended Charging Station: Systematic Design and Experimental Tests[J]. Ocean Engineering, 2022, 249: 110766. doi: 10.1016/j.oceaneng.2022.110766
[7]	张伟, 潘珺, 宫鹏, 等. 面向UUV回收过程的单目视觉导引灯阵跟踪方法[J]. 水下无人系统学报, 2021, 29(4): 435-441.
[8]	Li C, Quo J, Pang Y, et al. Single Underwater Image Restoration by Blue-green Channels Dehazing and Red Channel Correction[C]//2016 IEEE International Conference on Acoustics, Speech and Signal Processing(ICASSP). Shanghai: IEEE, 2016.
[9]	Pedersen M, Bruslund Haurum J, et al. Detection of Marine Animals in a New Underwater Dataset with Varying Visibility[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. Long Beach, CA, USA: IEEE, 2019: 18-26.
[10]	Lei F, Tang F, Li S. Underwater Target Detection Algorithm Based on Improved YOLOv5[J]. Journal of Marine Science and Engineering, 2022, 10(3): 310. doi: 10.3390/jmse10030310
[11]	Liu S, Xu H, Lin Y, et al. Visual Navigation for Recovering an AUV by Another AUV in Shallow Water[J]. SENSORS, 2019, 19(8): 1-19. doi: 10.1109/JSEN.2019.2897393
[12]	Wojke N, Bewley A, Paulus D. Simple Online and Realtime Tracking with a Deep Association Metric[J]. IEEE, 2017: 3645-3649.
[13]	Lepetit V, Moreno-Noguer F, Fua P. Epnp: An Accurate o (n) Solution to the PnP Problem[J]. International Journal of Computer vision, 2009, 81(2): 155-166. doi: 10.1007/s11263-008-0152-6
[14]	Li S, Xu C, Xie M. A Robust O(n) Solution to the Perspective-n-point Problem[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2012, 34(7): 1444-1450. doi: 10.1109/TPAMI.2012.41
[15]	Han B, Sun Y, Li M, et al. Influence of a Watertight Optical Window with Plain Glass on the Light Distribution of an LED Transmitter for Underwater Wireless Optical Communications[J]. Applied Optics, 2022, 61(13): 3720-3728. doi: 10.1364/AO.454809

Relative Articles

[1]	LIANG Yinian, LI Jie, CHEN Fangjiong, JI Fei, YU Hua. A Direction of Arrival Estimation Algorithm for Underwater Distributed Source based on Deep Neural Network[J]. Journal of Unmanned Undersea Systems. doi: 10.11993/j.issn.2096-3920.2024-0178
[2]	LI Rongchang, BAI Huajun, ZHANG Jingxi, ZHANG Yi. Fuzzy Model Based Sliding Mode Control for AUVs[J]. Journal of Unmanned Undersea Systems. doi: 10.11993/j.issn.2096-3920.2024-0149
[3]	GAO Jian, HE Yaozhen, CHEN Yimin, ZHANG Yuanxu, YANG Xubo, LI Yufeng, ZHANG Zhenchi. Review of Visual Control Technology for Undersea Vehicles[J]. Journal of Unmanned Undersea Systems, 2024, 32(2): 282-294. doi: 10.11993/j.issn.2096-3920.2023-0061
[4]	YANG Changsheng, GOU Wenbo, LIANG Hong. Ship Wake Detection Based on One-Dimensional Convolutional Neural Network[J]. Journal of Unmanned Undersea Systems, 2023, 31(6): 839-846. doi: 10.11993/j.issn.2096-3920.2022-0052
[5]	YAN Jing, CHEN Tian-ming, GUAN Xin-ping, YANG Xian, LUO Xiao-yuan. Autonomous Undersea Vehicle Cooperative Control: Current Research Status and Development Trends[J]. Journal of Unmanned Undersea Systems, 2023, 31(1): 108-120. doi: 10.11993/j.issn.2096-3920.2022-0096
[6]	AN Ping, WANG Tingting, ZHAO Yuan, HU Ning. Underwater Visual Guidance Deep Learning Detection Method for AUV[J]. Journal of Unmanned Undersea Systems, 2023, 31(3): 421-429. doi: 10.11993/j.issn.2096-3920.202205006
[7]	GUO Ke-jian, LIN Xiao-bo, HAO Cheng-peng, HOU Chao-huan. Reinforcement-Learning Control for the High-Speed AUV Based on the Neural-Network State Estimator[J]. Journal of Unmanned Undersea Systems, 2022, 30(2): 147-156. doi: 10.11993/j.issn.2096-3920.2022.02.002
[8]	SUN Yuan, WANG Guang-ping, LI Chun-yu, WANG Xue-feng. Research on the Establishment Time of Underwater Inflatable Positive Buoyancy for Vehicle[J]. Journal of Unmanned Undersea Systems, 2022, 30(4): 514-518. doi: 10.11993/j.issn.2096-3920.202106010
[9]	ZHU Zhi-peng, ZHU Zhi-yu. Method for Detecting and Ranging an Underwater Guided Light Source Based on Binocular Vision[J]. Journal of Unmanned Undersea Systems, 2021, 29(1): 065-73. doi: 10.11993/j.issn.2096-3920.2021.01.010
[10]	SHI Yue, LI Cheng, HAO Kun. Underwater Wireless Sensor Network MAC Protocol Based on Dynamical Change Contention Window[J]. Journal of Unmanned Undersea Systems, 2020, 28(2): 174-181. doi: 10.11993/j.issn.2096-3920.2020.02.009
[11]	ZHU Zhao-tong, FU Xue-zhi, HU You-feng. A Sonar Image Recognition Method Based on Convolutional Neural Network Trained through Transfer Learning[J]. Journal of Unmanned Undersea Systems, 2020, 28(1): 089-96. doi: 10.11993/j.issn.2096-3920.2020.01.013
[12]	LI Xin, HUANG Ru-nan, DING Ning. Adaptive Backstepping Control of Autonomous Undersea Vehicle with Input Limitation[J]. Journal of Unmanned Undersea Systems, 2019, 27(6): 624-628. doi: 10.11993/j.issn.2096-3920.2019.06.004
[13]	HUANG Yu-long, ZHANG Yong-gang, ZHAO Yu-xin. Review of Autonomous Undersea Vehicle Navigation Methods[J]. Journal of Unmanned Undersea Systems, 2019, 27(3): 232-253. doi: 10.11993/j.issn.2096-3920.2019.03.002
[14]	QI Bei-bei, YAN Wei-sheng, GAO Jian. 3D Docking Guidance Algorithm Based on Dipole Field for a Moving Dock Station[J]. Journal of Unmanned Undersea Systems, 2018, 26(3): 221-227. doi: 10.11993/j.issn.2096-3920.2018.03.006
[15]	XUE Yuan, YAN Wei-sheng, GAO Jian, SHI Shu-wei. A Path Planning Method Based on Artificial Vector Field for Autonomous Recovery of AUV[J]. Journal of Unmanned Undersea Systems, 2011, 19(2): 104-108. doi: 10.11993/j.issn.1673-1948.2011.02.006
[16]	FAN Xin, ZHANG Fu-bin, LI X iao-hui. Design and Simulation of a Trajectory Generator for Autonomous Underwater Vehicle[J]. Journal of Unmanned Undersea Systems, 2010, 18(3): 214-217. doi: 10.11993/j.issn.1673-1948.2010.03.011
[17]	WANG Xiao-feng. New Application of Federated Filter in INS/GPS/DVL Integrated Navigation System for AUV[J]. Journal of Unmanned Undersea Systems, 2010, 18(4): 287-290. doi: 10.11993/j.issn.1673-1948.2010.04.011
[18]	MA Wen-Jie, YAN Wei-sheng, GUI Zhi-Hui. Obstacle Avoidance for AUV in Virtual Environment[J]. Journal of Unmanned Undersea Systems, 2008, 16(2): 021-24. doi: 10.11993/j.issn.1673-1948.2008.02.006
[19]	LU Shu-juan, YAO Yao, LI Hui-ping. Design and Implementation of Integrated Navigation Simulation System for Autonomous Underwater Vehicle[J]. Journal of Unmanned Undersea Systems, 2007, 15(5): 029-32. doi: 10.11993/j.issn.1673-1948.2007.05.008
[20]	YAN Wei-sheng, ZHANG Fu-bin, GAO Jian. Lateral Sliding Mode Control of a New Type Long Distance Autonomous Underwater Vehicle[J]. Journal of Unmanned Undersea Systems, 2007, 15(3): 019-21. doi: 10.11993/j.issn.1673-1948.2007.03.004

Supplements(0)

Cited By

Cited by

Periodical cited type(3)

1.	高剑，何耀祯，陈依民，张元旭，杨旭博，李宇丰，张桢驰. 水下航行器视觉控制技术综述. 水下无人系统学报. 2024(02): 282-294 . 本站查看
2.	王嘉，关夏威，付少波，马哲松. 基于先验信息的光照鲁棒性水下视觉定位方法. 舰船科学技术. 2024(10): 98-101 .
3.	王微，郁强，王五桂，邢博闻. YOLOv7-F:一种轻量级船舶实时检测算法. 兵器装备工程学报. 2024(11): 11-18 .

Other cited types(1)

Proportional views

Proportional views

通讯作者: 陈斌, bchen63@163.com

1.
沈阳化工大学材料科学与工程学院沈阳 110142

Figures(14) / Tables(5)

Get Citation

PDF

XML

Article Metrics

Article Views(420) PDF Downloads(51)