融合多尺度旋转锚机制的海洋中尺度涡自动检测
Multi-scale rotating anchor mechanism based automatic detection of ocean mesoscale eddy
- 2022年27卷第10期 页码:3092-3101
收稿:2021-04-30,
修回:2021-6-28,
录用:2021-7-4,
纸质出版:2022-10-16
DOI: 10.11834/jig.210286
移动端阅览

浏览全部资源
扫码关注微信
收稿:2021-04-30,
修回:2021-6-28,
录用:2021-7-4,
纸质出版:2022-10-16
移动端阅览
目的
2
海洋中尺度涡自动检测是了解其演变规律,研究其在海洋物质运输和能量传递中的作用的基础。针对海洋中尺度涡形态不规则、结构复杂多变、长宽比不确定,以及涡群海域中尺度涡分布密集导致的检测精度低的问题,提出一种基于深度学习多尺度旋转锚机制的海洋中尺度涡自动旋转检测方法。
方法
2
首先对卫星遥感海平面高度异常数据进行可视化预处理,并采用图像处理策略对数据集进行扩充构建训练集;其次构建了一种基于深度学习多尺度旋转锚机制的中尺度涡自动检测模型,考虑到中尺度涡尺度变化大和其所处海洋环境复杂多变的特点,主干网络采用RetinaNet提取中尺度涡特征,同时采用特征金字塔结构融合中尺度涡的低层与高层特征,设计多尺度、多长宽比以及多旋转角度锚点机制实现多尺度旋转检测锚的生成;最后集成分类与回归两个子网络,实现海洋中尺度涡的自动旋转检测。
结果
2
实验结果表明,提出的中尺度涡自动检测方法极大改进了水平检测框存在显著的大纵横比导致检测精度低和检测框嵌套和重叠现象。本文方法最优检测精度为90.22%,与水平检测方法相比,精度提升了8%。在印度洋、太平洋、大西洋和赤道海域进行了海洋中尺度涡的旋转检测实证分析,验证了模型具有很好的泛化能力。
结论
2
本文通过设计多尺度、多长宽比和多旋转角度实现多尺度旋转锚的生成机制,达到中尺度涡目标旋转检测,有效克服了水平检测框区域冗余和检测框重叠、嵌套现象,显著提升了中尺度涡检测精度。
Objective
2
Mesoscale eddy analysis is developed in the field of world's oceans and marginal seas. The multi-scale response mechanism and feedback interaction of mesoscale eddy and ocean phenomena has been promoted through mesoscale eddy generation
growth and extinction
the large scale spatial mesoscale eddy is essential to the issues of transport and distribution of global marine contexts of energy
heat and fresh water in terms of the feature of irregular three-dimensional structure and multifaceted dynamics. Therefore
the automatic detection of ocean mesoscale eddy can be used to understand the evolution of ocean mesoscale eddy and the role of ocean mesoscale eddy in material transport and energy transfer. The traditional ocean mesoscale eddy detection methods are mostly adopted based on the physical parameter
flow field geometric feature or both of them. The mesoscale eddies are detected by setting appropriate threshold artificially. The emerging deep learning technology is beneficial to ocean mesoscale eddy detection methods based on deep network model. A classifier is used to classify mesoscale eddy based on manual design and features extraction. The traditional algorithm has good mesoscale eddy detection effect via horizontal bounding box. However
the marine scenario of mesoscale eddy is complicated and ocean mesoscale eddy has the feature of irregular shape
complicated structure and length-width ratio uncertainty and dense distribution. The traditional threshold-dependent detection algorithm has constrained of its rigid and poor generalization ability. The horizontal boundary box methods have redundant horizontal detection region
nested detection box and overlapped issue. Therefore
we propose an automatic detection method of ocean mesoscale eddy based on multi-scale rotating anchor mechanism.
Method
2
We visualize and normalize the satellite remote sensing sea level height anomaly data. The visual dataset is annotated based on ocean mesoscale eddy understanding and global daily ocean eddy satellite altimeter data. To expand small number of accurate expert annotation data sets
we use two-dimensional image processing strategy to construct the training set
such as adding noise and clipping operation. The basic features are derived of the factors of scale and signal noise ratio. We construct an automatic mesoscale eddy detection model based on multi-scale rotating anchor mechanism and one-stage object detection network RetinaNet. In the network structure
ResNet backbone network extract mesoscale eddy feature through introducing residual mapping and jump connection into the network. The feature information of the obtained residual block is added into the following residual block. It avoids the problem of gradient disappearance and deeper feature information loss effectively. At the same time
we use the feature pyramid network structure to integrate the low-level and high-level features of mesoscale eddy. It provides spatial and high-level semantic feature information of complex structure
different scales and more rapid sustainable changes. To cover the multi-oriented mesoscale eddy object with arbitrary shapes
it is generated that multi-scale rotation detection anchors are composed of scale
multi-aspect ratio and multi-rotation angles for each grid point of the output feature map. We integrate the classification and regression subnetworks
in which the classification subnetwork predict the probability of the presence of the object spatially
and the regression subnetwork predict location information via the regression transformation of predictive bounding box and the generated anchor. Finally
non-maximum suppression is used to obtain the final detection result.
Result
2
Thanks to multi-scale rotating anchor mechanism
this experiment shows that our ocean mesoscale eddy automatic detection method can improve the issues of low detection precision
detect box nesting and overlapping via large aspect ratio of ocean mesoscale eddy
the deductible area of horizontal detection. It can detect the existence of multi-core eddy effectively. Furthermore
comparative analysis is conducted in same data set between feature pyramid networks (FPNs)
faster region-convolutional neural networks (Faster R-CNNs) and ours. It shows that the optimal detection accuracy can reach 90.22%
which is 8% higher than the horizontal bounding box detection method
and there is not much difference in speed. Then
we evaluate the accuracy
recall and F1 value amongst the Indian Ocean
Pacific Ocean and Atlantic Ocean. At the same time
the center and scale information of mesoscale eddy can be obtained based on the output position information of the boundary box. Finally
we carried out an empirical analysis of the rotation detection of oceanic mesoscale eddies in the Indian Ocean
Pacific Ocean
Atlantic Ocean and equatorial waters
which illustrates that the model has its potential generalization ability.
Conclusion
2
Our research is focused on detection redundancy
overlapping and nested detection boxes in the horizontal bounding box detection method. We facilitate a deep network model based on a one-stage target detection network RetinaNet and promote the generation mechanism of multi-scaled rotating anchors via multifaceted ratio and multi-rotation
and the integrated classification and regression subnetworks. Non-maximum suppression is used to obtain the final detection results. The features of mesoscale eddy are demonstrated based on irregular shape
complex and variable structure
uncertain ratio and dense distribution
The redundancy
overlap and nesting barriers of the horizontal detection box region are released effectively and the existence of multi-core eddy can be detected. Our method improves detection accuracy and guarantee the detection speed compared to the popular object detection methods in recent three years. We evaluated the experimental effectiveness of data augmentation on the original dataset
the noise-added dataset
and the noise-trimmed dataset. We carry out the accuracy
recall and F1 value analysis based on multiple oceans like the Indian Ocean
Pacific Ocean and Atlantic Ocean
which demonstrates the generalization ability of the model.
Chelton D B, Schlax M G and Samelson R M. 2007. Summertime coupling between sea surface temperature and wind stress in the California current system. Journal of Physical Oceanography, 37(3): 495-517 [DOI: 10.1175/JPO3025.1]
Chen G X, Hou Y J and Chu X Q. 2011. Mesoscale eddies in the South China Sea: mean properties, spatiotemporal variability, and impact on thermohaline structure. Journal of Geophysical Research, 116(C6): #C06018 [DOI: 10.1029/2010JC006716]
Duo Z J, Wang W K and Wang H Z. 2019. Oceanic mesoscale eddy detection method based on deep learning. Remote Sensing, 11(16): #1921 [DOI: 10.3390/rs11161921]
Faghmous J H, Frenger I, Yao Y S, Warmka R, Lindell A and Kumar V. 2015. A daily global mesoscale ocean eddy dataset from satellite altimetry. Scientific Data, 2: #150028 [DOI: 10.1038/sdata.2015.28]
Franz K, Roscher R, Milioto A, Wenzel S and Kusche J. 2018. Ocean eddy identification and tracking using neural networks//IGARSS 2018—2018 IEEE International Geoscience and Remote Sensing Symposium. Valencia, Spain: IEEE: 6887-6890 [ DOI:10.1109/IGARSS.2018.8519261 http://dx.doi.org/10.1109/IGARSS.2018.8519261 ]
He K M, Zhang X Y, Ren S Q and Sun J. 2016. Deep residual learning for image recognition//Proceedings of 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Las Vegas, USA: IEEE: 770-778 [ DOI:10.1109/CVPR.2016.90 http://dx.doi.org/10.1109/CVPR.2016.90 ]
Henson S A and Thomas A C. 2008. A census of oceanic anticyclonic eddies in the Gulf of Alaska. Deep Sea Research Part I: Oceanographic Research Papers, 55(2): 163-176 [DOI: 10.1016/j.dsr.2007.11.005]
Huang D M, Liu J J, Su C and Du Y L. 2019. Ocean eddy recognition based on multi-feature fusion in complex environment. Journal of Image and Graphics, 24(1): 31-38
黄冬梅, 刘佳佳, 苏诚, 杜艳玲. 2019. 多特征融合的复杂环境海洋涡旋识别. 中国图象图形学报, 24(1): 31-38 [DOI: 10.11834/jig.180324]
Isern-Fontanet J, García-Ladona E and Font J. 2003. Identification of marine eddies from altimetric maps. Journal of Atmospheric and Oceanic Technology, 20(5): 772-778
Krizhevsky A, Sutskever I and Hinton G E. 2017. ImageNet classification with deep convolutional neural networks. Communications of the ACM, 60(6): 84-90 [DOI: 10.1145/3065386]
Li L. 2002. A review on mesoscale oceanographical phenomena in the South China Sea. Journal of Oceanography in Taiwan Strait, 21(2): 265-274
李立. 2002. 南海中尺度海洋现象研究概述. 台湾海峡, 21(2): 265-274 [DOI: 10.3969/j.issn.1000-8160.2002.02.021]
Lin T Y, Dollár P, Girshick R, He K M, Hariharan B and Belongie S. 2017. Feature pyramid networks for object detection//Proceedings of 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Honolulu, USA: IEEE: 936-944 [ DOI:10.1109/CVPR.2017.106 http://dx.doi.org/10.1109/CVPR.2017.106 ]
McWilliams J. 1984. The emergence of isolated coherent vortices in turbulent flow. Journal of Fluid Mechanics, 146: 21-43 [DOI: 10.1017/S0022112084001750]
Nencioli F, Dong C M, Dickey T, Washburn L and McWilliams J C. 2010. A Vector geometry-based eddy detection algorithm and its application to a high-resolution numerical model product and high-frequency radar surface velocities in the southern California bight. Journal of Atmospheric and Oceanic Technology, 27(3): 564-579 [DOI: 10.1175/2009JTECHO725.1]
Ōkubo A. 1970. Horizontal dispersion of floatable particles in the vicinity of velocity singularities such as convergences. Deep Sea Research and Oceanographic Abstracts, 17(3): 445-454 [DOI: 10.1016/0011-7471(70)90059-8]
Peckinpaugh S H, Chase J R and Holyer R J. 1993. Neural networks for eddy detection in satellite imagery//Proceedings Volume 1965, Applications of Artificial Neural Networks IV. Orlando, USA: SPIE: 151-161 [ DOI:10.1117/12.152544 http://dx.doi.org/10.1117/12.152544 ]
Penven P, Echevin V, Pasapera J, Colas F and Tam J. 2005. Average circulation, seasonal cycle, and mesoscale dynamics of the Peru current system: a modeling approach. Journal of Geophysical Research: Oceans, 110(C10): #C10021 [DOI: 10.1029/2005JC002945]
Sadarjoen I A and Post F H. 2000. Detection, quantification, and tracking of vortices using streamline geometry. Computers and Graphics, 24(3): 333-341 [DOI: 10.1016/S0097-8493(00)00029-7]
Simonyan K and Zisserman A. 2015. Very deep convolutional networks for large-scale image recognition [EB/OL]. [2021-04-10] . https://arxiv.org/pdf/1409.1556v4.pdf https://arxiv.org/pdf/1409.1556v4.pdf
Szegedy C, Liu W, Jia Y Q, Sermanet P, Reed S, Anguelov D, Erhan D, Vanhoucke V and Rabinovich A. 2015. Going deeper with convolutions//Proceedings of 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Boston, USA: IEEE: 1-9 [ DOI:10.1109/CVPR.2015.7298594 http://dx.doi.org/10.1109/CVPR.2015.7298594 ]
Weiss J. 1991. The dynamics of enstrophy transfer in two-dimensional hydrodynamics. Physica D: Nonlinear Phenomena, 48(2/3): 273-294 [DOI: 10.1016/0167-2789(91)90088-Q]
Yi J, Du Y, He Z and Zhou C. 2014. Enhancing the accuracy of automatic eddy detection and the capability of recognizing the multi-core structures from maps of sea level anomaly. Ocean Science, 10(1): 39-48 [DOI: 10.5194/os-10-39-2014]
Zhang Z G, Wang W and Qiu B. 2014. Oceanic mass transport by mesoscale eddies. Science, 345(6194): 322-324 [DOI: 10.1126/science.1252418]
相关作者
相关机构
京公网安备11010802024621