浏览全部资源
扫码关注微信
纸质出版日期： 2021-08-16 ，
录用日期： 2021-04-29
移动端阅览
付航, 孙根云, 赵云华, 潘兆杰, 胡光, 张爱竹. 多尺度超像素分割和奇异谱分析的高光谱影像分类[J]. 中国图象图形学报, 2021,26(8):1978-1993.
Hang Fu, Genyun Sun, Yunhua Zhao, Zhaojie Pan, Guang Hu, Aizhu Zhang. Combining multiscale superpixel segmentation and singular spectral analysis for hyperspectral image classification[J]. Journal of Image and Graphics, 2021,26(8):1978-1993.
目的
2
高光谱影像（hyperspectral image，HSI）中“同物异谱，异物同谱”的现象普遍存在，使分类结果存在严重的椒盐噪声问题。HSI中的空间地物结构复杂多样，单一尺度的空间特征提取方法无法有效地表达地物类间差异和区分地物边界。有效解决光谱混淆和空间尺度问题是提高分类精度的关键。
方法
2
结合多尺度超像素和奇异谱分析，提出一种新的高光谱影像分类方法，从而充分挖掘地物的局部空间特征和光谱特征，解决空间尺度和光谱混淆的问题，提高分类精度。利用多尺度超像素对影像进行分割，获取不同尺度的分割影像，同时在分割区域内进行均值滤波，减少类内的光谱差异，增强类间的光谱差异；对每个区域计算平均光谱向量，并利用奇异谱分析方法获取光谱的主要鉴别特征，同时消除噪声的影响；利用支持向量机对不同尺度超像素分割影像进行分类，并进行决策融合，得到最终的分类结果。
结果
2
实验选取了两个标准高光谱数据集和一个真实数据集，结果表明，利用本文算法提取的光谱—空间特征进行分类，比直接在原始数据上进行分类分别提高约26.8%、9.2%和13%的精度；与先进的深度学习SSRN（spectral-spatial residual network）算法相比，本文算法在精度上分别提升约5.2%、0.7%和4%，并且运行时间仅为前者的18.3%、45.4%和62.1%，处理效率更高。此外，在训练样本有限的情况下，两个标准数据集的样本分别为1%和0.2%时，本文算法均能取得87%以上的分类精度。
结论
2
针对高光谱影像分类中的难题，提出一种新的融合光谱和多尺度空间特征的HSI分类方法。实验结果表明，本文方法优于对比方法，可以产生更精细的分类结果。
Objective
2
Hyperspectral image (HSI) contains hundreds of spectral bands. The spectral signature of each image pixel acts as a finger print for identification of its material type. Thus
HSI with abundant spectral information is widely used in material recognition and land cover classification. However
the phenomenon of the same objects with dissimilar spectra and the different objects with similar spectra is common in HSI. Specifically
the same ground objects show different spectral curves due to the influence of the surrounding environment
diseases
insect pests
or radioactive substances. Meanwhile
two different features may show the same spectral characteristics in a certain spectral range. As a result
the single spectral information-based classification methods cannot achieve satisfactory ground object discrimination effects. This limitation leads to the salt and pepper noise in the classification maps. Given that HSI is originally 3D cube data
spatial characteristics are complementary to spectral information. The utilization of spatial features
such as shape
texture
and geometrical structures
can improve the land cover discrimination in the pixel-wise classification while reducing the classification noise. However
most spatial methods act on the regular shape or fixed size space area of HSI
which is obviously improper for the complex and diverse land covers. In other words
the region used for spatial feature extraction should adapt to the spatial structure of the image. Moreover
the single-scale feature extraction method in HSI classification cannot effectively express the differences among all land categories and distinguish the boundary of land covers. A multiscale approach appears to be a good solution. We aim to propose an effective classification framework that not only solves the abovementioned problems in HSI but also completes the classification task quickly and efficiently.
Method
2
A novel HSI feature extraction and classification method
which combines multiscale superpixel segmentation and singular spectrum analysis (MSP-SSA)
is proposed in this study. This method can fuse the local spatial and spectral trend features of land objects. Three main steps are involved in the proposed method
namely
multiscale spatial segmentation
spectral feature extraction
and the use of a classifier-based decision fusion strategy. Superpixel segmentation can divide an image into local homogeneous regions with different sizes and shapes to improve the consistency of spatial structure information. However
a single segmentation scale cannot adequately express the land surface and distinguish the boundary of objects. In detail
too large scales lead to over-segmentation of the region. This condition hinders the full utilization of all samples in the homogeneous region. Meanwhile
too small scales lead to under-segmentation
which makes the samples come from multiple homogeneous regions. Therefore
the multiscale superpixel segmentation is performed in the first step to extract abundant spatial features of complex and various land objects. The first principal component image after principal component analysis is the basic image of segmentation to reduce the subsequent computation. A set of segmentation scales is defined on the basis of the number of benchmark superpixels. The mean filter is also used to further improve the spectral pixel similarity inside superpixels considering the inevitable existence of interference pixels
such as noise
inside the superpixel. Then
the singular spectrum analysis (SSA)
named superpixel SSA
acts on each superpixel to extract spectral trend features. After the mean filter
the mean spectral vector is considered to replace the local spatial features of each superpixel. SSA can decompose the mean spectral vector into several sub-components
where each sub-component has the same size as the original vector. Useful information can be enhanced while noise or less representative signals can be effectively suppressed for improving classification accuracy by selecting sub-component(s) to reconstruct the spectral profile. Superpixel SSA acts on the mean spectral vector of each superpixel
and its processing efficiency is mainly affected by the number of superpixels
which significantly reduces the running time compared with the traditional SSA. Finally
a decision fusion strategy based on a classifier is adopted to obtain the final classification results. The support vector machine classifier is utilized to classify the superpixel feature images in different scales due to the robustness of the variation in data dimension. The majority voting decision fusion method is used to obtain the final classification results because of the different scales of the classification results. This method can reduce the probability of pixels being misclassified in a single scale and further improve the classification accuracy.
Result
2
We compare our method MSP-SSA with seven state-of-the-art spectral-spatial classification methods that include traditional approaches and deep learning methods on three public datasets
namely
Indian Pines
Pavia University
and 2018 IEEE GRSS Data Fusion Context(IEEE GRSS DFC 2018). The quantitative evaluation metrics include overall accuracy (OA)
average accuracy (AA)
kappa coefficient
and running time. The classification maps of each method are provided for comparison. The classification results show that MSP-SSA outperforms all other methods on three datasets
and the classification maps show that it can effectively eliminate the noise and preserve the object boundary. Compared with the original data
the features extracted by the proposed MSP-SSA can increase by around 21.9%
8.6%
and 13.5% in terms of OA
nearly 21.6%
10.3%
and 15.9% in terms of AA
and approximately 0.25
0.12
and 0.19 in terms of kappa on Indian Pines (5% samples)
Pavia University (1% samples)
and IEEE GRSS DFC2018 (0.1% samples)
respectively. Compared with the metrics of spectral-spatial residual network (SSRN) on three datasets
the OA of the proposed method increases by 2%
2.3%
and 3.3%
the AA increases by 1.8%
3.9%
and 7.2%
and the kappa increases by 2%
2.3%
and 3.3%. The processing efficiency of our method is also higher than that of SSRN
and the running time is only 18.3%
45.4%
and 62.1% of the latter. Moreover
the proposed method achieves a classification accuracy of over 87% on the Indian Pines and Pavia University datasets with a small number of training samples.
Conclusion
2
We propose an effective and efficient HSI classification method by integrating and combining several effective technologies. This method can fuse spectral and multiscale spatial features. Diverse experimental results also demonstrate that MSP-SSA outperforms several state-of-the-art approaches and can produce refined results in classification maps.
高光谱影像分类超像素奇异谱分析(SSA)决策融合支持向量机(SVM)
hyperspectral image classificationsuperpixelsingular spectrum analysis(SSA)decision fusionsupport vector machines(SVM)
Bachmann C M, Ainsworth T L and Fusina R A. 2006. Improved manifold coordinate representations of large-scale hyperspectral scenes. IEEE Transactions on Geoscience and Remote Sensing, 44(10): 2786-2803[DOI:10.1109/TGRS.2006.881801]
Bandos T V, Bruzzone L and Camps-Valls G. 2009. Classification of hyperspectral images with regularized linear discriminant analysis. IEEE Transactions on Geoscience and Remote Sensing, 47(3): 862-873[DOI:10.1109/TGRS.2008.2005729]
Chang C C and Lin C J. 2011. LIBSVM: a library for support vector machines. ACM Transactions on Intelligent Systems and Technology, 2(3): #27[DOI:10.1145/1961189.1961199]
Cui B G, Wu Y N, Zhong Y, Zhong L W and Lu Y. 2019. Hyperspectral image rolling guidance recursive filtering and classification. Journal of Remote Sensing, 23(3): 431-442
崔宾阁, 吴亚男, 钟勇, 钟利伟, 路燕. 2019. 高光谱图像滚动引导递归滤波与地物分类. 遥感学报, 23(3): 431-442[DOI:10.11834/jrs.20197510]
Duan P H, Kang X D, Li S T and Ghamisi P. 2019. Noise-robust hyperspectral image classification via multi-scale total variation. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 12(6): 1948-1962[DOI:10.1109/JSTARS.2019.2915272]
Fabiyi S D, Vu H, Tachtatzis C, Murray P, Harle D, Dao T K, Andonovic I, Ren J C and Marshall S. 2020. Varietal classification of rice seeds using RGB and hyperspectral images. IEEE Access, 8: 22493-22505[DOI:10.1109/ACCESS.2020.2969847]
Fang L Y, Li S T, Duan W H, Ren J C and Benediktsson J A. 2015. Classification of hyperspectral images by exploiting spectral-spatial information of superpixel via multiple kernels. IEEE Transactions on Geoscience and Remote Sensing, 53(12): 6663-6674[DOI:10.1109/TGRS.2015.2445767]
Fang L Y, Li S T, Nie Q, Izatt J A, Toth C A and Farsiu S. 2012. Sparsity based denoising of spectral domain optical coherence tomography images. Biomedical Optics Express, 3(5): 927-942[DOI:10.1364/BOE.3.000927]
Fauvel M, Benediktsson J A, Chanussot J and Sveinsson J R. 2008. Spectral and spatial classification of hyperspectral data using SVMs and morphological profiles. IEEE Transactions on Geoscience and Remote Sensing, 46(11): 3804-3814[DOI:10.1109/TGRS.2008.922034]
Felzenszwalb P F and Huttenlocher D P. 2004. Efficient graph-based image segmentation. International Journal of Computer Vision, 59(2): 167-181[DOI:10.1023/B:VISI.0000022288.19776.77]
Fu H, Sun G Y, Zabalza J, Zhang A Z, Ren J C and Jia X P. 2020. A novel spectral-spatial singular spectrum analysis technique for near real-time in situ feature extraction in hyperspectral imaging. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 13: 2214-2225[DOI:10.1109/JSTARS.2020.2992230]
Golyandina N and Zhigljavsky A. 2013. Singular Spectrum Analysis for Time Series. Berlin, Germany: Springer: 11-20[DOI: 10.1007/978-3-642-34913-3http://dx.doi.org/10.1007/978-3-642-34913-3]
Hashjin S S, Boloorani A D, Khazai A and Kakroodi A A. 2019. Selecting optimal bands for sub-pixel target detection in hyperspectral images based on implanting synthetic targets. IET Image Processing, 13(2): 323-331[DOI:10.1049/iet-ipr.2018.5324]
He K M, Sun J and Tang X O. 2013. Guided image filtering. IEEE Transactions on Pattern Analysis and Machine Intelligence, 35(6): 1397-1409[DOI:10.1109/TPAMI.2012.213]
Hong D F, Wu X, Ghamisi P, Chanussot J, Yokoya N and Zhu X X. 2020. Invariant attribute profiles: a spatial-frequency joint feature extractor for hyperspectral image classification. IEEE Transactions on Geoscience and Remote Sensing, 58(6): 3791-3808[DOI:10.1109/TGRS.2019.2957251]
Hughes G. 1968. On the mean accuracy of statistical pattern recognizers. IEEE Transactions on Information Theory, 14(1): 55-63[DOI:10.1109/TIT.1968.1054102]
Jia S, Shen L L and Li Q Q. 2015. Gabor feature-based collaborative representation for hyperspectral imagery classification. IEEE Transactions on Geoscience and Remote Sensing, 53(2): 1118-1129[DOI:10.1109/TGRS.2014.2334608]
Jiang J J, Ma J Y, Chen C, Wang Z Y,Cai Z H and Wang L Z. 2018. SuperPCA: a superpixelwise PCA approach for unsupervised feature extraction of hyperspectral imagery. IEEE Transactions on Geoscience and Remote Sensing, 56(8): 4581-4593[DOI:10.1109/TGRS.2018.2828029]
Kang X D, Li S T, Fang L Y and Benediktsson J A. 2015. Intrinsic image decomposition for feature extraction of hyperspectral images. IEEE Transactions on Geoscience and Remote Sensing, 53(4): 2241-2253[DOI:10.1109/tgrs.2014.2358615]
Li C L, Zuo H and Fan T H. 2017. Hyperspectral image classification based on gray level co-occurrence matrix and local mean decomposition//Proceedings of the 4th International Conference on Systems and Informatics (ICSAI). Hangzhou, China: IEEE: 1219-1223[DOI: 10.1109/ICSAI.2017.8248472http://dx.doi.org/10.1109/ICSAI.2017.8248472]
Li S S, Zhang B, Jia XP and Wu H. 2016b. Fusion multiscale superpixel features for classification of hyperspectral images//Proceedings of the 8th Workshop on Hyperspectral Image and Signal Processing: Evolution in Remote Sensing (WHISPERS). Los Angeles, USA: IEEE: 21-24[DOI: 10.1109/WHISPERS.2016.8071751http://dx.doi.org/10.1109/WHISPERS.2016.8071751]
Li S T, Lu T, Fang L Y, Jia X P and Benediktsson J A. 2016a. Probabilistic fusion of pixel-level and superpixel-level hyperspectral image classification. IEEE Transactions on Geoscience and Remote Sensing, 54(12): 7416-7430[DOI:10.1109/TGRS.2016.2603190]
Licciardi G, Marpu P R, Chanussot J and Benediktsson J A. 2012. Linear versus nonlinear PCA for the classification of hyperspectral data based on the extended morphological profiles. IEEE Geoscience and Remote Sensing Letters, 9(3): 447-451[DOI:10.1109/LGRS.2011.2172185]
Liu J J, Wu Z B, Wei Z H, Xiao L and Sun L. 2013. Spatial-spectral kernel sparse representation for hyperspectral image classification. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 6(6): 2462-2471[DOI:10.1109/JSTARS.2013.2252150]
Liu M Y, Tuzel O, Ramalingam S and Chellappa R. 2014. Entropy-rate clustering: cluster analysis via maximizing a submodular function subject to a matroid constraint. IEEE Transactions on Pattern Analysis and Machine Intelligence, 36(1): 99-112[DOI:10.1109/TPAMI.2013.107]
Liu S and Li Q. 2016. Composite kernel support vector regression model for hyperspectral image impervious surface extraction. Journal of Remote Sensing, 20(3): 420-430
刘帅, 李琦. 2016. 组合核支持向量回归提取高光谱影像不透水面. 遥感学报, 20(3): 420-430[DOI:10.11834/jrs.20165239]
Mori G, Ren X F, Efros A A and Malik J. 2004. Recovering human body configurations: combining segmentation and recognition//Proceedings of 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. Washington, USA: IEEE: 326-333[DOI: 10.1109/CVPR.2004.1315182http://dx.doi.org/10.1109/CVPR.2004.1315182]
Moroni M, Lupo E, Marra E and Cenedese A. 2013. Hyperspectral image analysis in environmental monitoring: setup of a new tunable filter platform. Procedia Environmental Sciences, 19: 885-894[DOI:10.1016/j.proenv.2013.06.098]
Nemhauser G L, Wolsey L A and Fisher M L. 1978. An analysis of approximations for maximizing submodular set functions-Ⅰ. Mathematical Programming, 14(1): 265-294[DOI:10.1007/BF01588971]
Peng J T, Zhou Y C and Chen C L P. 2015. Region-kernel-based support vector machines for hyperspectral image classification. IEEE Transactions on Geoscience and Remote Sensing, 53(9): 4810-4824[DOI:10.1109/TGRS.2015.2410991]
Shen L L and Jia S. 2011. Three-dimensional Gabor wavelets for pixel-based hyperspectral imagery classification. IEEE Transactions on Geoscience and Remote Sensing, 49(12): 5039-5046[DOI:10.1109/TGRS.2011.2157166]
Tripathi M K and Govil H. 2019. Evaluation of AVIRIS-NG hyperspectral images for mineral identification and mapping. Heliyon, 5(11): 2405-2440[DOI:10.1016/j.heliyon.2019.e02931]
Veksler O, Boykov Y and Mehrani P. 2010. Superpixels and supervoxels in an energy optimization framework//Proceedings of the 11th European Conference on Computer Vision. Heraklion, Greece: Springer: 211-224[DOI: 10.1007/978-3-642-15555-0_16http://dx.doi.org/10.1007/978-3-642-15555-0_16]
Wang L G, Cao X W, Zheng Y L and Dai Q L. 2018. Multi-scale feature extraction of hyperspectral image with guided filtering. Journal of Remote Sensing, 22(2): 293-303
王雷光, 曹小汪, 郑雅兰, 代沁伶. 2018. 高光谱影像的引导滤波多尺度特征提取. 遥感学报, 22(2): 293-303[DOI:10.11834/jrs.20186439]
Yu H Y, Gao L R, Liao W Z, Zhang B, Pižurica A and Philips W. 2017. Multiscale superpixel-level subspace-based support vector machines for hyperspectral image classification. IEEE Geoscience and Remote Sensing Letters, 14(11): 2142-2146[DOI:10.1109/LGRS.2017.2755061]
Yu W Y, Wang Y H, Liu H W and He J L. 2016. Superpixel-based CFAR target detection for high-resolution SAR images. IEEE Geoscience and Remote Sensing Letters, 13(5): 730-734[DOI:10.1109/LGRS.2016.2540809]
Zabalza J, Ren J C, Wang Z, Marshall S and Wang J. 2014. Singular spectrum analysis for effective feature extraction in hyperspectral imaging. IEEE Geoscience and Remote Sensing Letters, 11(11): 1886-1890[DOI:10.1109/lgrs.2014.2312754]
Zabalza J, Ren J C, Wang Z, Zhao H M, Wang J and Marshall S. 2015a. Fast implementation of singular spectrum analysis for effective feature extraction in hyperspectral imaging. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 8(6): 2845-2853[DOI:10.1109/JSTARS.2014.2375932]
Zabalza J, Ren J C, Zheng J B, Han J W, Zhao H M, Li S T and Marshall S. 2015b. Novel two-dimensional singular spectrum analysis for effective feature extraction and data classification in hyperspectral imaging. IEEE Transactions on Geoscience and Remote Sensing, 53(8): 4418-4433[DOI:10.1109/tgrs.2015.2398468]
Zhang S Z, Li S T, Fu W and Fang L Y. 2017. Multiscale superpixel-based sparse representation for hyperspectral image classification. Remote Sensing, 9(2): #139[DOI:10.3390/rs9020139]
Zhong Z L, Li J, Luo Z M and Chapman M. 2017. Spectral-spatial residual network for hyperspectral image classification: a 3-D deep learning framework. IEEE Transactions on Geoscience and Remote Sensing, 56(2): 847-858[DOI:10.1109/TGRS.2017.2755542]
相关作者
相关机构
京公网安备11010802024621