Shadow detection from high resolution remote sensing imagery based on multi-scale segmentation and morphology operation

Yuzhun Lin; Baoming Zhang; Haitao Guo; Jun Lu

doi:10.11834/jig.170657

Remote Sensing Image Processing | Views : 0 下载量: 5 CSCD: 4

PDF
Export
Share
Collection
Album

Shadow detection from high resolution remote sensing imagery based on multi-scale segmentation and morphology operation
Vol. 23, Issue 8, Pages: 1263-1272(2018)
Received：14 November 2017，

Revised：2018-1-24，

Published：16 August 2018
DOI： 10.11834/jig.170657
稿件说明：

移动端阅览

DOI：

Yuzhun Lin, Baoming Zhang, Haitao Guo, Jun Lu. Shadow detection from high resolution remote sensing imagery based on multi-scale segmentation and morphology operation[J]. Journal of Image and Graphics, 2018, 23(8): 1263-1272. DOI： 10.11834/jig.170657.

摘要

目的

针对阴影在高分辨率遥感影像的特性，提出了一种多尺度分割和形态学运算相结合的阴影检测方法。

方法

基于面向对象思想，首先利用均值漂移法实现影像分割生成对象，并以对象为基本单元分别进行形态学膨胀和腐蚀运算，从而获得面向对象的阴影指数；然后对影像进行多尺度分割，生成阴影指数矢量；最后对阴影指数矢量和亮度均值分别指定高低阈值，进而获得阴影检测结果。

结果

选取高分二号和Google earth影像进行实验，采用误检率、漏检率和总错误率3个指标进行定量分析，并将实验结果与结合多特征法和形态学阴影指数法进行比较。在阴影检测定量精度分析中，相比于对比方法，本文方法的误检率偏高，但漏检率平均降低了7.31%；在建筑物阴影检测实验中，本文方法的漏检率同样下降了4.5个百分点；在多尺度效果融合分析中，本文方法在多组尺度组合下，各项精度指标均较理想；在阴影压盖地物实验中，3种方法的误检情况差异不大，但本文方法的漏检率得到较大改善，其下降程度平均达到了19.29%。

结论

本文提出的阴影检测方法具备一定的抗干扰能力，适用性强，可靠性高。

Abstract

Objective

In high-resolution remote sensing imagery

tall objects

such as buildings and trees

often cause interference with part of the light

resulting in the absence of corresponding spectral information and forming the shadow. Therefore

effective and accurate detection of shadow is helpful to recognize the shape of certain objects

relative position

surface properties

height

and other information. On the one hand

considering the common phenomenon of "same object with different spectra and same spectrum with different objects" and rich details in high-resolution remote-sensing imagery

traditional pixel level methods are often affected by noise when detecting shadow

but the imagery segmentation can allow spatially adjacent and spectrally similar pixels to be merged into the whole to avoid noise interference. On the other hand

morphology operation has certain recognition ability to the prominent region of the spectrum

and the spectral characteristics of shadow are often dark. With this analysis

a method based on multi-scale segmentation and morphology operation is proposed.

Method

The proposed method is based on objected-oriented idea. First

imagery segmentation objects are generated by mean shift algorithm

and object-based shadow index is obtained by object morphology dilation and erosion operation. Then

shadow index vector and brightness mean are constructed by setting different sizes of color space and coordinating space kernel function bandwidth. Finally

the shadow index vector and brightness mean are designated with high and low thresholds

and the shadow detection is accomplished.

Result

GF-2 imagery from Guangzhou and Google earth imageries from Ohio are used in verifying the validity of the proposed method. The proposed method is compared with principal component analysis + HSV transformation + histogram segmentation algorithm and morphological shadow index algorithm by using error

miss

and total error rates. In the shadow quantitative detection experiment

although the error rate of the proposed method is relatively high

the miss rate decreases by 7.31%. In the building shadow detection experiment

the miss rate of the proposed method also dropped by 4.5 percentage points. In the multi-scale effect fusion analysis

the accuracy of the proposed method is ideal under the different combinations of multiple scales. In the capped ground shadow detection experiment

the error rate of the three methods are roughly the same

but the miss rate of the proposed method is significantly lower than that of the comparative methods

and the extent of its decrease reaches an average of 19.29 percentage points.

Conclusion

This study presents a shadow detection method that combines morphology operation and multi-scale segmentation. Objected-oriented idea is used in the proposed method

which effectively solves the salt and pepper phenomenon. First

on the basis of imagery segmentation

the morphology operation is used to extract the dark area of spectral information. Then

shadow detection result is further determined by the brightness mean. In addition

in view of the difficulty of determining the optimal segmentation scale

the shadow index vector is constructed by multi-scale segmentation. Thus

this vector is helpful to effectively combine the advantages of each scale

enhance the applicability of the proposed method

and reduce the dependence on the segmentation scale. From the detection results

the proposed method achieves ideal results for different types of high-resolution remote-sensing imageries and exerts good detection effect on the capped ground shadow

showing strong robustness and universality. However

the proposed method needs to be improved. For example

if the spectral features are close to the shadows and the shapes of the areas are not much different

then the method needs further exploration. Moreover

how to remove several non-building shadows is challenging

especially when building shadows are adjacent to non-building shadows.

关键词

Keywords

references

Makarau A, Richter R, Muller R, et al. Adaptive shadow detection using a blackbody radiator model[J]. IEEE Transactions on Geoscience and Remote Sensing, 2011, 49(6):2049-2059.[DOI:10.1109/TGRS.2010.2096515]

Finlay G D, Hordley S D, Drew M S. Removing shadows from images[C ] //Proceedings of the 7th European Conference on Computer Vision. Copenhagen, Denmark: Springer, 2002: 823-836. [ DOI: 10.1007/3-540-47979-1_55 http://dx.doi.org/10.1007/3-540-47979-1_55 ]

Zhang X P, Chen F, He H J. Shadow detection in high resolution remote sensing images using multiple features[J]. Acta Automatica Sinica, 2016, 42(2):290-298.

张先鹏, 陈帆, 和红杰.结合多种特征的高分辨率遥感影像阴影检测[J].自动化学报, 2016, 42(2):290-298. [DOI:10.16383/j.aas.2016.c150196]

Fang J Q, Chen F, He H J, et al. Shadow detection of remote sensing images based on local-classification level set and color feature[J]. Acta Automatica Sinica, 2014, 40(6):1156-1165.

方菊芹, 陈帆, 和红杰, 等.结合局部分类水平集与颜色特征的遥感影像阴影检测[J].自动化学报, 2014, 40(6):1156-1165. [DOI:10.3724/SP.J.1004.2014.01156]

Wu T P, Tang C K. A Bayesian approach for shadow extraction from a single image[C ] //Proceedings of the 10th IEEE International Conference on Computer Vision. Beijing, China: IEEE, 2005: 480-487. [ DOI: 10.1109/ICCV.2005.4 http://dx.doi.org/10.1109/ICCV.2005.4 ]

Xie W H, Yi B S, Xiao J S, et al. Shadow detection algorithm based on color and regional gradient direction features[J]. Journal of Central South University:Science and Technology, 2013, 44(12):4874-4480.

解文华, 易本顺, 肖进胜, 等.基于颜色和区域梯度方向特征的阴影检测算法[J].中南大学学报:自然科学版, 2013, 44(12):4874-4880.

Jiang K, Li A H, Su Y Z, et al. Adaptive shadow detection using global texture and sampling deduction[J]. IET Computer Vision, 2013, 7(2):115-122.[DOI:10.1049/iet-cvi.2012.0106]

Jiang K, Li A H, Gui Z G, et al. Adaptive shadow detection using global texture and sampling deduction[J]. Iet Computer Vision, 2013, 7(2):115-122.[DOI:10.1049/iet-cvi.2012.0106]

Guo H T, Xu Q, Zhang B M. Shadow extraction of building based on multiple constraints[J]. Geomatics and Information Science of Wuhan University, 2005, 30(12):1059-1062.

郭海涛, 徐青, 张保明.多重约束下的建筑物阴影提取[J].武汉大学学报:信息科学版, 2005, 30(12):1059-1062. [DOI:10.3969/j.issn.1671-8860.2005.12.007]

Finlayson G D, Hordley S D, Lu C, et al. On the removal of shadows from images[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2006, 28(1):59-68.[DOI:10.1109/TPAMI.2006.18]

Huang X, Zhang L P. Morphological building/shadow index for building extraction from high-resolution imagery over urban areas[J]. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2012, 5(1):161-172.[DOI:10.1109/JSTARS.2011.2168195]

Jimenez L I, Plaza J, Plaza A. Efficient implementation of morphological index for building/shadow extraction from remotely sensed images[J]. The Journal of Supercomputing, 2017, 73(1):482-494.[DOI:10.1007/s11227-016-1890-9]

Li C, Sun L, Tian R L, et al. Single image shadow detection based on intersecting cortical model[J]. Acta Automatica Sinica, 2014, 40(12):2887-2898.

李成, 孙路, 田润澜, 等.基于交叉皮质模型的单幅图像阴影检测算法[J].自动化学报, 2014, 40(12):2887-2898. [DOI:10.3724/SP.J.1004.2014.02887]

Xia H Y, Guo P. A shadow detection of remote sensing images based on statistical texture features[J]. Journal of Remote Sensing, 2011, 15(4):778-791.

夏怀英, 郭平.基于统计混合模型的遥感影像阴影检测[J].遥感学报, 2011, 15(4):778-791. [DOI:10.11834/jrs.20110153]

Zhu Q, Xu S H, Han L T. A new shadow extraction method from color aerial images based on Dempster-Shafer evidence theory[J]. Acta Automatica Sinica, 2007, 33(6):588-595.

朱庆, 徐胜华, 韩李涛.基于D-S证据理论的彩色航空影像阴影提取方法[J].自动化学报, 2007, 33(6):588-595. [DOI:10.16383/j.aas.2007.06.004]

Wang S G, Wang J L, Wang A P. Shadow detection and extraction from imagery based on total variation[J]. Geomatics and Information Science of Wuhan University, 2006, 31(8):663-666.

王树根, 王军利, 王爱萍.基于整体变分模型的影像阴影检测算法研究[J].武汉大学学报:信息科学版, 2006, 31(8):663-666. [DOI:10.3321/j.issn:1671-8860.2006.08.002]

Guo R Q, Dai Q Y, Hoiem D. Single-image shadow detection and removal using paired regions[C ] //Proceedings of 2011 IEEE Conference on Computer Vision and Pattern Recogni tion. Providence, RI, USA: IEEE, 2011: 2033-2040. [ DOI: 10.1109/CVPR.2011.5995725 http://dx.doi.org/10.1109/CVPR.2011.5995725 ]

Vicente T F Y, Yu C P, Samaras D. Single image shadow detection using multiple cues in a supermodular MRF[C ] //Proceedings of British Machine Vision Conference. London, UK: BMVA Press, 2013: 1-12. [ DOI: 10.5244/C.27.126 http://dx.doi.org/10.5244/C.27.126 ]

Comaniciu D, Meer P. Mean shift:a robust approach toward feature space analysis[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2002, 24(5):603-619.[DOI:10.1109/34.1000236]

Jing R, Deng L, Zhao W J, et al. Object-oriented aquatic vegetation extracting approach based on visible vegetation indices[J]. Chinese Journal of Applied Ecology, 2016, 27(5):1427-1436.

井然, 邓磊, 赵文吉, 等.基于可见光植被指数的面向对象湿地水生植被提取方法[J].应用生态学报, 2016, 27(5):1427-1436. [DOI:10.13287/j.1001-9332.201605.002]

Liu J H, Fang T, Li D R. Shadow detection in remotely sensed images based on self-adaptive feature selection[J]. IEEE Transactions on Geoscience and Remote Sensing, 2011, 49(12):5092-5103.[DOI:10.1109/TGRS.2011.2158221]

Li Y, Sasagawa T, Gong P. A system of the shadow detection and shadow removal for high resolution city aerial photo[C]//Proceedings of the 24th ISPRS Congress. Istanbul, Turkey: ISPRS, 2004.

Alert me when the article has been cited

提交

Segmentation of high-resolution remote sensing image by collaborating with edge loss enhancement

Sparse scale set model based on global regional dissimilarity threshold

Physical Properties Synthetic Dataset and Forgery Detection Method for Shadow-Consistency Analysis

Research on Shadow Detection in Grayscale Video Sequence for Traffic Images

Studies of Background Subtraction and Shadow Detection Algorithm