Current Issue Cover
融合目标增强与稀疏重构的显著性检测

郭鹏飞, 金秋, 刘万军(辽宁工程技术大学软件学院, 葫芦岛 125105)

摘 要
目的 为了解决图像显著性检测中存在的边界模糊,检测准确度不够的问题,提出一种基于目标增强引导和稀疏重构的显著检测算法(OESR)。方法 基于超像素,首先从前景角度计算超像素的中心加权颜色空间分布图,作为前景显著图;由图像边界的超像素构建背景模板并对模板进行预处理,以优化后的背景模板作为稀疏表示的字典,计算稀疏重构误差,并利用误差传播方式进行重构误差的校正,得到背景差异图;最后,利用快速目标检测方法获取一定数量的建议窗口,由窗口的对象性得分计算目标增强系数,以此来引导两种显著图的融合,得到最终显著检测结果。结果 实验在公开数据集上与其他12种流行算法进行比较,所提算法对具有不同背景复杂度的图像能够较准确的检测出显著区域,对显著对象的提取也较为完整,并且在评价指标检测上与其他算法相比,在MSRA10k数据集上平均召回率提高4.1%,在VOC2007数据集上,平均召回率和F检验分别提高18.5%和3.1%。结论 本文提出一种新的显著检测方法,分别利用颜色分布与对比度方法构建显著图,并且在显著图融合时采用一种目标增强系数,提高了显著图的准确性。实验结果表明,本文算法能够检测出更符合视觉特性的显著区域,显著区域更加准确,适用于自然图像的显著性目标检测、目标分割或基于显著性分析的图像标注。
关键词
Saliency detection via object enhancement and sparse reconstruction

Guo Pengfei, Jin Qiu, Liu Wanjun(School of Software, Liaoning Technical University, Huludao 125105, China)

Abstract
Objective The human visual system can acquire regions of interest for different scenes based on the visual attention mechanism.Each image contains one or more salient objects.Saliency detection involves imitating the visual attention mechanism to obtain important information in an image,thereby improving the efficiency and accuracy of image processing.Saliency detection methods can be used not only in detecting a target object,but also in image annotation and retrieval,object recognition,image clipping,image segmentation,image compression,and other fields.Saliency detection is a research hot spot in computer vision.Although existing significant detection methods have achieved good results,several problems remain,such as the blurring of significant boundaries due to foreground and background noises.Therefore,the accuracy of saliency detection should be improved.Saliency detection methods based on pixels or regions,such as super pixels,can effectively describe the features of salient regions.However,these pixels or regions exist alone and have no real object significance;that is,complete descriptions of objects are lacking.Objectness detection involves obtaining object information by sliding windows.We propose a saliency detection algorithm via object enhancement and sparse reconstruction (OESR) to introduce object descriptions while preserving the effective description of salient features to solve the problems of fuzzy boundaries and improve the accuracy of image saliency detection.The objectness detection method is not used to directly access windows as the final salient objects.We consider window information as an object description to enhance the effectiveness of salient features.Method The input image is segmented by super pixels,and several super pixel regions are obtained.A central weighted color spatial distribution model is adopted.The model is based on the idea that when a wide range of colors exist,these colors are less likely to belong to a salient region.This model utilizes the color information of an image,but the method is based on pixels.Consequently,the final result lacks structured information.We calculate the color space distribution feature on super pixels to introduce structured information.First,from the foreground point of view,the Gauss mixture model is used to model all colors,and the probability of each pixel corresponding to the C color component is calculated.The probability of each super pixel corresponding to the C color component is calculated through the probability of pixels within a super pixel.The color spatial distribution based on super pixels is calculated through its probability and location information.We use the super pixel color spatial distribution map as the foreground saliency map.Second,from the background point of view,we introduce a sparse reconstruction error based on the idea of contrast to describe the feature difference between a super pixel and its surrounding super pixels.We construct the background template by using the super pixel features of the image boundaries.We conduct pretreatment on the template using the k-means clustering algorithm for a combined treatment on the boundary of super pixels to obtain representative boundary features.Super pixels with similar features are merged in each direction;thus,good background templates are obtained.The optimized background template is used as a sparse representation dictionary to compute sparse reconstruction errors.The reconstruction error of a super pixel is corrected in its 8-neighbor to solve the region discontinuity caused by the oversegmentation of an image.After correction,the saliency region becomes smooth,and the sparse reconstruction error is set as the salient value to obtain the background difference map.Finally,from the object point of view,the target enhancement coefficient is calculated using the objectness detection method.We use a fast target detection method to obtain a certain number of proposed windows with various scales.Each window assigns an object score based on the possibility of containing the object.If a pixel belongs to a salient region,then the more target windows that contain this pixel,the higher object scores it will have,and the greater its significance.The target enhancement coefficient is calculated from the object scores of the proposed windows.The foreground saliency map and the background difference map are fused,with the target enhancement coefficient as the guide.We obtain a high-contrast salient map with a significant foreground and a suppressed background.Result The proposed algorithm is compared with 12 methods on two public data sets (i.e.,MSRA10k and VOC2007).The precision,recall,F-measure,and mean absolute error (MAE) are evaluated on the two data sets.The visual contrast of the experiment indicates that the salient objects detected using OESR are complete and accurate,and the method can also effectively deal with images with complex background.OESR uses the target enhancement coefficient in the salient map fusion step.The final salient region has high brightness,and background suppression works efficiently.The P-R curve,average precision,average recall,and average F-measure value indicate that OESR exhibits certain advantages in the three evaluation indexes.Compared with other methods,our method has improved recall of 4.1% on the MSRA10k data set.In the VOC2007 data set,the recall of our method improves by 18.5%,and F-measure improves by 3.1%.Recall represents the recall situation of images to be detected.An improvement in recall shows that the color features and sparse reconstruction features can describe the salient features effectively,and the introduction of object information ensures the integrity of salient regions.The result of the MAE evaluation index also reflects the advantage of OESR in terms of overall performance.Conclusion A new saliency detection method is proposed in this study.The method uses color spatial distribution and sparse reconstruction error to produce a saliency map.Object enhancement coefficients are adopted in the combination of the two maps to improve the accuracy of saliency maps.Experimental results show that the algorithm can detect accurate salient regions,which agree with human vision characteristics.This method is suitable for saliency detection,target segmentation,and image annotation based on saliency analysis.
Keywords

订阅号|日报