Contour detection based on a computation model for primary visual pathway

Wei Wu; Tao Zhou; Yaping Zhu; Yingle Fan

doi:10.11834/jig.180556

Image Understanding and Computer Vision | Views : 0 下载量: 135 CSCD: 0

PDF
Export
Share
Collection
Album

Contour detection based on a computation model for primary visual pathway
Vol. 24, Issue 5, Pages: 805-815(2019)
Received：19 September 2018，

Revised：2018-11-5，

Published：16 May 2019
DOI： 10.11834/jig.180556
稿件说明：

移动端阅览

DOI：

Wei Wu, Tao Zhou, Yaping Zhu, Yingle Fan. Contour detection based on a computation model for primary visual pathway[J]. Journal of Image and Graphics, 2019, 24(5): 805-815. DOI： 10.11834/jig.180556.

摘要

目的

轮廓是对图像目标的一种稀疏表达方式，从图像中提取出有效物体轮廓可以更好地完成后续的视觉认知任务，所以轮廓检测在计算机视觉领域具有较好的应用。本文考虑到初级视通路中视觉信息传递和处理流程中的特点，提出了一种基于初级视通路计算模型的轮廓检测方法。

方法

在视网膜神经节环节，提出一种体现方向选择特性的经典感受野（CRF）改进模型，利用多尺度特征融合策略来模拟视网膜神经节细胞对图像目标的初级轮廓响应；在视网膜神经节到神经节-外膝体（LGN）的视通路中，提出一种反映视觉信息时空尺度特征的时空编码机制，模拟神经节-外膝体通路对初级轮廓响应的去冗余处理；利用非下采样轮廓波变换和Gabor变换协同作用，模拟非经典感受野（NCRF）的侧向抑制特性。最后利用初级视皮层对整体轮廓的前馈机制，实现对轮廓局部细节信息的完整性融合。

结果

选择将RuG40图库的所有图像作为测试集合进行模型性能测试，对检测结果进行非极大值抑制和阈值处理，最终将得到的二值轮廓图与基准图比较，整个数据集和单张图的最优平均

指标分别为0.49和0.56。对于单个图像最优参数条件下的检测结果均值，将本文方法与非经典感受野抑制模型（ISO）和多特征外周抑制模型（MCI）比较，较两者分别提高了19.1%和7.7%。结果表明本文方法能有效突出主体轮廓并抑制纹理背景。

结论

面向图像处理应用的初级视通路计算模型，将为后续图像理解和分析提供一种新的思路。

Abstract

Objective

The effectiveness of contour detection in many applications has been well established and demonstrated widely. This operation is fundamental for numerous vision tasks

such as image analysis and scene understanding. The operation can be used for image segmentation

object detection

and occlusion and depth reasoning. Many studies on contour detection respond not only to foreground objects but also to background textures. In this study

a new method of "object-only" contour detection based on the primary visual pathway computation model is proposed according to the characteristics of visual information transmission and processing in the primary visual pathway. Obtaining the accurate boundaries of an object in the foreground is expected

and the noise and background textures in images are suppressed.

Method

In this study

we attempt to construct a primary visual pathway computation model to simulate the transmission and processing of visual information flows. First

in the retinal ganglion

a classical receptive field direction selection model that combines multi-scale features is constructed to obtain the primary contour response of image targets. Then

a spatiotemporal coding mechanism is used to streamline the redundant features in the primary contour response in the visual pathway of the retinal ganglion to the LGN (lateral geniculate nucleus). Furthermore

the synergistic effects of NSCT (non-subsampled contourlet transform) and Gabor transform are used to simulate the processing effects of the lateral suppression characteristics of NCRF (non-classical receptive field) on the texture background information. Finally

the feedforward mechanism of the visual pathway to the primary visual cortex is combined with the visual features of the multi-visual pathway to obtain the contour response.

Result

The experimental images are derived from RuG40. To verify the effectiveness of our proposed algorithm

we use and compare two methods (ISO and MCI) with the best contour detection results. After the non-maximum suppression and threshold processing

the binary contour map obtained is compared with the reference map. On the one hand

the qualitative analysis of the proposed algorithm shows that although the ISO method achieves a certain balance between false detection rate and missed detection rate in general

some parts present severely distorted contours

such as the image ganglions. Although the MCI method has an improved balance between false detection rate and missed detection rate

the actual detection effect is equally superior. However

its suppression of the image background must be improved in the processing effect of some complex background images

such as the Buffalo. The proposed detection model has the best detection performance under the premise of ensuring that the contour detection results are close to the manual detection results. On the other hand

the quantitative analysis of the proposed algorithm shows that the optimal average indicators for the entire data set and a single map of the RuG40 library are 0.49 and 0.56

respectively. For the average detection results of the optimal parameters of the entire library

the proposed detection model achieves an increase of 22.5% and 6.5% relative to the ISO and MCI models

respectively. For the mean values of the detection results of the optimal parameters for a single image

the proposed detection model achieves an increase of 19.1% and 7.7% relative to the ISO and MCI models

respectively.

Conclusion

This study attempts to construct a primary visual pathway computation model to simulate the transmission and processing of biological visual information flows. Compared with the best methods for current contour detection by ISO and MCI

the proposed algorithm can suppress texture background information to a large extent while achieving complete extraction of contour information. Moreover

the proposed algorithm is close to the biological vision mechanism. The contour detection method put forward in this study provides a new research approach for the subsequent contour detection method based on the biological vision mechanism. Subsequent research can be based on the biological vision mechanism to explore how the proposed contour detection method affects advanced image understanding and perception tasks. At the same time

the proposed contour detection method can be used to provide a solid foundation for subsequent high-level visual perception technology.

关键词

Keywords

references

Grossberg S. Cortical dynamics of three-dimensional form, color, and brightness perception:Ⅰ. Monocular theory[J]. Perception&Psychophysics, 1987, 41(2):87-116. [DOI:10.3758/BF03204874]

Grigorescu C, Petkov N, Westenberg M A. Contour detection based on nonclassical receptive field inhibition[J]. IEEE Transactions on Image Processing, 2003, 12(7):729-739. [DOI:10.1109/TIP.2003.814250]

Tang Q L, Sang N, Zhang T X. Extraction of salient contours from cluttered scenes[J]. Pattern Recognition, 2007, 40(11):3100-3109. [DOI:10.1016/j.patcog.2007.02.009]

Zeng C, Li Y J, Li C Y. Center-surround interaction with adaptive inhibition:a computational model for contour detection[J]. NeuroImage, 2011, 55(1):49-66. [DOI:10.1016/j.neuroimage.2010.11.067]

Lyu C, Xu Y L, Zhang X L, et al. Edge detection based on primary visual pathway[C ] //Proceedings of the 9th International Conference on Image and Graphics. Shanghai: Springer, 2017: 430-439. [ DOI:10.1007/978-3-319-71589-6_37 http://dx.doi.org/10.1007/978-3-319-71589-6_37 ]

Hou W S, Zhang Y, Zheng X L, et al. Simulation study of epidural electrical stimulation applied on the visual cortex based on finite element method[J]. Chinese Journal of Biomedical Engineering, 2010, 29(4):557-563.

侯文生, 章毅, 郑小林, 等.基于有限元法的硬脑膜外视皮层电刺激仿真研究[J].中国生物医学工程学报, 2010, 29(4):557-563. [DOI:10.3969/j.issn.0258-8021.2010.04.013]

Zhu M C, Rozell C J. Visual nonclassical receptive field effects emerge from sparse coding in a dynamical system[J]. PLoS Computational Biology, 2013, 9(8):#e1003191. [DOI:10.1371/journal.pcbi.1003191]

Wang Z Z, Guo L L, Adjouadi M. A generalized leaky integrate-and-fire neuron model with fast implementation method[J]. International Journal of Neural Systems, 2014, 24(5):#1440004. [DOI:10.1142/S0129065714400048]

Liang P J, Wu S, Gu F J. An Introduction to Neural Information Processing[M]. Dordrecht:Springer, 2016. [DOI:10.1007/978-94-017-7393-5]

Jones H E, Grieve K L, Wang W, et al. Surround suppression in primate V1[J]. Journal of Neurophysiology, 2001, 86(4):2011-2028. [DOI:10.1152/jn.2001.86.4.2011]

Da Cunha A L, Zhou J, Do M N. The nonsubsampled contourlet transform:theory, design, and applications[J]. IEEE Transactions on Image Processing, 2006, 15(10):3089-3101. [DOI:10.1109/TIP.2006.877507]

Wu Y Q, Luo Z J, Wu W Y. A method of small target detection in infrared image based on non-subsampled contourlet transform[J]. Journal of Image and Graphics, 2009, 14(3):477-481.

吴一全, 罗子娟, 吴文怡.基于NSCT的红外图像小目标检测技术[J].中国图象图形学报, 2009, 14(3):477-481. [DOI:10.11834/jig.20090316]

Yang Y, Tong S, Huang S Y, et al. Log-Gabor energy based multimodal medical image fusion in NSCT domain[J]. Computational and Mathematical Methods in Medicine, 2014, 2014:#835481. [DOI:10.1155/2014/835481]

Azzopardi G, Petkov N. A CORF computational model of a simple cell that relies on LGN input outperforms the Gabor function model[J]. Biological Cybernetics, 2012, 106(3):177-189. [DOI:10.1007/s00422-012-0486-6]

Papari G, Campisi P, Petkov N, et al. A biologically motivated multiresolution approach to contour detection[J]. EURASIP Journal on Advances in Signal Processing, 2007, 2007:#071828. [DOI:10.1155/2007/71828]

Yang K F, Li C Y, Li Y J. Multifeature-based surround inhibition improves contour detection in natural images[J]. IEEE Transactions on Image Processing, 2014, 23(12):5020-5032. [DOI:10.1109/TIP.2014.2361210]

Yang K F. Non classical receptive field model based on multiple visual features and its application[D]. Chengdu: University of Electronic Science and Technology of China, 2012.

杨开富.基于多视觉特征的非经典感受野模型及应用研究[D ] .电子科技大学, 2012[ DOI:CNKI:CDMD:2.1012.472791 http://dx.doi.org/CNKI:CDMD:2.1012.472791 ]