钢板表面低对比度微小缺陷图像增强和分割
Image enhancement and segmentation algorithm for low-contrast small defects on steel plate
- 2020年25卷第1期 页码:81-91
收稿:2019-03-08,
修回:2019-7-16,
录用:2019-7-23,
纸质出版:2020-01-16
DOI: 10.11834/jig.190057
移动端阅览

浏览全部资源
扫码关注微信
收稿:2019-03-08,
修回:2019-7-16,
录用:2019-7-23,
纸质出版:2020-01-16
移动端阅览
目的
2
环境干扰及光学元件不稳定等因素往往会造成钢板表面图像照度不均,钢板表面的微小缺陷具有图像灰度不均、对比度低、形态微小等特点,给后续图像分析和缺陷识别带来因难。为此,提出一种钢板表面低对比度微小缺陷图像增强和分割算法,以消除照度不均并突出缺陷信息,从而有效分割缺陷目标。
方法
2
采用小波-同态滤波算法进行图像增强处理,即先利用小波变换对图像进行分解,再基于同态滤波对小波低频系数进行图像灰度修正,同时对高频系数进行高通滤波,然后将处理后的小波低频系数和高频系数进行重构得到增强的图像,从而达到消除照度不均、增强缺陷细节信息的目的。最后利用最大类间方差法(Otsu法)确定自适应阈值提供给Canny算子进行边缘检测。
结果
2
采用本文算法对钢板表面多类型低对比度表面微小缺陷进行研究,有效消除了光照不均;单一的Otsu阈值分割和Canny算子难以有效检测这些缺陷,而本文Otsu-Canny算法的正确检测率达96%。
结论
2
采用小波-同态滤波进行图像增强处理后,再利用Otsu-Canny算法对钢板表面多类型、低对比度的微小缺陷进行边缘检测取得了良好效果。
Objective
2
Steel plates are important raw materials in industry. In its manufacturing process
a variety of surface defects inevitably arise. These surface defects have a negative effect on the appearance and performance of the product; thus
detecting and controlling them in time is necessary. At present
an increasing number of iron and steel manufacturing enterprises use the machine vision method to detect and identify steel-plate surface defects automatically. The defect detection of the steel-plate surface based on machine vision collects the image of the steel-plate surface by using a charge-coupled device camera. By image denoising and enhancement
the defect image is segmented
the defect features are extracted
and the defect classification is conducted. In image acquisition
being disturbed by the on-site environment of the production line is unavoidable
as are the reflection of the steel plate
the illumination environment or the instability of the optical elements
often resulting in the non-uniform illumination of the image. If the image is not enhanced
great interference in the detection and recognition of small surface defects of the steel plate would occur. The common characteristics of small defects on the steel plate surface are non-uniform gray scale
low contrast between defects and background
obscure edge
diverse and small shape
and a small proportion of a defective area in the entire image
which is even mixed with noise. The contrast between the surface defect of the steel plate and its background is low. To conduct subsequent image analysis and defect recognition effectively
we need to conduct image enhancement processing to emphasize the surface defect information. The purpose of image enhancement is to make the original image clear or emphasize interesting features
thereby improving the overall contrast of the image and enhancing the local details of the image
which has good visual effect and rich information features. On this basis
the surface defect target is segmented from the background by image segmentation; thus
the feature of the defect can be extracted and recognized in the future.
Method
2
Low-contrast image enhancement methods often include histogram equalization (HE)
Retinex model
homomorphic filtering
and gray transform. The HE algorithm is widely used because of its simple principle and easy implementation
but it cannot adapt to the local contrast of the image of small defects on the surface of the steel plate. The Retinex model algorithm is also a common method for low-contrast image enhancement. Based on this model
single-scale Retinex (SSR) and multi-scale Retinex (MSR) algorithms have emerged. These series of algorithms have achieved good results
but the computational complexity is high. Homomorphic filtering can also enhance low-contrast images. This method avoids the distortion of image directly processed by Fourier transform (FFT)
but it also has problems
such as over-enhancement and poor enhancement effect in high-light regions. In low-contrast image enhancement
if the local contrast of the image is enhanced in the spatial domain and the detailed information is enhanced by high-pass processing in frequency domain; the spatial and frequency characteristics of the image are considered at the same time. Compared with Fourier transform
wavelet transform (WT) is a localized analysis of space and frequency. It refines the signal step-by-step by scaling and translation operations
and it finally achieves time subdivision at high frequency and frequency subdivision at low frequency
focusing on arbitrary details of the signal. The wavelet-homomorphic filtering algorithm is used in image enhancement to eliminate non-uniform illumination. First
the image is decomposed by wavelet transform
and then the low-frequency coefficients of wavelet are modified by homomorphic filtering
while the high-pass filtering is applied to the high-frequency coefficients. Then
the low-frequency coefficients and high-frequency coefficients of the processed wavelet are reconstructed to obtain the enhanced image to eliminate non-uniform illumination. After image enhancement with wavelet transform and homomorphic filtering
the surface defect target is segmented to obtain the surface defect area of the steel plate. Many methods are used in image segmentation. The common classical methods are threshold segmentation based on gray histogram and edge detection. Given the low contrast of small defects on the surface of the steel plate
the distribution of gray histogram of the image does not have obvious peaks and valleys; thus
obtaining satisfactory results for image segmentation by using threshold method alone is difficult. The edge detection methods of Roberts
Sobel
and Prewitt operators are also poor for this type of small defects with low contrast
and canny edge detection operator remains widely studied and applied
but the segmentation effect is greatly affected by the threshold. On this basis
this study uses the Otsu-Canny algorithm in defect edge detection. In other words
the method of maximum inter-class variance (Otsu method) is used to determine the adaptive threshold for the Canny operator to perform edge detection.
Result
2
In this study
the algorithm is used to study the multiple types of low-contrast surface small defects on the strip surface
thereby effectively eliminating the non-uniform illumination. The Otsu algorithm or Canny operator cannot easily detect these defects effectively
and the correct detection rate of the Otsu-Canny algorithm in this study is 96%.
Conclusion
2
After image enhancement with wavelet-homomorphic filtering
the Otsu-Canny algorithm is used to detect the edges of small defects with multiple types and low contrast on the surface of the steel plate
and good results are obtained. Image enhancement and image segmentation should focus not only on the effect of processing but also on the real-time performance of the algorithm. In steel-plate surface defect detection based on machine vision
a real-time algorithm can be used for conventional surface defects. This algorithm is suitable for small surface defects with low contrast. To improve the processing speed
the parallel algorithm of a high-performance processor graphic processing unit can greatly improve the speed of image processing
thereby satisfying the effectiveness and real-time performance of the algorithm.
Arici T, Dikbas S and Altunbasak Y. 2009. A histogram modification framework and its application for image contrast enhancement. IEEE Transactions on Image Processing, 18(9):1921-1935[DOI:10.1109/TIP.2009.2021548]
Chen S D and Ramli A R. 2003. Minimum mean brightness error bi-histogram equalization in contrast enhancement. IEEE Transactions on Consumer Electronics, 49(4):1310-1319[DOI:10.1109/TCE.2003.1261234]
Canny J. 1986. A computational approach to edge detection. IEEE Transactions on Pattern Analysis and Machine Intelligence, PAMI-8(6): 679-698[ DOI:10.1109/TPAMI.1986.4767851 http://dx.doi.org/10.1109/TPAMI.1986.4767851
Drago F, Myszkowski K, Annen T, Chiba H, Brunet P and Fellner D W. 2003. Adaptive logarithmic mapping for displaying high contrast scenes. Computer Graphics Forum, 22(3):419-426[DOI:10.1111/1467-8659.00689]
Gupta B and Agarwal T K. 2017. Linearly quantile separated weighted dynamic histogram equalization for contrast enhancement. Computers&Electrical Engineering, 62:360-374[DOI:10.1016/j.compeleceng.2017.01.010]
Huang S C, Cheng F C and Chiu Y S.2013. Efficient contrast enhancement using adaptive gamma correction with weighting distribution]. IEEE Transactions on Image Processing, 22(3):1032-1041[DOI:10.1109/TIP.2012.2226047]
Jobson D J, Rahman Z and Woodell G A. 1997a. Properties and performance of a center/surround Retinex. IEEE Transactions on Image Processing, 6(3):451-462[DOI:10.1109/83.557356]
Jobson D J, Rahman Z and Woodell G A. 1997b. A multiscale Retinex for bridging the gap between color images and the human observation of scenes. IEEE Transactions on Image Processing, 6(7):965-976[DOI:10.1109/83.597272]
Kazama A and Oshige T. 2008. A defect inspection technique using polarized images for steel strip surface//Proceedings of SPIE. San Diego, California, United States:SPIE, 70-72[DOI:10.1117/12.794685]
Kim J Y, Kim L S and Hwang S H. 2001. An advanced contrast enhancement using partially overlapped sub-block histogram equalization. IEEE Transactions on Circuits and Systems for Video Technology, 11(4):475-484[DOI:10.1109/76.915354]
Kim W, Jeong J and You J. 2012. Contrast enhancement using histogram equalization based on logarithmic mapping. Optical Engineering, 51(6):067002[DOI:10.1117/1.OE.51.6.067002]
Kim Y T. 1997. Contrast enhancement using brightness preserving bihistogram equalization. IEEE Transactions on Consumer Electronics, 43(1):1-8[DOI:10.1109/30.580378]
Liu M F, Liu Y, Hu H J and Nie L Q. 2016. Genetic algorithm and mathematical morphology based binarization method for strip steel defect image with non-uniform illumination. Journal of Visual Communication and Image Representation, 37:70-77[DOI:10.1016/j.jvcir.2015.04.005]
Land E H. 1986. An alternative technique for the computation of the designator in the Retinex theory of color vision. Proceedings of the National Academy of Sciences of the United States of America, 83(10):3078-3080[DOI:10.1073/pnas.83.10.3078]
Mao D Y, Xie Z X, He X Q, Jia Y Y and Zhou L Y. 2017. Adaptive bilateral logarithm transformation with bandwidth preserving and low-illumination image enhancement. Journal of Iamge and Graphics, 22(10):1356-1363
毛东月, 谢正祥, 贺向前, 贾媛媛, 周丽华. 2017.自适应双向保带宽对数变换及低照度图像增强.中国图象图形学报, 22(10):1356-1363)[DOI:10.11834/jig.170094]
Nnolim U A. 2018. Partial differential equation-based hazy image contrast enhancement. Computers&Electrical Engineering, 72:670-681[DOI:10.1016/j.compeleceng.2018.01.041]
Otsu N. 1979. A threshold selection method from gray-level histograms. IEEE Transactions on Systems, Man, and Cybernetics, 9(1):62-66[DOI:10.1109/TSMC.1979.4310076]
Rahman Z, Jobson D J and Woodell G A. 1996. Multi-scale retinex for color image enhancement//Proceedings of the 3rd IEEE International Conference on Image Processing. Lausanne, Switzerland: IEEE, 1003-1006[ DOI: 10.1109/ICIP.1996.560995 http://dx.doi.org/10.1109/ICIP.1996.560995 ]
Singh K and Kapoor R. 2014. Image enhancement via median-mean based sub-image-clipped histogram equalization. Optik-International Journal for Light and Electron Optics, 125(17):4646-4651[DOI:10.1016/j.ijleo.2014.04.093]
Voicu L I, Myler H R and Week A R. 1997. Practical considerations on color image enhancement using homomorphic filtering. Journal of Electronic Imaging, 6(1):108-113[DOI:10.1117/12.251157]
Wei J T, Chen P and Han Y. 2016. Variable voltage X-ray images fusion based on power function transformation. Journal of North University of China:Natural Science Edition, 37(4):414-418
魏交统, 陈平, 韩焱. 2016.基于幂函数变换的递变电压X射线图像融合.中北大学学报:自然科学版, 37(4):414-418) DOI:10.3969/j.issn.1673-3193.2016.04.017]
Xu K, Wang L and Wang J Y. 2016. Surface defect recognition of hot-rolled steel plates based on Tetrolet transform. Journal of Mechanical Engineering, 52(4):13-19
徐科, 王磊, 王璟瑜. 2016.基于Tetrolet变换的热轧钢板表面缺陷识别方法.机械工程学报, 52(4):13-19)[DOI:10.3901/JME.2016.04.013]
Xiao L M, Li C, Wu Z Z and Wang T. 2016. An enhancement method for X-ray image via fuzzy noise removal and homomorphic filtering. Neurocomputing, 195:56-64[DOI:10.1016/j.neucom.2015.08.113]
Yan Y H, Peng Y S, Song K C and Liu W W. 2010. Removing impulse noise from surface defect images of steel strip based on threshold theory. Journal of Northeastern University:Natural Science, 31(5):718-720
颜云辉, 彭怡书, 宋克臣, 刘伟嵬. 2010.基于阈值法的带钢表面缺陷图像脉冲噪声去除.东北大学学报:自然科学版, 31(5):718-720)[DOI:10.3969/j.issn.1005-3026.2010.05.027]
Zhang X M and Shen L S. 2001. Image contrast enhancement by wavelet based homomorphic filtering. Acta Electronica Sinica, 29(4):531-533
张新明, 沈兰荪. 2001.基于小波的同态滤波器用于图像对比度增强.电子学报, 29(4):531-533)[DOI:10.3321/j.issn:0372-2112.2001.04.025]
Zhang Z, Wang Y P and Xue G X. 2010. Digital Image Processing and Machine Vision. Beijing:Posts and Telecommunications Press
张铮, 王艳平, 薛桂香. 2010.数字图像处理与机器视觉.北京:人民邮电出版社)
相关作者
相关机构
京公网安备11010802024621