Functional patterns-relevant blind-deblurring method for anti-counterfeiting code images

Chang Liu; Hong Zheng; Tianyu Wang; Chengzhuo Zhou

doi:10.11834/jig.220022

Image Processing | Views : 0 下载量: 303 CSCD: 0

PDF
Export
Share
Collection
Album

Functional patterns-relevant blind-deblurring method for anti-counterfeiting code images
Vol. 28, Issue 3, Pages: 680-690(2023)
Received：09 February 2022，

Revised：2022-7-24，

Accepted：01 August 2022，

Published：16 March 2023
DOI： 10.11834/jig.220022
稿件说明：

移动端阅览

DOI：

Chang Liu, Hong Zheng, Tianyu Wang, Chengzhuo Zhou. Functional patterns-relevant blind-deblurring method for anti-counterfeiting code images[J]. Journal of Image and Graphics, 2023, 28(3): 680-690. DOI： 10.11834/jig.220022.

摘要

目的

防伪码是一类经过特殊设计的QR(quick response)码，在防伪和溯源领域有着广泛应用。模糊的防伪码图像不利于解码和真伪鉴别，需要进行去模糊操作。目前主流的盲去模糊算法在用于防伪码图像时，去模糊效果不好且算法消耗时间较长。对此，本文提出一种基于防伪码功能图形的盲去模糊优化算法。

方法

首先，定义了防伪码图像的强度先验和梯度先验。强度先验是图像像素的灰度值，而梯度先验是图像像素水平方向和垂直方向的差分。然后，将整幅模糊防伪码图像均分为左上、左下、右上、右下4块，提取左上、左下、右上3个位置的探测图形和右下的校正图形。最后，将强度先验和梯度先验作为约束项，利用正则化方法求出4个分块的清晰图像和模糊核。

结果

本文测试了100幅人工添加模糊的防伪码图像和50幅手机实际拍摄的模糊防伪码图像，采用峰值信噪比(peak signal to noise ratio

PSNR)、结构相似度(structural similarity

SSIM)和自然图像质量评价器(natural image quality evaluator

NIQE)作为图像清晰度评价指标。从实验结果来看，相较于对比算法的最优结果，本文算法在手机拍摄的模糊防伪码图像数据集上的平均NIQE降低了3.02，复原时间缩短了22.07 s，且能较好地恢复防伪图案的细节信息。在人为添加模糊的防伪码图像数据集上，本文算法的性能也优于对比算法，且能够处理不同程度的运动模糊和离焦模糊。

结论

本文提出的防伪码图像盲去模糊优化算法简单易实现，在保证一定去模糊效果的前提下，算法耗时大幅缩短。

Abstract

Objective

Anti-counterfeiting code can be as a sort of quick response (QR) code-special design. The functions of anti-counterfeiting and traceability of QR code are involved in beyond encoding and decoding. So

the quality of anti-counterfeiting code images is highly required for that. Actually

the obtained anti-counterfeiting code image is challenged to be blurred due to camera-derived noise

the relative shooting motion between camera and anti-counterfeiting code

and its errors-defocused. Generally

QR codes-relevant slight blur degradation does not have a great impact on the function-decoded of anti-counterfeiting codes in terms of its own error-modified ability

but the function of authenticity identification is still a challenging issue to be resolved via the restoration for blurred anti-counterfeiting code images. Most of current blind deblurring algorithms are aimed at natural images

which do not make full use of the features of anti-counterfeiting code. The restoration result is not effective and time cost is high as well. To resolve this problem

we develop a blind-deblurring method on the basis of anti-counterfeiting code's functional patterns.

Method

First

the blurred anti-counterfeiting code image is converted into grayscale and interpolation-bilinear is used to coordinate its size to 512×512 pixels. The intensity and gradient priors of anti-counterfeiting code image are re-identified in terms of its binary features. Intensity-prior means the gray values of clear anti-counterfeiting code image are concentrated between 0 and 255

while anti-counterfeiting code image-blurred are scattered between 0 and 255. Gradient-prior is defined as the difference between adjacent image pixels

which has horizontal and vertical directions. The gradient distribution of clear anti-counterfeiting code image is amongst 0

255 and -255

whereas gradient values of blurred image are scattered between -255 and 255. Then

the entire blurred anti-counterfeiting code image is divided into four blocks with the same size: 1) upper left

2) lower left

3) upper right

and 4) lower right. After that

the three image position detection patterns of upper left

lower left and upper right and the correction pattern of lower right are extracted respectively. There are two potentials of block processing as mentioned below. The first one is beneficial for the deblurring-regularized method

which is scale-related temporal optimization. The other one is focused on comparative analysis for estimating the blur kernel of whole image to make deblurring result better in terms of non-uniform blur-melted block processing. Finally

intensity and gradient-priors cost function is as the constraints

and the deblurring problem is decomposed into two subproblems. The clear images and blur kernels of four blocks are generated based on regularization method and numerical method.

Result

First

we test 100 artificial blur-relevant anti-counterfeiting code images. The updated blur types consist of motion blur

defocus blur and the two blurs-coordinated. To evaluate the performance of those algorithms to be tested

peak signal to noise ratio (PSNR)

structural similarity (SSIM) and the time cost are used as the indicators. The experimental result shows that our algorithm can deal with varied degrees of motion blur and defocus blur. Next

we test 50 blurred anti-counterfeiting code images collected by mobile phones. Natural image quality evaluator (NIQE) is used as the image quality evaluation index. Our average NIQE value is decreased by 3.02 and the time cost is optimized by 22.07 s compared to some popular algorithms

including blind image deblurring using patch wise minimal pixels regularization. Furthermore

the details of anti-counterfeiting pattern can be restored well.

Conclusion

To guarantee certain deblurring effect and time efficiency

our easy-to-use blind-deblurring optimization of anti-counterfeiting code images is demonstrated.

关键词

Keywords

references

Chen L, Fang F M, Wang T T and Zhang G X. 2019. Blind image deblurring with local maximum gradient prior//Proceedings of 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition. Long Beach, USA: IEEE: 1742-1750 [ DOI: 10.1109/CVPR.2019.00184 http://dx.doi.org/10.1109/CVPR.2019.00184 ]

Cho T S, Paris S, Horn B and Freeman W T. 2011. Blur kernel estimation using the radon transform//Proceedings of 2011 IEEE Conference on Computer Vision and Pattern Recognition. Colorado Springs, USA: IEEE: 241-248 [ DOI: 10.1109/CVPR.2011.5995479 http://dx.doi.org/10.1109/CVPR.2011.5995479 ]

Cho H, Wang J and Lee S. 2012. Text image deblurring using text-specific properties//Proceedings of the 12th European Conference on Computer Vision. Florence, Italy: Springer: 524-537 [ DOI: 10.1007/978-3-642-33715-4_38 http://dx.doi.org/10.1007/978-3-642-33715-4_38 ]

Chu C H, Yang D N, Pan Y L and Chen M S. 2011. Stabilization and extraction of 2D barcodes for camera phones. Multimedia Systems, 17(2), 113-133 [DOI:10.1007/s00530-010-0206-9]

Goldstein A and Fattal R. 2012. Blur-kernel estimation from spectral irregularities//Proceedings of the 12th European Conference on Computer Vision. Berlin, Heidelberg, Germany: Springer-Verlag: 622-635 [ DOI: 10.1007/978-3-642-33715-4_45 http://dx.doi.org/10.1007/978-3-642-33715-4_45 ]

Guo Z Y, Zheng H, You C H, Xu X H, Wu X B, Zheng Z H and Ju J P. 2020. Digital forensics of scanned QR code images for printer source identification using bottleneck residual block. Sensors, 20(21): #6305 [DOI: 10.3390/S20216305]

Hu Z, Cho S, Wang J and Yang M H. 2014. Deblurring low-light images with light streaks//Proceedings of 2014 IEEE Conference on Computer Vision and Pattern Recognition, Columbus, USA: IEEE: 3382-3389 [ DOI: 10.1109/CVPR.2014.432 http://dx.doi.org/10.1109/CVPR.2014.432 ]

Jin M G, Roth S and Favaro P. 2018. Normalized blind deconvolution//Proceedings of the 15th European Conference on Computer Vision. Munich, Germany: Springer: 694-711 [ DOI: 10.1007/978-3-030-01234-2_41 http://dx.doi.org/10.1007/978-3-030-01234-2_41 ]

Kupyn O, Budzan V, Mykhailych M, Mishkin D and Matas J. 2018. DeblurGAN: blind motion deblurring using conditional adversarial networks//Proceedings of 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). Salt Lake City, USA: IEEE: 8183-8192 [ DOI: 10.1109/CVPR.2018.00854 http://dx.doi.org/10.1109/CVPR.2018.00854 ]

Liu N, Zheng X, Sun H and Tan X. 2013. Two-dimensional bar code out-of-focus deblurring via the increment constrained least squares filter. Pattern Reognition Letters, 34(2): 124-130 [DOI:10.1016/J.PATREC.2012.09.006]

Mai L and Liu F. 2015. Kernel fusion for better image deblurring//Proceedings of 2015 IEEE Conference on Computer Vision and Pattern Recognition. Boston, USA: IEEE: 371-380 [ DOI: 10.1109/CVPR.2015.7298634 http://dx.doi.org/10.1109/CVPR.2015.7298634 ]

Pan J S, Hu Z, Su Z X and Yang M H. 2014. Deblurring text images via L 0 -regularized intensity and gradient prior//Proceedings of 2014 IEEE Conference on Computer Vision and Pattern Recognition. Columbus, USA: IEEE: 2901-2908 [ DOI: 10.1109/CVPR.2014.371 http://dx.doi.org/10.1109/CVPR.2014.371 ].

Pan J S, Sun D Q, Pfister H and Yang M H. 2016. Blind image deblurring using dark channel prior//Proceedings of 2016 IEEE Conference on Computer Vision and Pattern Recognition. Las Vegas, USA: IEEE: 1628-1636 [ DOI: 10.1109/CVPR.2016.180 http://dx.doi.org/10.1109/CVPR.2016.180 ]

Sörös G, Semmler S, Humair L and Hilliges O. 2015. Fast blur removal for wearable QR code scanners//Proceedings of 2015 ACM International Symposium on Wearable Computers. Osaka, Japan: Association for Computing Machinery: 117-124 [ DOI: 10.1145/2802083.2808390 http://dx.doi.org/10.1145/2802083.2808390 ]

Sun L B, Cho S, Wang J and Hays J. 2013. Edge-based blur kernel estimation using patch priors//Proceedings of 2013 IEEE International Conference on Computational Photography. Cambridge, USA: IEEE: 1-8 [ DOI: 10.1109/ICCPhot.2013.6528301 http://dx.doi.org/10.1109/ICCPhot.2013.6528301 ]

van Gennip Y, Athavale P, Gilles J and Choksi R. 2015. A regularization approach to blind deblurring and denoising of QR barcodes. IEEE Transactions on Image Processing, 24(9): 2864-2873 [DOI: 10.1109/TIP.2015.2432675]

Wen F, Ying R D, Liu Y P, Liu P L and Truong T K. 2020. A simple local minimal intensity prior and an improved algorithm for blind image deblurring. IEEE Transactions on Circuits and Systems for Video Technology, 31(8): 2923-2937 [DOI: 10.1109/TCSVT.2020.3034137]

Whyte O, Sivic J and Zisserman A. 2014. Deblurring shaken and partially saturated images. International Journal of Computer Vision, 110(2): 185-201 [DOI: 10.1007/s11263-014-0727-3]

Wu D, Zhao H T and Zheng S B. 2020. Motion deblurring method based on DenseNets. Journal of Image and Graphics, 25(5): 890-899

吴迪, 赵洪田, 郑世宝. 2020. 密集连接卷积网络图像去模糊. 中国图象图形学报, 25(5): 890-899 [DOI: 10.11834/jig.190400]

Xu L, Lu C W, Xu Y and Jia J Y. 2011. Image smoothing via L 0 gradient minimization//Proceedings of 2011 SIGGRAPH Asia Conference. Hong Kong, China: Association for Computing Machinery: #174 [ DOI: 10.1145/2024156.2024208 http://dx.doi.org/10.1145/2024156.2024208 ].

Xu L, Zheng S C and Jia J Y. 2013. Unnatural l0 sparse representation for natural image deblurring//Proceedings of 2013 IEEE Conference on Computer Vision and Pattern Recognition. Portland, USA: IEEE: 1107-1114 [ DOI: 10.1109/CVPR.2013.147 http://dx.doi.org/10.1109/CVPR.2013.147 ]

Yan Y Y, Ren W Q, Guo Y F, Wang R and Cao X C. 2017. Image deblurring via extreme channels prior//Proceedings of 2017 IEEE Conference on Computer Vision and Pattern Recognition. Honolulu, USA: IEEE: 6978-6986 [ DOI: 10.1109/CVPR.2017.738 http://dx.doi.org/10.1109/CVPR.2017.738 ]

Zheng Z H, Zheng H, Ju J P, Chen D, Li X, Guo Z Y, You C H and Lin M Y. 2021. A system for identifying an anti-counterfeiting pattern based on the statistical difference in key image regions. Expert Systems with Applications, 183: #115410 [DOI: 10.1016/j.eswa.2021.115410]

Alert me when the article has been cited

提交

Comprehensive survey of continual learning

Review of optimization methods for supervised deep learning

Research progress in objective quality evaluation of virtual reality images

A real-world quality evaluation dataset for enhanced underwater images

Motion deblurring method based on DenseNets