梯度优化的有理函数图像插值
Rational function interpolation algorithm based on gradient optimization
- 2018年23卷第5期 页码:766-777
收稿:2017-07-11,
修回:2017-10-27,
纸质出版:2018-05-16
DOI: 10.11834/jig.170369
移动端阅览

浏览全部资源
扫码关注微信
收稿:2017-07-11,
修回:2017-10-27,
纸质出版:2018-05-16
移动端阅览
目的
2
对图像纹理区域的细节保持一直以来是图像插值技术的一个难题,为此提出了一种梯度优化的有理函数图像插值算法。
方法
2
首先,构造了一种新的含有可调参数的双变量有理插值函数,随着参数的不同取值,该函数具有不同的表达形式,它是多项式模型和有理模型的有机统一体;其次,根据图像的区域特征,利用等值线方法将图像自适应地划分为纹理区域和平滑区域,纹理区域采用有理模型插值,平滑区域采用多项式模型插值;最后,根据各向同性Sobel算子计算插值单元的图像梯度,确定纹理方向,不同纹理方向的插值单元用相应的权重对中心点进行优化。
结果
2
从客观数据、主观效果、时间复杂度3个方面对重建图像进行评价,客观数据包括峰值信噪比(PSNR)和结构相似性(SSIM),从实验结果可以看出,本文算法的PSNR平均提高了0.14~1.50 dB,SSIM平均提高了0.005~0.097。从主观效果来看,本文算法的重建图像的纹理细节更加丰富,边缘结构更加清晰,从时间复杂度来看,本文算法的平均运行时间是3.77 s,分别比DFDF(directional filtering and data fusion)、NEDI(new edge-directed interpolation)、RSAI(robust soft-decision adaptive interpolation)、Lee's、NARM(nonlocal autoregressive model)算法快了3.28倍、5.26倍、53.28倍、43.53倍、418.54倍。特别地,对于Baboon、Barbara、Metal这类纹理细节丰富的图像,本文算法在峰值信噪比和结构相似性上较对比算法有突出优势,主观效果有明显提高。
结论
2
基于构造的双变量有理插值模型,本文提出了一个梯度优化的有理函数图像插值算法,实验结果表明,该算法在图像纹理细节和边缘结构保持方面具有良好的视觉效果,有效提高了插值图像质量,且时间复杂度较低。
Objective
2
Image interpolation has become an active area of research in image processing
which can be easily extended to diverse applications ranging from medical imaging
remote sensing
aviation
animation production
and multimedia entertainment industries. A large number of image interpolation methods have been proposed by researchers. Generally
the interpolation methods can be divided into discrete and continuous methods. The adaptive interpolation methods based on discrete ideas can preserve the image structure of the edge. However
its performance in maintaining image details is less than satisfactory. The image cannot be amplified at any multiple by using discrete methods. And such methods are considerably time consuming. The interpolation methods based on continuous ideas can obtain rich image detail information but cannot maintain the image edge structure well. A new method of rational function image interpolation based on gradient optimization that has the advantages of the discrete and continuous methods is proposed.
Method
2
First
a novel bivariate rational interpolation function is constructed. With varying shape parameters
the function has different forms of expression
i.e.
an organic unity of polynomial and rational models. The constructed
$${{\rm{C}}^2}$$
continuous rational function interpolation model has the advantages of the continuous method
in which the appearance of the jagged edge is reduced to some extent and becomes smooth. Second
according to the regional characteristics
the image is divided into the texture and smooth regions automatically using the isoline method. If the interpolation unit has at least an isoline
then the unit belongs to the texture region. If the interpolation unit does not have isolines
then the unit belongs to the smooth region. The smooth region is interpolated by the polynomial model
and the texture region is interpolated by the rational model. Finally
according to the isotropic Sobel operator
the image gradient of the interpolation unit is calculated and the direction of the texture region is determined. According to the image gradient and texture direction
the weight of the influencing factor of every interpolation unit is obtained. Then
the center of the image patch with different directions is optimized by convoluting with the weight matrix.
Result
2
A rational function image interpolation algorithm based on gradient optimization is proposed. The proposed algorithm is tested in three different aspects
namely
objective data
visual effect
and time complexity. Compared with the state-of-the-art interpolation algorithms
the average peak signal-to-noise ratio of the proposed method is 1.5
0.36
0.14
0.28
1.11
and 0.95 dB higher than that of the bicubic
RSAI
DFDF
NARM
NEDI
and Lee's algorithms
respectively. The average structural similarity of the proposed method is 0.0968
0.007 2
0.007 6
0.005 2
0.014 1
and 0.023 7 higher than that of the bicubic
RSAI
DFDF
NARM
NEDI
and Lee's algorithms
respectively. The image reconstructed by the proposed method has richer texture detail and sharper edge structure than that by the bicubic
RSAI
DFDF
NARM
NEDI
and Lee's algorithms. The average runtime of the proposed method is 7 s
which is 3.28
5.26
53.28
43.53
and 418.54 times faster than that of DFDF
NEDI
RSAI
Lee's
and NARM algorithms. For texture images such as Baboon
Barbara
and Metal
the proposed method is highly competitive not only in objective data but also in visual effect.
Conclusion
2
We construct a bivariate rational interpolation function in this study. On the basis of this model
an image interpolation algorithm based on gradient optimization is presented
which is not only able to scale the reconstructed image indefinitely but also has a low time complexity. Experimental results show that the proposed algorithm preserves the image details and structures of the edge effectively and generates a high-quality interpolation image.
Keys R. Cubic convolution interpolation for digital image processing[J]. IEEE Transactions on Acoustics, Speech, and Signal Processing, 1981, 29(6):1153-1160.[DOI:10.1109/TASSP.1981.1163711]
Hou H, Andrews H. Cubic splines for image interpolation and digital filtering[J]. IEEE Transactions on Acoustics, Speech, and Signal Processing, 1978, 26(6):508-517.[DOI:10.1109/TASSP.1978.1163154]
Yang Z X, Lu F, Guan L T. Image enlargement and reduction with arbitrary accuracy through scaling relation of B-spline[J]. Journal of Computer-Aided Design&Computer Graphics, 2001, 13(9):824-827.
杨朝霞, 逯峰, 关履泰.用B样条的尺度关系来实现图像任意精度的放大缩小[J].计算机辅助设计与图形学学报, 2001, 13(9):824-827. [DOI:10.3321/j.issn:1003-9775.2001.09.012]
Carrato S, Tenze L. A high quality 2 x image interpolator[J]. IEEE Signal Processing Letters, 2000, 7(6):132-134.[DOI:10.1109/97.844630]
Li X, Orchard M T. New edge-directed interpolation[J]. IEEE Transactions on Image Processing, 2001, 10(10):1521-1527.[DOI:10.1109/83.951537]
Zhang L, Wu X L. An edge-guided image interpolation algorithm via directional filtering and data fusion[J]. IEEE Transactions on Image Processing, 2006, 15(8):2226-2238.[DOI:10.1109/TIP.2006.877407]
Zhang X J, Wu X L. Image interpolation by adaptive 2-D autoregressive modeling and soft-decision estimation[J]. IEEE Transactions on Image Processing, 2008, 17(6):887-896.[DOI:10.1109/TIP.2008.924279]
Hung K W, Siu W C. Robust soft-decision interpolation using weighted least square[J]. IEEE Transactions on Image Processing, 2012, 21(3):1061-1069.[DOI:10.1109/TIP.2011.2168416]
Dong W S, Zhang L, Lukac R, et al. Sparse representation based image interpolation with nonlocal autoregressive modeling[J]. IEEE Transactions on Image Processing, 2013, 22(4):1382-1394.[DOI:10.1109/TIP.2012.2231086]
Lee S J, Kang M C, Uhm K H, et al. An edge-guided image interpolation method using Taylor series approximation[J]. IEEE Transactions on Consumer Electronics, 2016, 62(2):159-165.[DOI:10.1109/TCE.2016.7514715]
Zhang Y F, Zhang C M, Chi J, et al. An algorithm for enlarged image enhancement[J]. ICIC Express Letters, 2009, 3(3):669-674.
Duan Q, Zhang H L, Zhang Y F, et al. Bounded property and point control of a bivariate rational interpolating surface[J]. Computers&Mathematics with Applications, 2006, 52(6-7):975-984.[DOI:10.1016/j.camwa.2006.04.021]
Zhang Y F, Bao F X, Zhang C M, et al. Local shape control of a bivariate rational interpolating surface with mixing conditions[C]//The 8th International Symposium on Voronoi Diagrams in Science and Engineering. Qingdao, China: IEEE, 2011: 200-205. [ DOI:10.1109/ISVD.2011.34 http://dx.doi.org/10.1109/ISVD.2011.34 ]
Sun Q H, Bao F X, Zhang Y F, et al. A bivariate rational interpolation based on scattered data on parallel lines[J]. Journal of Visual Communication and Image Representation, 2013, 24(1):75-80.[DOI:10.1016/j.jvcir.2012.11.003]
Yao X X, Zhang Y F, Ning Y, et al. Multi-scale feature image interpolation based on a rational fractal function[J]. Journal of Image and Graphics, 2016, 21(4):482-489.
姚勋祥, 张云峰, 宁阳, 等.多尺度有理分形的图像插值算法[J].中国图象图形学报, 2016, 21(4):482-489. [DOI:10.11834/jig.20160410]
Liu Y F, Zhang Y F, Guo Q, et al. Image interpolation based on weighted and blended rational function[M]//Jawahar C V, Shan S G. Computer Vision-ACCV 2014 Workshops. Cham: Springer, 2015: 78-88. [ DOI:10.1007/978-3-319-16631-5_6 http://dx.doi.org/10.1007/978-3-319-16631-5_6 ]
Zhao Q J, Hu M, Tan J Q. Many-knot splines technique for image interpolation[J]. Journal of Image and Graphics, 2006, 11(5):667-671.
赵前进, 胡敏, 檀结庆.图像插值的多结点样条技术[J].中国图象图形学报, 2006, 11(5):667-671. [DOI:10.3969/j.issn.1006-8961.2006.05.010]
Wen Y H, Liu Y J.An isoline generating algorithm based on Delaunay[C]//Proceedings of the 20102nd International Conference on Computer Engineering and Technology. Chengdu, China: IEEE, 2010: V7-173-V7-176. [ DOI:10.1109/ICCET.2010.5485290 http://dx.doi.org/10.1109/ICCET.2010.5485290 ]
相关作者
相关机构
京公网安备11010802024621