Detail-aware texture filtering algorithm
- Vol. 24, Issue 6, Pages: 969-978(2019)
Received:04 September 2018,
Revised:2018-12-6,
Published:16 June 2019
DOI: 10.11834/jig.180521
移动端阅览

浏览全部资源
扫码关注微信
Received:04 September 2018,
Revised:2018-12-6,
Published:16 June 2019
移动端阅览
目的
2
基于现有的研究提出一种细节感知的纹理去除算法,在去除图像纹理时,能够很好地保持图像的结构信息,尤其是诸如细长结构和边角信息等在其他方法中容易被模糊化的特殊细节。
方法
2
首先,本文提出一种能够识别细长结构的结构检测方法,对细长结构进行检测并增强其结构特征。其次,为了估计每个像素点的最优滤波核尺度,改进原有的相对总变差模型,多方向寻找最小相对总变差,使它能够更好地区分纹理和边界,并且将边角信息从纹理中区分出来。然后,将检测出来的细长结构归一到改进的相对总变差的度量尺度上,估计滤波核尺度,生成引导滤波图像。这样就能够在平坦或有纹理的区域运用大尺度的滤波核,并在结构边缘和边角附近减小滤波核。最后,通过联合双边滤波器得到纹理去除后的图像。
结果
2
实验测试了马赛克图像和艺术画作,对比了相对总变差和尺度敏感的结构保护滤波等方法,本文方法在去除纹理的同时保留了细长结构和边角细节,并且具有良好的普适性和鲁棒性。利用本文算法处理一幅含10万像素的图像,仅通过一次迭代计算就能够去除大量纹理且效果优于已有的方法,本算法的计算时间为3.37 s,其他算法为0.07~3.29 s。
结论
2
本文设计的纹理滤波器不仅在保持诸如细长结构方面的性能更好,而且使纹理去除后的图像在边角细节处更尖锐,为图像的后续处理提供了一种强有力的图像预处理方式。
Objective
2
This study proposes a detail-aware texture removal algorithm based on existing studies. When removing image textures
the proposed method maintains the fine structural information of the image
particularly the special details (e.g.
slender structure and corner information) that are easily obscured in other methods. With the continuous development of computer technology
the application of image processing technology has become increasingly widespread in pattern recognition
security monitoring
smart driving
computer photography
and other areas. However
the image quality obtained directly from the image acquisition card is not satisfactory. Therefore
image preprocessing is necessary. Texture filtering is an important step in image preprocessing. The image edge in a texture image is the main component of the image structure. Traditional image filter processing techniques
such as median and Gaussian filtering
can filter noise to a certain extent
but the structure context is also filtered. Therefore
this study investigates how to remove texture and maintain the slender structure context simultaneously.
Method
2
The main idea of the proposed algorithm is to compute the optimal filter scale by leveraging a novel slender structure recognition technique and an improved structure angle relative total variation based on multiple directions and obtain the filtering result through a guided filter. The method consists of four steps. First
to address the deficiency of existing algorithms
this study proposes a method that can identify and enhance slender structures to avoid smoothing them in the subsequent texture filtering process. Second
to estimate the optimal filtering kernel scale of each pixel
the original relative total variation model is improved by searching the minimum relative total variation in multiple directions so that it can distinguish textures and boundaries effectively
and corner information is effectively distinguished from texture. Then
the detected elongated structure is normalized to the improved metric of relative total variation
and the filtered kernel scale is estimated to generate a guided filtered image. Thus
large-scale filtering kernels are used in flat or textured regions
and the filtering kernels are reduced near the edges and corners of the structure. Finally
a texture-removed image is obtained by combining the joint bilateral filters.
Result
2
We evaluate our method on different types of pictures
including mosaics and paintings. Experiments are conducted on a Windows 8.1 operating system
and the proposed method is implemented in MATLAB language. No reasonable quantitative objective evaluation metrics exist in the research field of texture filtering; thus
subjective evaluation by human eyes is commonly used. In the experiments
we compare five existing methods of texture filtering
namely
bilateral texture filtering
rotation guided filtering
relative total variation
scale-sensitive structural protection filtering
and interval gradient operator. Compared with these methods
the proposed algorithm needs a slightly longer computing time. Specifically
for an image with 394×304 pixels
the proposed method consumes 3.37 s
whereas bilateral texture filtering
rotation guided filtering
relative total variation
scale-sensitive structural protection filtering
and interval gradient operator consume 2.23
0.07
0.23
1.01
and 3.29 s
respectively. Our method outperforms these methods in terms of texture removal while maintaining slender structures and corner details. We also analyze the iteration number and parameter value standard deviation (σ) of the proposed algorithm. The comparative experiments demonstrate that with one iteration used to remove texture
the result of our algorithm is better than those of relative total variation and interval gradient operator methods. A large σ is selected when the optimal filter scale is large
and a small σ is equipped when the optimal filter scale is small.
Conclusion
2
The texture filter designed in this study performs well in maintaining features
such as elongated structures and sharp corners in an image after texture removal
thus providing a powerful image preprocessing method for image subsequent processing
including image detail enhancement
edge detection
image abstraction
and image segmentation. For the problem of sharp reduction in the filter kernel scale encountered in the experiment
this study provides a reasonable explanation and solution. The proposed algorithm is limited by its long computing time. In general
the proposed algorithm obtains better results compared with others despite its slightly lower computing time efficiency.
Arnheim R, Chapanis M R, Chapanis A. Art and visual perception. A psychology of the creative eye[J]. Philosophy&Phenomenological Research, 1956, 16(3):425.[DOI:10.2307/2104731]
Tomasi C, Manduchi R. Bilateral filtering for gray and color images[C]//Proceedings of the 6th International Conference on Computer Vision. Bombay, India: IEEE, 1998: 839-846.[ DOI: 10.1109/ICCV.1998.710815 http://dx.doi.org/10.1109/ICCV.1998.710815 ]
Karacan L, Erdem E, Erdem A. Structure-preserving image smoothing via region covariances[J]. ACM Transactions on Graphics (TOG), 2013, 32(6):176.[DOI:10.1145/2508363.2508403]
Zhang Q, Shen X Y, Xu L, et al. Rolling guidance filter[C]//Proceedings of the 13th European Conference on Computer Vision. Zurich, Switzerland: Springer, 2014: 815-830.[ DOI: 10.1007/978-3-319-10578-9_53 http://dx.doi.org/10.1007/978-3-319-10578-9_53 ]
Cho H, Lee H, Kang H, et al. Bilateral texture filtering[J]. ACM Transactions on Graphics (TOG), 2014, 33(4):128.[DOI:10.1145/2601097.2601188]
Lin T H, Way D L, Shih Z C, et al. An efficient structure-aware bilateral texture filtering for image smoothing[J]. Computer Graphics Forum, 2016, 35(7):57-66.[DOI:10.1111/cgf.13003]
Jain P, Tyagi V. An adaptive edge-preserving image denoising technique using tetrolet transforms[J]. The Visual Computer, 2015, 31(5):657-674.[DOI:10.1007/s00371-014-0993-7]
Wang H, Wang Y, Liu C Z, et al. Adaptive scale bilateral texture filtering method[J]. Journal of Computer Applications, 2018, 38(5):1415-1419.
[王辉, 王悦, 刘畅祖, 等.自适应尺度的双边纹理滤波方法[J].计算机应用, 2018, 38(5):1415-1419. [DOI:10.11772/j.issn.1001-9081.2017102589]
Bao L C, Song Y B, Yang Q X, et al. Tree filtering:efficient structure-preserving smoothing with a minimum spanning tree[J]. IEEE Transactions on Image Processing, 2014, 23(2):555-569.[DOI:10.1109/TIP.2013.2291328]
Zhang F H, Dai L Q, Xiang S M, et al. Segment graph based image filtering: fast structure-preserving smoothing[C]//Proceedings of 2015 IEEE International Conference on Computer Vision. Santiago, Chile: IEEE, 2015: 361-369.[ DOI: 10.1109/ICCV.2015.49 http://dx.doi.org/10.1109/ICCV.2015.49 ]
Yu L H, Feng Y Q, Chen W F. Adaptive regularization method based total variational de-noising algorithm[J]. Journal of Image and Graphics, 2009, 14(10):1950-1954.
余丽红, 冯衍秋, 陈武凡.基于自适应正则化的全变分去噪算法[J].中国图象图形学报, 2009, 14(10):1950-1954. [DOI:10.11834/jig.20091004]
Farbman Z, Fattal R, Lischinski D, et al. Edge-preserving decompositions for multi-scale tone and detail manipulation[J]. ACM Transactions on Graphics (TOG), 2008, 27(3):67.[DOI:10.1145/1360612.1360666]
Xu L, Lu C W, Xu Y, et al. Image smoothing via L 0 gradient minimization[J]. ACM Transactions on Graphics (TOG), 2011, 30(6):174.[DOI:10.1145/2070781.2024208]
Xu L, Yan Q, Xia Y, et al. Structure extraction from texture via relative total variation[J]. ACM Transactions on Graphics (TOG), 2012, 31(6):139.[DOI:10.1145/2366145.2366158]
Bhat P, Zitnick C L, Cohen M, et al. GradientShop:a gradient-domain optimization framework for image and video filtering[J]. ACM Transactions on Graphics (TOG), 2010, 29(2):10.[DOI:10.1145/1731047.1731048]
Freeman W T, Adelson E H. The design and use of steerable filters[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1991, 13(9):891-906.[DOI:10.1109/34.93808]
Jeon J, Lee H, Kang H, et al. Scale-aware structure-preserving texture filtering[J]. Computer Graphics Forum, 2016, 35(7):77-86.[DOI:10.1111/cgf.13005]
Lee H, Jeon J, Kim J, et al. Structure-texture decomposition of images with interval gradient[J]. Computer Graphics Forum, 2017, 36(6):262-274.[DOI:10.1111/cgf.12875]
相关文章
相关作者
相关机构
京公网安备11010802024621