浏览全部资源
扫码关注微信
Received：27 July 2017，
Revised：2017-11-8，
Published：16 June 2018
移动端阅览
目的
2
现有的基于邻域嵌入的人脸超分辨率重建算法只利用了低分辨率图像流形空间的几何结构，而忽略了原始高分辨率图像的流形几何结构，不能很好的反映高低分辨率图像流形几何结构的关系。此外，其对同一幅图像中的不同图像块选取固定数目的最近邻域图像块，从而导致重建质量的下降。为了充分利用原始高分辨率图像空间的几何结构信息，提出基于联合局部约束和自适应邻域选择的邻域嵌入人脸超分辨率重建算法。
方法
2
该方法结合待重构图像与低分辨率图像样本库的相似性约束与初始高分辨图像与高分辨率图像样本库的相似性约束，形成约束低分辨率图像块的重构权重，并利用该重构权重估计出高分辨率的人脸图像，同时引入自适应邻域选择的方法。
结果
2
在CAS-PEAL-R1人脸库上的实验结果表明，相较于传统的基于邻域嵌入的人脸超分辨率重建方法，本文算法在PSNR和SSIM上分别提升了0.39 dB和0.02。相较于LSR重建方法，在PSNR和SSIM上分别提升了0.63 dB和0.01；相较于LcR重建方法，在PSNR和SSIM上分别提升了0.36 dB和0.003 2；相较于TRNR重建方法，在PSNR和SSIM上分别提升了0.33 dB和0.001 1。
结论
2
本文所提的重建方法在现有人脸数据库上进行实验，在主观视觉和客观评价指标上均取得了较好的结果，可进一步适用于现实监控视频中人脸图像的高分辨率重建。
Objective
2
Face super-resolution reconstruction is a technique based on an observed low-quality
low-resolution face image. Combined with prior knowledge
which is acquired from learning high- and low-resolution training sample pairs
face super-resolution reconstruction can estimate clear high-resolution face images and increase the resolution of the image to effectively improve the image visual effects. The existing face super-resolution reconstruction algorithm mainly adopts the method of neighborhood embedding
but the traditional reconstruction algorithm based on neighborhood embedding has drawbacks. For example
the algorithm only utilizes the geometric structure of the low-resolution image manifold space while ignoring the manifold geometry of the original high-resolution image
so it cannot effectively reflect the relationship between the high- and low-resolution image manifold geometry. This situation also causes a significant loss in available information of the original high-resolution images and eventually leads to a reconstructed face image with incomplete local details
image blur
and other issues. In addition
the method is based on the image super-resolution reconstruction
where a fixed number of nearest neighborhood image blocks are selected for different image blocks in the same image. Both methods are based on the assumption that the high- and low-resolution image block manifolds have a consistent geometric structure. However
a "one-to-many" correspondence exists between the high-and low-resolution images
and the assumptions of the proposed manifold geometry consistency do not conform to the actual situation. The neighborhood relationship of the low-resolution image obtained after the original image is degraded and cannot truly reflect the neighborhood relationship of the original image
resulting in a decline in the quality of reconstruction. To fully utilize the geometric structure information of the original high-resolution image space
this work proposes a neighborhood embedded face super-resolution reconstruction algorithm based on joint local constraints and adaptive neighborhood selection.
Method
2
To solve the problem caused by the algorithm presented
this work proposes a face super-resolution reconstruction method based on joint local constraint neighbor embedding. The algorithm mainly includes two parts
namely
sample library and match reconstruction. Establishing the sample library mainly involves construction on high-and low-resolution image blocks. When matching the reconstruction process
to better characterize the neighborhood relation of the original image block
this study introduces the following constraints: the distance between the input low-resolution image and the low-resolution sample is taken as one of the constraints
and the distance between the initial high-resolution image obtained by the input low-resolution image interpolation and the high-resolution sample is assumed as another constraint. The neighborhood of the low-resolution image block in the low-resolution image block sample and the initial high-resolution image block in the high-resolution image block sample are used as local constraints to solve the optimal reconstruction weight coefficients. The two constraints are combined to effectively maintain the geometric structure of the image
forming a reconstructed weight coefficient that constrains the low-resolution image block. For each image block obtained from the input low-resolution face image
the optimal reconstruction weight is solved by minimizing the reconstruction error. After determining the optimal weight
the reconstructed high-resolution image block can be obtained by weighted summing and using the weight and the corresponding high-resolution image sample block. Then
the high-resolution face image is estimated by using the reconstructed weight. At the same time
the method of adaptive neighborhood selection is introduced.
Result
2
In this study
the experiment is conducted on the CAS-PEAL-R1 face database
and the proposed reconstruction algorithm is compared with the relatively advanced face super-resolution reconstruction algorithm to verify the effectiveness of the algorithm. Furthermore
the subjective image of the experimental results is given
and the image quality of the reconstructed results of different methods is evaluated by the peak signal-to-noise ratio (PSNR) and structural similarity (SSIM). The experimental results show that
compared with the traditional face super-resolution reconstruction method based on neighborhood embedding
the subject image obtained by the proposed algorithm has more details on facial features and is more similar to the original high-resolution face image. Moreover
the contrast of the objective indicators
which were raised to 0.39 and 0.02 dB in the PSNR and SSIM
respectively
shows the superiority of the algorithm. Compared with the indicators for the LSR reconstruction method
the PSNR and SSIM were improved by 0.63 dB and 0.01
respectively. Compared with the indicators for the LCR reconstruction method
the PSNR and SSIM were improved by 0.36 dB and 0.003 2
respectively. Compared with the indicators for the TRNR reconstruction method
the PSNR and SSIM were improved by 0.33 dB and 0.001 1
respectively.
Conclusion
2
The reconstruction method described in this study is conducted on the existing face database. The facial image is unified and segmented through the experiment to determine the optimal experimental parameters
while ignoring the location information of the facial features. Compared with the indicators of other algorithms
the subjective visual and objective evaluation indicators of the proposed algorithm achieved good results
which can be further applied to a real surveillance video with high-resolution image reconstruction. Combined with the location information of facial features and a reasonable segmentation of human face images
the full use of the prior structure of face images for super-resolution reconstruction is a future research direction.
Zhao J J, Fang Q, Liang Z C, et al. Sketch face recognition based on super-resolution reconstruction[J]. Journal of Image and Graphics, 2016, 21(2):218-224.
赵京晶, 方琪, 梁植程, 等.超分辨率重建的素描人脸识别[J].中国图象图形学报, 2016, 21(2):218-224. [DOI:10.11834/jig.20160211]
Zhao L, Qi X B, Li X M. A single frame super resolution algorithm based on fusion of regression function and local self-similarity[J]. Computermeasurement&control, 2016, 24(4):181-184.
赵丽, 齐兴斌, 李雪梅.基于回归函数结合局部自相似的单帧图像超分辨率算法[J].计算机测量与控制, 2016, 24(4):181-184. [DOI:10.16526/j.cnki.11-4762/tp.2016.04.053]
Freeman W T, Jones T R, Pasztor E C. Example-based super-resolution[J]. IEEE Computer Graphics and Applications, 2002, 22(2):56-65.[DOI:10.1109/38.988747]
Chakrabarti A, Rajagopalan A N, Chellappa R. Super-resolution of face images using kernel PCA-based prior[J]. IEEE Transactions on Multimedia, 2007, 9(4):888-892.[DOI:10.1109/TMM.2007.893346]
Jiang J J, Ma X, Cai Z H, et al. Sparse support regression for imagesuper-resolution[J]. IEEE Photonics Journal, 2015, 7(5):#6901211.[DOI:10.1109/JPHOT.2015.2484287]
Wang X G, Tang X O. Hallucinating face by eigentransformation[J]. IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews), 2005, 35(3):425-434.[DOI:10.1109/TSMCC.2005.848171]
Huang H, He H T, Fan X. Super-resolution of human face image using canonical correlation analysis[J]. Pattern Recognition, 2010, 43(7):2532-2543.[DOI:10.1016/j.patcog.2010.02.007].
Zhuang Y T, Zhang J, Wu F. Hallucinating faces:LPH super-resolution and neighbor reconstruction for residue compensation[J]. Pattern Recognition, 2007, 40(11):3178-3194.[DOI:10.1016/j.patcog.2007.03.011]
Huang H, Wu N, Fan X, et al. Face image super resolution by linear transformation[C]//Proceedings of 2010 IEEE International Conference on Image Processing. Hong Kong, China: IEEE, 2010: 913-916. [ DOI:10.1109/ICIP.2010.5651255 http://dx.doi.org/10.1109/ICIP.2010.5651255 ]
Chang H, Yeung D Y, Xiong Y M. Super-resolution through neighbor embedding[C]//Proceedings of 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. Washington, USA: IEEE, 2004: 275-282. [ DOI:10.1109/CVPR.2004.1315043 http://dx.doi.org/10.1109/CVPR.2004.1315043 ]
Ferreira J C, Vural E, Guillemot C. Geometry-aware neighborhood search for learning local models for image superresolution[J]. IEEE Transactions on Image Processing, 2016, 25(3):1354-1367.[DOI:10.1109/TIP.2016.2522303]
Yan Q, Xu Y, Yang X K, et al. Single image superresolution based on gradient profile sharpness[J]. IEEE Transactions on Image Processing, 2015, 24(10):3187-3202.[DOI:10.1109/TIP.2015.2414877]
Ma X, Zhang J P, Qi C. Hallucinating face by position-patch[J]. Pattern Recognition, 2010, 43(6):2224-2236.[DOI:10.1016/j.patcog.2009.12.019]
Jiang J J, Hu R M, Wang Z Y, et al. Noise robust face hallucination via locality-constrained representation[J]. IEEE Transactions on Multimedia, 2014, 16(5):1268-1281.[DOI:10.1109/TMM.2014.2311320]
Jiang J J, Chen C, Huang K B, et al. Noise robust position-patch based face super-resolution via Tikhonov regularized neighbor representation[J]. Information Sciences, 2016, 367-368:354-372.[DOI:10.1016/j.ins.2016.05.032]
Ma J Y, Zhou H B, Zhao J, et al. Robust feature matching for remote sensing image registration via locally linear transforming[J]. IEEE Transactions on Geoscience and Remote Sensing, 2015, 53(12):6469-6481.[DOI:10.1109/TGRS.2015.2441954]
Thomaz C E, Giraldi G A. A new ranking method for principal components analysis and its application to face image analysis[J]. Image and Vision Computing, 2010, 28(6):902-913.[DOI:10.1016/j.imavis.2009.11.005]
相关文章
相关作者
相关机构
京公网安备11010802024621
