浏览全部资源
扫码关注微信
纸质出版日期： 2023-10-16 ，
移动端阅览
肖照林， 孙彤鑫， 张晶瑞， 金海燕. 2023. 油画相似度的表面光场特征点分布鉴别. 中国图象图形学报， 28(10):3123-3135
Xiao Zhaolin， Sun Tongxin， Zhang Jingrui， Jin Haiyan. 2023. Feature point distribution of the surface light field-measured oil painting similarity identification. Journal of Image and Graphics， 28(10):3123-3135
目的
2
油画区别于其他绘画形式的重要特征之一是其颜料图层存在厚度变化。因此，油画相似度鉴别不仅关注油画的纹理色彩细节，也需考虑其表面颜料厚度的差异。针对颜料厚度的细微变化，提出一种油画相似度的表面光场特征点分布鉴别方法。采用光场成像技术观测由于油画表面厚度起伏导致的不同角度成像的差异，以量化计算油画表面光场的相似性。
方法
2
该方法采用一块微透镜阵列板对油画表面的角度域变化进行光场编码，利用光场相机采集编码后的油画表面光场。在此基础上，选取油画表面光场中角度域差异大的特征点集合，采用K-Means方法对该特征点集合的二维分布进行多边形向量化描述。进而提出计算关键点连接线的欧氏距离与线段夹角，以度量表面光场特征点分布多边形的相似性。
结果
2
采用Illum光场相机拍摄了多组真实油画的表面光场实验数据，实验结果表明本文方法可对存在细微颜料厚度差别的油画相似度进行鉴别。在对油画表面光场的识别区分度以及检测精度方面，本文方法显著优于现有图像特征匹配鉴别方法。
结论
2
实验分析表明，相比于经典交并比及相似度系数，所提出油画相似性度量具有更优的相似性度量精度。通过调整编码板与测试油画表面距离的反复实验，验证所提方法能够有效检测0.5 mm以上厚度变化的表面光场差异。
Objective
2
Painting-specific layer thickness variation of oil painting can be used to reflect the shape， depth， and texture of the painted objects. Since the layer thickness is not be replicated easily， it is beneficial to identify the similarity between two sort of oil paintings. Thanks to its layer thickness， the surface of an oil painting will theoretically appear non-Lambertian feature， i.e.， the reflectance light of a targeted point will have obvious variation at a different angle. This kind of non-Lambertian feature is beneficial for oil painting identification. However， since the thickness variation of the oil painting surface is often less than 1mm， this sort of non-Lambertian effect is illustrated as a stronger weakness and it is still challenging to be captured using a traditional camera， even though for its higher spatial resolution there. To identify the weak angular variation better， we develop a compact plenoptic camera-based acquisition system further for capturing the oil painting surface. We facilitate a surface light field of the target oil paintings using a micro-lens array， which amplifies the non-Lambertian feature. It can activate sensitive identification of the oil painting in a non-contactable measurement.
Method
2
First， a surface light field is constructed via a micro-lens array in front of the oil painting surface at a distance of one focal length of the elemental micro-lens. In this case， the non-Lambertian effect of an oil painting can be significantly amplified based on the micro-lens array. Then， a compactable light field camera is used to capture a surface light field of the painting at 0.2 m away. A captured light field is composed of multiple angular samples （i.e.， the sub-aperture images）， which can refer to the speciality of the painting surfaces. For surface thickness variation， the angular samples of the captured light field are distributed deliberately， especially for some angular variation sensitive feature points. Therefore， this kind of non-Lambertian feature can be calculated to identify oil painting similarities. A theoretical analysis is used to demonstrate the optical path design of this amplification of angular differences. After capturing the surface light fields rather than applying the feature points matching， we try to measure the similarity of oil painting surfaces using a multiple angular views-derived polygonal similarity computation. The similarity metric is proposed， and the global distribution of those large angular variational feature points is concerned about simultaneously. The feature points are detected and gathered using the K-Means clustering. The
K
central points-related polygon can represent the spatial geometrical distribution for the surface-related undulation， which can be treated as a unique pattern for a given oil painting. Compared to feature point extraction and matching based schemes， the proposed similarity metric is more robust to image noises and feature point outliers.
Result
2
In the experiments， an oil painting surface light field generation and acquisition system is built up via such multiple tools like an Illum light field camera， a micro-lens array board， a step-motor translation stage， a positioner， a motion controller， and illumination devices. The surface light fields of some real world oil paintings are generated and captured using the proposed acquisition system. The proposed solution has its potential to clarify slight differences in the thickness of these samples to some extent. It is verified that the proposed solution can be used to detect the surface light field variation through multiple experiments， and micro-lens array and the target oil painting surface-between distance adjustment， in which surface undulation is greater than 0.5 mm. The proposed surface light field similarity metric is recognized to measure the region’s geometrical shape similarity. Comparative analysis is also carried out with scale-invariant feature transform （SIFT）， light field features （LiFF）， and Fourier disparity layer-based Harris-SIFT feature （FDL-HSIFT） feature extraction and its contexts. We also analyze the similarity of the computation results in terms of a different number of the K-Means centers. The results demonstrate that a feasible parameter
K
is essential for the distinguishability of the polygonal computation-based similarity metric
.
Since the surface light field capturing system is constructed based on a micro-lens array， the back-end capturing camera can be placed in front of the micro-lens array in a limited range only.
Conclusion
2
The surface light field generation and acquisition system is illustrated and demonstrated in oil painting identification. The proposed solution of surface light field feature extraction and polygonal similarity computation can be optimized in terms of its distinguishability. Additionally， the surface light field capturing system can be further optimized through illumination optimization and more accurate fixtures-added application. It can be extended to detect the variations of other related types of non-Lambertian surfaces to a certain extent.
表面光场油画鉴别光场特征相似度计算特征点提取
surface light fieldoil painting identificationlight field featuresimilarity computationfeature extraction
Bock H H. 2007. Clustering methods： a history of K-Means algorithms//Brito P， Cucumel G， Bertrand P and Carvalho F， eds. Selected Contributions in Data Analysis and Classification. Berlin， Heidelberg： Springer： 161-172 ［DOI： 10.1007/978-3-540-73560-1_15http://dx.doi.org/10.1007/978-3-540-73560-1_15］
Chao Y. Identification of renaissance oil paintings by laser methods ［J］. Advances in Lasers and Optoelectronics， 2007， 44（4）：14-14
朝阳.激光手段鉴定文艺复兴时期油画［J］.激光与光电子学进展， 2007， 44（4）：14-14
Claudia Lorenz-Lansberg. 2016. Neutron autoradiography detection in Rembrandt’s oil paintings. National Art Museum of China， （5）： 40-42
克劳迪娅·劳伦兹-兰斯伯格. 2016. 伦勃朗油画中的中子放射自显影检测研究. 中国美术馆， （5）： 40-42
Dansereau D G， Girod B and Wetzstein G. 2019. LiFF： light field features in scale and depth//Proceedings of 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition. Long Beach， USA： IEEE： 8034-8043 ［DOI： 10.1109/CVPR.2019.00823http://dx.doi.org/10.1109/CVPR.2019.00823］
Dansereau D G， Pizarro O and Williams S B. 2013. Decoding， calibration and rectification for lenselet-based plenoptic cameras//Proceedings of 2013 IEEE Conference on Computer Vision and Pattern Recognition. Portland， USA： IEEE： 1027-1034 ［DOI： 10.1109/CVPR.2013.137http://dx.doi.org/10.1109/CVPR.2013.137］
Fachada S， Bonatto D， Teratani M and Lafruit G. 2021. Light field rendering for non-lambertian objects. Electronic Imaging， 33（2）： 54-1-54-8 ［DOI： 10.2352/ISSN.2470-1173.2021.2.SDA-054http://dx.doi.org/10.2352/ISSN.2470-1173.2021.2.SDA-054］
Gershun A. 1939. The light field. Journal of Mathematics and Physics， 18（1/4）： 51-151 ［DOI： 10.1002/sapm193918151http://dx.doi.org/10.1002/sapm193918151］
Han F. 2007. How to identify chinese oil paintings. Art Market， （1）： 116-117
寒风. 2007. 如何鉴别中国油画. 艺术市场， （1）： 116-117
Jachnik J， Newcombe R A and Davison A J. 2012. Real-time surface light-field capture for augmentation of planar specular surfaces//Proceedings of 2012 IEEE International Symposium on Mixed and Augmented Reality （ISMAR）. Atlanta， USA： IEEE： 91-97 ［DOI： 10.1109/ISMAR.2012.6402544http://dx.doi.org/10.1109/ISMAR.2012.6402544］
Levoy M and Hanrahan P. 1996. Light field rendering//Proceedings of the 23rd Annual Conference on Computer Graphics and Interactive Techniques. New York， USA： ACM： 31-42 ［DOI： 10.1145/237170.237199http://dx.doi.org/10.1145/237170.237199］
Li K Y， Zhang J， Gao J and Qi M B. 2021. Self-supervised light field depth estimation using epipolar plane images//Proceedings of 2021 International Conference on 3D Vision （3DV）. London， UK： IEEE： 731-740 ［DOI： 10.1109/3DV53792.2021.00082http://dx.doi.org/10.1109/3DV53792.2021.00082］
Li W， Qiao H， Zhao C， Wu Z Q and Yang R G. 2018. Robust surface light field modeling//Proceedings of 2018 IEEE Conference on Multimedia Information Processing and Retrieval （MIPR）. Miami， USA： IEEE： 321-327 ［DOI： 10.1109/MIPR.2018.00073http://dx.doi.org/10.1109/MIPR.2018.00073］
Liang C K， Shih Y C and Chen H H. 2011. Light field analysis for modeling image formation. IEEE Transactions on Image Processing， 20（2）： 446-460 ［DOI： 10.1109/TIP.2010.2063036http://dx.doi.org/10.1109/TIP.2010.2063036］
Liu Y M， Zhang J， Zhang X D， Sun R and Gao J. 2020. Review of saliency detection on light fields. Journal of Image and Graphics， 25（12）： 2465-2483
刘亚美， 张骏， 张旭东， 孙锐， 高隽. 2020. 光场显著性检测研究综述. 中国图象图形学报， 25（12）： 2465-2483 ［DOI： 10.11834/jig.190679http://dx.doi.org/10.11834/jig.190679］
Lowe D G. 2004. Distinctive image features from scale-invariant keypoints. International Journal of Computer Vision， 60（2）： 91-110 ［DOI： 10.1023/B：VISI.0000029664.99615.94http://dx.doi.org/10.1023/B：VISI.0000029664.99615.94］
Miandji E， Kronander J and Unger J. 2011. Geometry independent surface light fields for real time rendering of precomputed global illumination//SIGRAD 2011. Stockholm， Sweden： ［s.n.］： 27-34
Ng R. 2006. Digital Light Field Photography. Stanford， USA： Stanford University
Ng R， Levoy M， Brédif M， Duval G， Horowitz M and Hanrahan P. 2005. Light Field Photography with a Hand-Held Plenoptic Camera Stanford， USA： Stanford University
Oechsle M， Niemeyer M， Reiser C， Mescheder L， Strauss T and Geiger A. 2020. Learning implicit surface light fields//Proceedings of 2020 International Conference on 3D Vision （3DV）. Fukuoka， Japan： IEEE： 452-462 ［DOI： 10.1109/3DV50981.2020.00055http://dx.doi.org/10.1109/3DV50981.2020.00055］
Qi S， Sang X Z， Yan B B， Chen D， Wang P， Wang H C and Ye X Q. 2022. Virtual view synthesis for 3D light-field display based on feature reprojection and fusion. Optics Communications， 519： #128383 ［DOI： 10.1016/j.optcom.2022.128383http://dx.doi.org/10.1016/j.optcom.2022.128383］
Su X W. 2020. Research on oil painting authenticity identification technology based on intelligent vision. Modern Electronics Technique， 43（5）： 61-64
苏雪薇. 2020. 基于智能视觉的油画真伪鉴定技术研究. 现代电子技术， 43（5）： 61-64 ［DOI： 10.16652/j.issn.1004-373x.2020.05.014http://dx.doi.org/10.16652/j.issn.1004-373x.2020.05.014］
Teixeira J A， Brites C， Pereira F and Ascenso J. 2017. Epipolar based light field key-location detector//Proceedings of the 19th IEEE International Workshop on Multimedia Signal Processing （MMSP）. Luton， UK： IEEE： 1-6 ［DOI： 10.1109/MMSP.2017.8122259http://dx.doi.org/10.1109/MMSP.2017.8122259］
Traxler L， Ginner L， Breuss S and Blaschitz B. 2021. Experimental comparison of optical inline 3D measurement and inspection systems. IEEE Access， 9： 53952-53963 ［DOI： 10.1109/ACCESS.2021.3070381http://dx.doi.org/10.1109/ACCESS.2021.3070381］
Tsai D， Dansereau D G， Peynot T and Corke P. 2019. Distinguishing refracted features using light field cameras with application to structure from motion. IEEE Robotics and Automation Letters， 4（2）： 177-184 ［DOI： 10.1109/LRA.2018.2884765http://dx.doi.org/10.1109/LRA.2018.2884765］
Wang Q. 2015. Based on Image Recognition Painting of Authenticity Identification Research. Xi’an： Xi’an University of Architecture and Technology
王倩. 2015. 基于图像识别的油画真伪鉴别方法研究. 西安： 西安建筑科技大学
Widjaja I， Leow W K and Wu F C. 2003. Identifying painters from color profiles of skin patches in painting images//Proceedings of 2003 International Conference on Image Processing. Barcelona， Spain： IEEE： #1247095 ［DOI： 10.1109/ICIP.2003.1247095http://dx.doi.org/10.1109/ICIP.2003.1247095］
Wood D N， Azuma D I， Aldinger K， Curless B， Duchamp T， Salesin D H and Stuetzle W. 2000. Surface light fields for 3D photography//Proceedings of the 27th Annual Conference on Computer Graphics and Interactive Techniques. New York， USA： ACM： 287-296 ［DOI： 10.1145/344779.344925http://dx.doi.org/10.1145/344779.344925］
Xiao Z L， Zhang M， Jin H Y and Guillemot C. 2021. A light field FDL-HSIFT feature in scale-disparity space//Proceedings of 2021 IEEE International Conference on Image Processing （ICIP）. Anchorage， USA： IEEE： 1549-1553 ［DOI： 10.1109/ICIP42928.2021.9506361http://dx.doi.org/10.1109/ICIP42928.2021.9506361］
Yu X J. 2021. Research on oil painting image extraction and identification method based on intelligent vision. Converter， 2021（2）： 742-749 ［DOI： 10.17762/converter.254http://dx.doi.org/10.17762/converter.254］
Zhou P Y， Kong L B， Sun X and Xu M. 2020. Three-dimensional measurement of specular surfaces based on the light field. IEEE Photonics Journal， 12（5）： #6901613 ［DOI： 10.1109/JPHOT.2020.3022923http://dx.doi.org/10.1109/JPHOT.2020.3022923］
相关文章
相关作者
相关机构
京公网安备11010802024621