国画的艺术目标分割及深度学习与分类
Learning artistic objects for improved classification of Chinese paintings
- 2018年23卷第8期 页码:1193-1206
收稿:2017-10-25,
修回:2018-3-7,
纸质出版:2018-08-16
DOI: 10.11834/jig.170545
移动端阅览

浏览全部资源
扫码关注微信
收稿:2017-10-25,
修回:2018-3-7,
纸质出版:2018-08-16
移动端阅览
目的
2
现有对艺术画进行分类的文献大多对整幅画作直接进行特征提取,但任何图像内容特征的可适应性都存在一定的局限性。画家画不同艺术目标的笔锋和艺术处理往往是不同的,如果不考虑每个笔锋所产生的条件而一味地分析笔锋的走向和力度分布等将会是很盲目的。为此提出一种基于艺术目标的中国画分类算法。
方法
2
首先,基于简单线性迭代聚类算法根据像素间颜色和位置的相差程度来生成超像素;其次,提出针对艺术目标的最大相似度区域合并算法交互式地进行艺术目标分割,将国画分割成一系列的艺术目标,如马、人物等,以提取画家用来表现艺术形式和抒发情感的相对稳定单元;然后利用深度卷积神经网络(O-CNN)来描述这些艺术目标的高级语义特征;最后,引入支持向量机对每幅中国画内的各种艺术目标的分类结果进行最后的融合与分类。
结果
2
本文针对艺术目标进行国画的学习和分类,实现了对样本库中10位画家中国画的识别,平均准确率为89%。实验结果表明,本文算法在平均查全率和查准率上优于现有的MHMM(The 2D multi-resolution hidden Markov model)和Fusion等方法。
结论
2
本文的成果可用于中国画的数字化分析、管理、理解和识别,为中国画传承和鉴赏提供有效的数字工具。
Objective
2
Presently
existing research on art classification is primarily based on feature extraction and hence feature-based classification. Although such feature-based methods reported in the literature achieve a certain level of success
a major weakness lies in the considerable dependence of classification performances on the effectiveness of the features in describing the content of Chinese paintings. Given that traditional Chinese artists tend to rely on popular objects
such as figures
trees
flowers
birds
mountains
horses
and houses to express their artistic feelings and emotions
we explore a new concept of artistic object-based approach to classify traditional Chinese paintings in this study. In this way
automated classification can be integrated with perception
understanding
and interpretation of artistic expressions and emotions via the segmented artistic objects. Such an approach also possibly enables our proposed methods to be further developed into an interactive object-based classification approach for other forms of paintings. In comparison with the existing state of the arts
one advantage of our proposed approach over those based on features or content is that objects provide direct and integrated art expressions inside paintings.
Method
2
Our proposed method includes three stages of processing and analytics for traditional Chinese paintings
that is
1) interactive art object segmentation; 2) description and characterization of art objects via convolution neural network (CNN)
the most popular deep learning unit; and 3) SVM-based classification and fusion across all art objects. Specifically
via an iterative linear clustering algorithm
super-pixels are constructed to detect the difference between the color and position of each individual pixel. By maximizing the similarity within the neighborhood of those super-pixels
a sequence of objects can be segmented
and an interactive scheme can be designed
allowing users to add
revise
and interact with the content of paintings to achieve the best possible balance between subjective demand and objective art description. Afterward
a CNN-based deep learning unit is added to describe those objects
so its classification can be carried out with regard to the individual art object. Finally
an SVM unit is adopted to achieve the final fusion of all these classifications via consideration of each individual object within the given window
which is influenced and initialized through the training process.
Result
2
Extensive experiments are carried out
which are in four phases
each of which considers one impact factor
such as consideration of the number of artists
comparison with the existing state of the arts
consideration of benchmarking via content-based classifications
and assessment of contributions from CNN alone. Experimental results show that our proposed algorithm:1) outperforms several existing representative approaches
including MHMM and fusion-based method
2) achieves effective fusion of all different object classifications
including CNN and SVM units
3) captures the artistic emotions through those segmented art objects
and 4) shows potential for interactive classification of Chinese paintings via segmentation of artistic objects.
Conclusion
2
This study proposes the computerized classification and recognition of art styles based on artistic objects in paintings rather than the whole paintings. Experimental results reveal that the proposed algorithm outperforms the existing representative benchmarks
providing potential for developing effective digital tools for computerized management of Chinese paintings. In addition
this method can be used to formulate an important tool for computerized management of Chinese traditional paintings
providing a range of techniques for effective and efficient digitization
manipulation
understanding
perception
and interpretation of Chinese traditional arts as well as its legacy.
Qian W H, Xu D, Guan Z, et al. Simulating chalk art style painting[J]. Journal of Image and Graphics, 2017, 22(5):622-630.
钱文华, 徐丹, 官铮, 等.粉笔画艺术风格模拟[J].中国图象图形学报, 2017, 22(5):622-630. [DOI:10.1142/S0218001417590261]
Sheng J C, Jiang J M. Recognition of Chinese artists via windowed and entropy balanced fusion in classification of their authored ink and wash paintings (IWPs)[J]. Pattern Recognition, 2014, 47(2):612-622.[DOI:10.1016/j.patcog.2013.08.017]
Sheng J C. Automatic categorization of traditional Chinese paintings based on wavelet transform[J]. Computer Science, 2014, 41(2):317-319.
盛家川.基于小波变换的国画特征提取及分类[J].计算机科学, 2014, 41(2):317-319. [DOI:10.3969/j.issn.1002-137X.2014.02.069]
Li J, Wang J Z. Studying digital imagery of ancient paintings by mixtures of stochastic models[J]. IEEE Transactions on Image Processing, 2004, 13(3):340-353.[DOI:10.1109/TIP.2003.821349]
Jiang S Q, Huang Q M, Ye Q X, et al. An effective method to detect and categorize digitized traditional Chinese paintings[J]. Pattern Recognition Letters, 2006, 27(7):734-746.[DOI:10.1016/j.patrec.2005.10.017]
Sun M J, Zhang D, Wang Z, et al. Monte Carlo convex hull model for classification of traditional Chinese paintings[J]. Neurocomputing, 2016, 171:788-797.[DOI:10.1016/j.neucom.2015.08.013]
Wang Z, Sun M J, Han Y H, et al. Supervised heterogeneous sparse feature selection for Chinese paintings classification[J]. Journal of Computer-Aided Design&Computer Graphics, 2013, 25(12):1848-1855.
王征, 孙美君, 韩亚洪, 等.监督式异构稀疏特征选择的国画分类和预测[J].计算机辅助设计与图形学学报, 2013, 25(12):1848-1855.
Guo F, Peng H, Tang J. A novel method of converting photograph into Chinese ink painting[J]. IEEJ Transactions on Electrical and Electronic Engineering, 2015, 10(3):320-329.[DOI:10.1002/tee.22088]
Liu J A, The Palace Museum. Image Catalog of Authenticity Identification for Chinese Paintings and Calligraphy[M]. Beijing:Forbidden City Press, 2013:1-360.
刘九庵, 故宫博物院.中国历代书画真伪对照图录[M].北京:故宫出版社, 2013:1-360.
Guo X G. Judging Arts by Xiaoguang[M]. Beijing:China Renmin University Press, 2014:10-77.
郭晓光.晓光鉴画[M].北京:中国人民大学出版社, 2014:10-77.
Song X Y, Zhou L L, Li Z G, et al. Review on superpixel methods in image segmentation[J]. Journal of Image and Graphics, 2015, 20(5):599-608.
宋熙煜, 周利莉, 李中国, 等.图像分割中的超像素方法研究综述[J].中国图象图形学报, 2015, 20(5):599-608. [DOI:10.11834/jig.20150502]
Moore A P, Prince S J D, Warrell J, et al. Superpixel lattices[C ] //Proceedings of IEEE Conference on Computer Vision and Pattern Recognition. Anchorage, Alaska, USA: IEEE, 2008: 1-8. [ DOI: 10.1109/CVPR.2008.4587471 http://dx.doi.org/10.1109/CVPR.2008.4587471 ]
Felzenszwalb P F, Huttenlocher D P. Efficient graph-based image segmentation[J]. International Journal of Computer Vision, 2004, 59(2):167-181.[DOI:10.1023/B:VISI.0000022288.19776.77]
Shi J B, Malik J. Normalized cuts and image segmentation[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2000, 22(8):888-905.[DOI:10.1109/34.868688]
Li H Y, W S P. Parallelization of Mean Shift image segmentation algorithm[J]. Journal of Image and Graphics, 2013, 18(12):1610-1619.
李宏益, 吴素萍. Mean Shift图像分割算法的并行化[J].中国图象图形学报, 2013, 18(12):1610-1619. [DOI:10.11834/jig.20131209]
Levinshtein A, Stere A, Kutulakos K N, et al. TurboPixels:fast superpixels using geometric flows[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2009, 31(12):2290-2297.[DOI:10.1109/TPAMI.2009.96]
Achanta R, Shaji A, Smith K, et al. SLIC superpixels compared to state-of-the-art superpixel methods[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2012, 34(11):2274-2282.[DOI:10.1109/TPAMI.2012.120]
Yang D X. Authenticity Identification of Chinese Paintings and Calligraphy[M]. 3rd ed. Shenyang:Liaoning People's Publishing House, 2016:149-196.
杨丹霞.中国书画真伪识别[M]. 3版.沈阳:辽宁人民出版社, 2016:149-196.
Meyer F, Beucher S. Morphological segmentation[J]. Journal of Visual Communication and Image Representation, 1990, 1(1):21-46.[DOI:10.1016/1047-3203(90)90014-M]
Schmidhuber J. Deep learning in neural networks:an overview[J]. NeuralNetworks, 2015, 61:85-117.[DOI:10.1016/j.neunet.2014.09.003]
Zhang X P, Xiong H K, Zhou W G, et al. Picking deep filter responses for fine-grained image recognition[C ] //Proceedings of IEEE Conference on Computer Vision and Pattern Recognition. Las Vegas, NV, USA: IEEE, 2016: 1134-1142. [ DOI: 10.1109/CVPR.2016.128 http://dx.doi.org/10.1109/CVPR.2016.128 ]
Liu J, Gao C Q, Meng D Y, et al. Two-stream contextualized CNN for fine-grained image classification[C]//Proceedings of the 30th AAAI Conference on Artificial Intelligence. Phoenix, Arizona, USA: AAAI Press, 2016: 4232-4233.
He X T, Peng Y X. Fine-grained image classification via combining vision and language[C ] //Proceedings of IEEE Conference on Computer Vision and Pattern Recognition. Honolulu, HI, USA: IEEE, 2017: 7332-7340. [ DOI: 10.1109/CVPR.2017.775 http://dx.doi.org/10.1109/CVPR.2017.775 ]
Feng Y S, Wang Z L. Fine-grained image categorization with segmentation based on top-down attention map[J]. Journal of Image and Graphics, 2016, 21(9):1147-1154.
冯语姗, 王子磊.自上而下注意图分割的细粒度图像分类[J].中国图象图形学报, 2016, 21(9):1147-1154.[DOI:10.11834/jig.20160904]
Chatfield K, Simonyan K, Vedaldi A, et al. Return of the devil in the details: delving deep into convolutional nets[C ] //Proceedings of the British Machine Vision Conference. London, UK: BMVA Press, 2014: 1-12. [ DOI: 10.5244/C.28.6 http://dx.doi.org/10.5244/C.28.6 ]
相关作者
相关机构
京公网安备11010802024621