浏览全部资源
扫码关注微信
纸质出版日期： 2022-01-16 ，
录用日期： 2021-09-23
移动端阅览
王翌妃, 周杨铭, 钱振兴, 李晟, 张新鹏. 鲁棒视频水印研究进展[J]. 中国图象图形学报, 2022,27(1):27-42.
Yifei Wang, Yangming Zhou, Zhenxing Qian, Sheng Li, Xinpeng Zhang. Review of robust video watermarking[J]. Journal of Image and Graphics, 2022,27(1):27-42.
数字视频在当前通信世界中被认为是一种重要而有效的媒体，广泛应用于新闻、短视频和有线网络广播视频节目中。随着计算机与互联网技术的发展，数字视频内容容易被侵权使用者肆意复制和传播，如何保护视频版权日益成为人们关注的问题。鲁棒视频水印是实现视频版权保护的一种有效手段。作为数字视频水印的分支，鲁棒视频水印是一种通过特定算法在需要被保护的视频对象中嵌入秘密信息——水印来证明版权归属的技术。本文对当前的视频水印技术进行了概述，对视频水印的概念、应用场景、分类方式、设计要求、发展历程和相关经典方法进行了介绍和梳理。本文归纳总结了2016—2021年鲁棒视频水印相关研究工作，包括基于内容的、基于码流的、基于深度学习和其他类型视频水印，并对其中部分工作进行了相应的性能比较和分析。其中，基于内容的视频水印方法将视频看做帧序列，由于在每一帧上应用水印算法，不考虑视频的编解码过程，这类方法实现简单，计算效率高；基于码流的视频水印方法将水印嵌入到编码比特流中，该方案更快速，故可支持实时视频水印应用；基于深度学习的方法取代了依靠手工设计的特征来提高水印的性能。最后分析了鲁棒视频水印的未来发展趋势。
Digital video is an essential effective medium in the communication world nowadays. It is widely used in news
short video and cable network broadcast video programs. Digital video content is easily copied and spread for infringing users
which makes the digital video face severe privacy difficulties. Video copyright has been concerned consistently. In order to protect and claim video ownership
robust video watermarking is one of the important techniques. As a branch of digital video watermarking
robust video watermarking is a technology to authorize copyright ownership. Embedding secret information into the video object needs to be protected by a specific algorithm. This article shows an overview of video watermarking technology. The application scenarios of different types of video watermarking are introduced
including copyright protection
content protection
content authentication
content filtering
broadcast monitoring and online search overall. The classification methods of video watermarking is illustrated
which can be classified based on watermarking attributes and carrier objects. The main properties of watermarking have been embedding capacity
perceptibility
and robustness. In accordance with the existence of embedding capacity
video watermarking can be divided into zero watermarking and non-zero watermarking. Video watermarking can be divided into visible and invisible watermarking in terms of its perceptibility. Video watermarking can be divided into robust video watermarking
semi-fragile video watermarking
and fragile video watermarking via the robustness. Carrier video formats has mainly evolved 2D video
3D video and virtual reality(VR) video
among which 2D video is the mainstream video format at present. 2D video watermarking can be further classified based on embedding method and extraction method
in which the embedding method can be divided into content-based video watermarking and bit stream-based video watermarking
and the extraction method can be divided into non-blind extraction
blind detection and semi-blind extraction.Moreover
this paper classifies classical video watermarking methods and video watermarking methods that have emerged in the past five years. A content-based and a bitstream-based perspective have been summarized each. Content-based video watermarking has treated video as a collection of images and watermarking application algorithm on each frame. This simplified method is easy to implement costly. Bitstream-based video watermarking embeds copyright information into video in video encoding and decoding process. Since the embedding process of this type of scheme can run in parallel with the video encoding and decoding process
this scheme is faster and more practical than content-based method. As a consequence
it supports real-time video watermarking applications. In the past five years
researchers have proposed video watermarking schemes based on deep learning and video watermarking methods for new video carriers such as 3D and VR. Among them
the video watermarking scheme based on deep learning replaces hand-designed features to improve the performance of video watermarking scheme. The sequential HiDDeN and StegaStamp data sets have been proposed in the intial stage The current deep learning-based video watermarking methods are all content-based watermarking and have not been developed to bitstream-based watermarking yet. In addition
the types of attacks can be resisted via the video watermarking deep learning method at the early stage. According to the two representations of 3D video
3D video watermarking is divided into watermarking based on stereo imaging and watermarking based on depth image based rendering(DIBR). The designation of DIBR-based 3D video watermarking not only needs to meet the requirements of 2D video watermarking such as robustness and imperceptibility
but also needs to meet the robustness of the DIBR process. Subsequently
this paper makes a classification and comparative analysis of the video watermarking methods that have emerged in the past five years. The performance of video watermarking scheme is evaluated from the two perspectives of video quality and robustness. The video quality evaluation indices include peak signal to noise ratio(PSNR) and structural similarity index(SSIM) and the robustness evaluation indices include bit error rate(BER)
mean opinion score(MOS)
and false negative rate(FNR). The relationship between performance of video watermarking and different evaluation index value is not same. The larger the PSNR value is
the higher the visual quality of the video produced. The smaller the BER value is
better robustness of the scheme gained. The larger the normalized cross correlation(NCC)value is
the better the robustness of the scheme formed. The capability of each method has been listed to resist various types of attacks more intuitively in the form of a table. Based on comparative analysis
it is concluded that the robustness against temporal synchronization attacks such as frame deleting
frame averaging
frame inserting
and frame rate conversion in the context of embedded frames issue. If the same watermark is embedded in all video frames
it tends to have poor imperceptibility and poor robustness to video frame cutting
frame averaging
and frame exchanging.If different watermarks are embedded in all key frames according to various video scenes
the robustness to video attacks is improved
especially in the case of video frame cutting
frame averaging
and frame exchanging. The poor imperceptibility of the watermark is still an issue to be resolved. Bitstream-based methods are mainly concerned with re-compression and re-encoding. Most of the proposed bitstream-based methods can resist re-compression and re-encoding
but they are generally not robust against geometric attacks and temporal synchronization attacks. Most of the video watermarking methods based on 3D and VR can well resist compression attacks and noise attacks
but they are generally not robust against geometric attacks such as rotation and cropping. This research has illustrated several aspects that should be considered in the future video watermarking research. For instance
the video watermarking method based on deep learning is in its intial stage and need to be improved. Temporal synchronization attacks and extended attacks have to be concerned consistently. Video watermarking application to more different forms of video signals should be resolved further.
版权保护信息隐藏数字水印视频水印鲁棒视频水印
copyright protectioninformation hidingdigital watermarkingvideo watermarkingrobust video watermarking
Ahmadi M, Norouzi A, Karimi N, Samavi S and Emami A. 2020. ReDMark: framework for residual diffusion watermarking based on deep networks. Expert Systems with Applications, 146: #113157 [DOI: 10.1016/j.eswa.2019.113157]
Alattar A M, Lin E T and Celik M U. 2003. Digital watermarking of low bit-rate advanced simple profile MPEG-4 compressed video. IEEE Transactions on Circuits and Systems for Video Technology, 13(8): 787-800 [DOI: 10.1109/TCSVT.2003.815958]
Asikuzzaman M, Alam M J, Lambert A J and Pickering M R. 2014. Imperceptible and robust blind video watermarking using chrominance embedding: A set of approaches in the DT CWT domain. IEEE Transactions on Information Forensics and Security, 9(9): 1502-1517 [DOI: 10.1109/TIFS.2014.2338274]
Asikuzzaman M, Alam M J, Lambert A J and Pickering M R. 2016. Robust DT CWT-based DIBR 3D video watermarking using chrominance embedding. IEEE Transactions on Multimedia, 18(9): 1733-1748 [DOI: 10.1109/TMM.2016.2589208]
Asikuzzaman M and Pickering M R. 2018. An overview of digital video watermarking. IEEE Transactions on Circuits and Systems for Video Technology, 28(9): 2131-2153 [DOI: 10.1109/TCSVT.2017.2712162]
Ayubi P, Barani M J, Valandar M Y, Irani B Y and Sadigh R S M. 2021. A new chaotic complex map for robust video watermarking. Artificial Intelligence Review, 54(2): 1237-1280 [DOI: 10.1007/S10462-020-09877-8]
Barni M, Bartolini F and Checcacci N. 2005. Watermarking of MPEG-4 video objects. IEEE Transactions on Multimedia, 7(1): 23-32 [DOI: 10.1109/TMM.2004.840594]
Bender W, Gruhl D, Morimoto N and Lu A. 1996. Techniques for data hiding. IBM Systems Journal, 35(3/4): 313-336 [DOI: 10.1147/SJ.353.0313]
Biswas S, Das S R and Petriu E M. 2005. An adaptive compressed MPEG-2 video watermarking scheme. IEEE Transactions on Instrumentation and Measurement, 54(5): 1853-1861 [DOI: 10.1109/TIM.2005.855084]
Buhari A M, Ling H C, Baskaran V M and Wong K. 2016. Fast watermarking scheme for real-time spatial scalable video coding. Signal Processing: Image Communication, 47: 86-95 [DOI: 10.1016/J.IMAGE.2016.06.003]
Cedillo-Hernandez A,Cedillo-Hernandez M, Nakano Miyatake M and Perez Meana H. 2018. A spatiotemporal saliency-modulated JND profile applied to video watermarking. Journal of Visual Communication and Image Representation, 52: 106-117 [DOI: 10.1016/J.JVCIR.2018.02.007]
Chen B and Wornell G W. 2001. Quantization index modulation: a class of provably good methods for digital watermarking and information embedding. IEEE Transactions on Information Theory, 47(4): 1423-1443 [DOI: 10.1109/18.923725]
Chen L and Zhao J Y. 2017. Robust contourlet-based blind watermarking for depth-image-based rendering 3D images. Signal Processing: Image Communication, 54: 56-65 [DOI: 10.1016/J.IMAGE.2017.02.011]
Cox I J, Kilian J, Leighton F T and Shamoon T. 1997. Secure spread spectrum watermarking for multimedia. IEEE Transactions on Image Processing, 6(12): 1673-1687 [DOI: 10.1109/83.650120]
Cui K Y, Shen J, Li Y F, Wang H and Wang Z Z. 2021. An end-to-end generative adversarial video digital watermarking algorithm. China Sciencepaper, 16(7): 687-694
崔凯元, 申静, 李叶凡, 王晗, 王忠芝. 2021. 一种端到端的对抗生成式视频数字水印算法. 中国科技论文, 16(7): 687-694) [DOI: 10.3969/j.issn.2095-2783.2021.07.001]
Dutta T and Gupta H P. 2016. A robust watermarking framework for high efficiency video coding (HEVC)-encoded video with blind extraction process. Journal of Visual Communication and Image Representation, 38: 29-44 [DOI: 10.1016/j.jvcir.2015.12.007]
Dutta T and Gupta H P. 2017. An efficient framework for compressed domain watermarking in P frames of high-efficiency video coding (HEVC)-encoded video. ACM Transactions on Multimedia Computing, Communications, and Applications, 13(1): #12 [DOI: 10.1145/3002178]
Fu J J and Chen D R. 2018. Watermarking algorithm of tolerating the second compression for video content authentication. Chinese Journal of Computers, 41(3): 558-573
付剑晶, 陈德人. 2018. 用于视频内容认证的抗二次压缩水印算法. 计算机学报, 41(3): 558-573) [DOI: 10.11897/SP.J.1016.2018.00558]
Gaj S, Kanetkar A, Sur A and Bora P K. 2017. Drift-compensated robust watermarking algorithm for H. 265/HEVC video stream. ACM Transactions on Multimedia Computing, Communications, and Applications, 13(1): #11 [DOI: 10.1145/3009910]
Gao Y M, Kang X B and Chen Y J. 2021. A robust video zero-watermarking based on deep convolutional neural network and self-organizing map in polar complex exponential transform domain. Multimedia Tools and Applications, 80(4): 6019-6039 [DOI: 10.1007/s11042-020-09904-4]
Huan W N, Li S, Qian Z X and Zhang X P. 2021. Exploring stable coefficients on joint sub-bands for robust video watermarking in DT CWT domain. IEEE Transactions on Circuits and Systems for Video Technology [DOI: 10.1109/TCSVT.2021.3092004]
Lai C C and Tsai C C. 2010. Digital image watermarking using discretewavelet transform and singular value decomposition. IEEE Transactions on Instrumentation and Measurement, 59(11): 3060-3063 [DOI: 10.1109/TIM.2010.2066770]
Li S Z, Zhang X, Deng X H and Wu X Y. 2015. Reversible video watermarking algorithm for H. 264/AVC based on mode feature. Journal of Image and Graphics, 20(10): 1285-1296
李淑芝, 张翔, 邓小鸿, 吴晓燕. 2015. 基于模式特征的H. 264/AVC可逆视频水印. 中国图象图形学报, 20(10): 1285-1296) [DOI: 10.11834/JIG.20151001]
Li Z and Chen X W. 2010. Adaptively imperceptible video watermarking algorithm using entropy model. Journal of Software, 21(7): 1692-1703
李智, 陈孝威. 2010. 基于熵模型的高透明性自适应视频水印算法. 软件学报, 21(7): 1692-1703) [DOI: 10.3724/SP.J.1001.2010.03569]
Lin C Y, Wu M, Bloom J A, Cox I J, Miller M L and Lui Y M. 2001. Rotation, scale, and translation resilient watermarking for images. IEEE Transactions on Image Processing, 10(5): 767-782 [DOI: 10.1109/83.918569]
Liu L, Zhao X M, Peng D Y and Gao Y X. 2014. Video watermarking protocol for broadcast monitoring. Chinese Journal of Computers, 37(11): 2389-2394
刘丽, 赵学民, 彭代渊, 高悦翔. 2014. 适用于广播监视的视频水印协议. 计算机学报, 37(11): 2389-2394) [DOI: 10.3724/SP.J.1016.2014.02389]
Liu Q L, Yang S G, Liu J, Xiong P C and Zhou M C. 2020. A discrete wavelet transform and singular value decomposition-based digital video watermark method. Applied Mathematical Modelling, 85: 273-293 [DOI: 10.1016/J.APM.2020.04.015]
Liu R Z and Tan T N. 2000. Survey of watermarking for digital images. Journal of China Institute of Communications, 21(8): 39-48
刘瑞祯, 谭铁牛. 2000. 数字图像水印研究综述. 通信学报, 21(8): 39-48) [DOI: 10.3321/J.ISSN:1000-436X.2000.08.007]
Liu R Z and Tan T N. 2002. An SVD-based watermarking scheme for protecting rightful ownership. IEEE Transactions on Multimedia, 4(1): 121-128 [DOI: 10.1109/6046.985560]
Liu X Y, Zhao R C, Li F F, Liao S H, Ding Y P and Zou B J. 2017. Novel robust zero-watermarking scheme for digital rights management of 3D Videos. Signal Processing: Image Communication, 54: 140-151 [DOI: 10.1016/J.IMAGE.2017.03.002]
Liu Y, Guo M X, Zhang J, Zhu Y S and Xie X D. 2019. A novel two-stage separable deep learning framework for practical blind watermarking//Proceedings of the 27th ACM International Conference on Multimedia. Nice, France: ACM: 1509-1517 [DOI: 10.1145/3343031.3351025http://dx.doi.org/10.1145/3343031.3351025]
Liu Y W, Liu J X, Argyriou A, Ma S W, Wang L M and Xu Z. 2021. 360-degree VR video watermarking based on spherical wavelet transform. ACM Transactions on Multimedia Computing, Communications, and Applications, 17(1): #38 [DOI: 10.1145/3425605]
Luo X Y, Li Y X, Chang H W, Liu C, Milanfar P and Yang F. 2021. DVMark: a deep multiscale framework for video watermarking[EB/OL]. [2021-04-26].https://arxiv.org/pdf/2104.12734.pdfhttps://arxiv.org/pdf/2104.12734.pdf
Luo X Y, Zhan R H, Chang H W, Yang F and Milanfar P. 2020. Distortion agnostic deep watermarking//Proceedings of 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition. Seattle, USA: IEEE: 13545-13554 [DOI: 10.1109/CVPR42600.2020.01356http://dx.doi.org/10.1109/CVPR42600.2020.01356]
Madine F, Akhaee M A and Zarmehi N. 2018. A multiplicative video watermarking robust to H. 264/AVC compression standard. Signal Processing: Image Communication, 68:229-240 [DOI: 10.1016/J.IMAGE.2018.06.015]
Mansouri A, Aznaveh A M, Torkamani-Azar F and Kurugollu F. 2010. A low complexity video watermarking in H. 264 compressed domain. IEEE Transactions on Information Forensics and Security, 5(4): 649-657 [DOI: 10.1109/TIFS.2010.2076280]
Mansouri A and Mahmoudi-Aznaveh A. 2019. Toward a secure video watermarking in compressed domain. Journal of Information Security and Applications, 48: #102370 [DOI: 10.1016/J.JISA.2019.102370]
Mareen H, De Praeter J, Van Wallendael G and Lambert P. 2019. A scalable architecture for uncompressed-domain watermarked videos. IEEE Transactions on Information Forensics and Security, 14(6): 1432-1444 [DOI: 10.1109/TIFS.2018.2879301]
Noorkami M and Mersereau R M. 2007. A framework for robust watermarking of H. 264-encoded video with controllable detection performance. IEEE Transactions on Information Forensics and Security, 2(1): 14-23 [DOI: 10.1109/TIFS.2006.890306]
Pexaras K, Karybali I G and Kalligeros E. 2019. Optimization and hardware implementation of image and video watermarking for low-cost applications. IEEE Transactions on Circuits and Systems Ⅰ: Regular Papers, 66(6): 2088-2101 [DOI: 10.1109/TCSI.2019.2907191]
Rasti P, Samiei S, Agoyi M, Escalera S and Anbarjafari G. 2016. Robust non-blind color video watermarking using QR decomposition and entropy analysis. Journal of Visual Communication and Image Representation, 38: 838-847 [DOI: 10.1016/J.JVCIR.2016.05.001]
Sahu N and Sur A. 2017. SIFT based video watermarking resistant to temporal scaling. Journal of Visual Communication and Image Representation, 45: 77-86 [DOI: 10.1016/J.JVCIR.2017.02.013]
Swati S, Hayat K and Shahid Z. 2014. A watermarking scheme for high efficiency video coding (HEVC). PLoS One, 9(8): e105613 [DOI: 10.1371/journal.pone.0105613]
Tancik M, Mildenhall B and Ng R. 2020. StegaStamp: invisible hyperlinks in physical photographs//Proceedings of 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition. Seattle, USA: IEEE: 2114-2123 [DOI: 10.1109/CVPR42600.2020.00219http://dx.doi.org/10.1109/CVPR42600.2020.00219]
van Schyndel R G, Tirkel A Z and Osborne C F. 1994. A digital watermark//Proceedings of the 1st International Conference on Image Processing. Austin, USA: IEEE: 86-90 [DOI: 10.1109/ICIP.1994.413536http://dx.doi.org/10.1109/ICIP.1994.413536]
Wagdarikar A M U and Senapati R K. 2019. Optimization based interesting region identification for video watermarking. Journal of Information Security and Applications, 49: #102393 [DOI: 10.1016/J.JISA.2019.102393]
Wang Y L and Pearmain A. 2006. Blind MPEG-2 video watermarking robust against geometric attacks: a set of approaches in DCT domain. IEEE Transactions on Image Processing, 15(6): 1536-1543 [DOI: 10.1109/tip.2006.873476]
Wengrowski E and Dana K. 2019. Light field messaging with deep photographic steganography//Proceedings of 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition. Long Beach, USA: IEEE: 1515-1524 [DOI: 10.1109/CVPR.2019.00161http://dx.doi.org/10.1109/CVPR.2019.00161]
Zeng X, Chen Z Y, Fan W, Chen J and Xiong Z. 2010. Invertible semi-fragile video watermarking algorithm used for content authentication. Journal of Image and Graphics, 15(8): 1189-1195
曾骁, 陈真勇, 范围, 陈辉, 熊璋. 2010. 用于内容认证的半脆弱可逆视频水印算法. 中国图象图形学报, 15(8): 1189-1195
Zhang W W, Zhang R, Liu J Y, Niu X X and Yang Y X. 2012. Robust video watermarking algorithm for H. 264/AVC based on texture feature. Journal on Communications, 33(3): 82-89
张维纬, 张茹, 刘建毅, 钮心忻, 杨义先. 2012. 基于纹理特征的H. 264/AVC顽健视频水印算法. 通信学报, 33(3): 82-89
Zhu J R, Kaplan R, Johnson J and Fei-Fei L. 2018. HiDDeN: hiding data with deep networks//Proceedings of the 15th European Conference on Computer Vision. Munich, Germany: Springer: 682-697 [DOI: 10.1007/978-3-030-01267-0_40http://dx.doi.org/10.1007/978-3-030-01267-0_40]
相关作者
相关机构
京公网安备11010802024621