浏览全部资源
扫码关注微信
收稿：2021-06-28，
修回：2021-10-22，
录用：2021-10-29，
纸质出版：2022-01-16
移动端阅览
目的
2
图像篡改区域检测是图像取证领域的一个挑战性任务，其目的是找出图像的篡改区域。传统方法仅针对某种特定的篡改方式进行设计，难以检测其他篡改方式的图像。基于卷积神经网络的方法能够自适应地提取特征，同时检测包含多种篡改方式的图像。但是其中多数方法都选择增强图像的噪声特征，这种机制无法较好处理篡改区域与原图像来源相同、噪声相似的情况。多数方法还忽略了篡改区域过小而产生的样本不平衡问题，导致检测效果不佳。
方法
2
提出了一个基于区域损失的用于检测小篡改区域的U型网络，该网络构建了一个异常区域特征增强机制，放大与图像背景差异较大的异常区域的特征。此外，还利用区域损失增强对篡改区域框内像素的判别能力，可以解决因篡改区域过小而产生的样本不平衡问题。
结果
2
消融实验说明了异常区域特征增强机制和区域损失机制的有效性；对JPEG压缩和高斯模糊的对抗性测试证明了模型的鲁棒性；在CASIA2.0(CASI-A image tampering detection evaluation database)、NIST2016(NIST nimble 2016 datasets)、COLUMBIA(Columbia uncompressed image splicing detection evaluation dataset)和COVERAGE(a novel database forcopy-move forgery detection)数据集上与最新方法进行比较时，本文方法取得了最优性能，其F1 score分别为0.979 5、0.982 2、0.995 3和0.987 0。
结论
2
本文的异常区域特征增强机制和区域损失机制能有效提高模型性能，同时缓解篡改区域过小导致的样本不平衡问题，大量实验也表明了本文提出的小篡改区域检测方法的优越性。
Objective
2
Detecting the image forgery region is a challenging task on the aspect of image forensics. The statistical features and physical characteristics of the image itself methods have been focused on in the traditional detection and localization field. Traditional methods are designed only for a specific forgery
making them difficult to detect images containing diverse forgery approaches. Convolutional neural networks (CNNs) are proposed to various image tasks recently due to extracting adaptive features. Most of these methods have enhanced the noise features of an image. It cannot be qualified that the noise of the forgery region is similar to the original image. In addition
most of CNNs-based forgery region detection methods ignore the imbalanced sample constrained by the small forgery region. It affects the further improvement of detection performance. So
more qualified image features enhancement and problem solving have been focused on due to the small forgery region.
Method
2
A region loss based U-Net for small image forgery region detection is demonstrated. First
the most forgery regions differ from the image background has been investigated. Image anomaly regions could be called where differ from the image background. Splicing the difference tensor between local and dominant image features to the image to enhance the features extracted from these image anomaly regions. This feature augmentation mechanism only needs to be computed once when given an image as input
which significantly reduces training time compared to other state-of-the-art methods. Simutanesouly
a U-Net structure model is illustrated. A modified VGG-16 architecture is used to be the down-sampling part. Several de-convolution layers and convolution layers are utilized to be the up-sampling part. Aiming at retaining the location information of an image
maxpool layers is removed from the down-sampling network. To extract hierarchical features with diverse scales
the stride of last convolution layer in each down-sampling block is set as 2. The upsampling process requires fusing the multi-scale features extracted from the down-sampling process to avoid the loss of image spatial information. To address the final question caused by small forgery regions
a novel region loss has been demonstrated. The illustrated region loss mechanism requires segmenting the learning process of the network into two stages. In the first stage
the targeted binary cross entropy loss(BCELoss) of overall image as a loss function for network training. A relative rough model has been obtained. In the training process of second stage
a multiple candidate region boxes have been generated based on the location information from the model learned in first stage. The option of candidate region box should satisfy two conditions: 1) The candidate region box should contain all forgery regions; 2) The ratio of forgery region and non-forgery region is approximate to 1 ∶1. The oriented candidate region box is called forgery region box. Next
the BCELoss of the image is calculated in the forgery region box and as the second loss for the learning of second stage. Hence
the judging capability about whether pixels are forged in region box is able to be remarkable improved.
Result
2
It has the priority of the illustrated forgery region detection methods on four standard image forgery datasets
including traditional DWT method and three CNNs-based methods including manipulation tracing network(ManTra-Net)
U-Net
and the ringed residual U-Net(RRU-Net). The four standard image forgery datasets are CASI-A image tampering detection evaluation database(CASIA2.0)
Columbia uncompressed image splicing detection evaluation dataset(COLUMBIA)
a novel database forcopy-move forgery detection(COVERAGE) and NIST nimble 2016 datasets(NIST 2016)
respectively. The CASIA2.0 dataset images are small
complex and more challenging. F1 score is used as the benchmark for model evaluation. Moreover
F1 score is improved most on the CASIA2.0 dataset
which is asymptotical 2.17% higher than the second method. To test the robustness of our approach
the F1 score is evaluated as well. U-Net and RRU-Net on images is interfered by JPEG compression and Gaussian blur. The comparison results demonstrate that the method has its optimal robustness. To verify the effectiveness of the proposed feature augmentation mechanism and region loss mechanism in this work
we also perform abundant ablation experiments. Anomaly region feature augmentation modeling has its advantage and models region loss models can achieve its more qualified results.
Conclusion
2
A region loss based U-Net architecture is illustrated in order to detect forgery region in images effectively and accurately. It mainly resolves the issue of feature augmentation and small forgery regions. The difference amongst local and dominant features has been sorted out to enhance the features from image anomaly regions. An illustrated region loss enhanced the learning of features in the forgery region caused by imbalanced sample issue. Ablation study has shown that feature augmentation and region loss mechanisms improve the proposed model calculation effectively. In addition
the JPEG compression and Gaussian blur tests also demonstrate the robustness. An effective forgery region detection method is implemented and facilitated.
Amerini I, Ballan L, Caldelli R, Bimbo A, Tongo L and Serra G. 2013. Copy-move forgery detection and localization by means of robust clustering with J-Linkage. Signal Processing: Image Communication, 28(6): 659-669 [DOI: 10.1016/j.image.2013.03.006]
Ardizzone E, Bruno A and Mazzola G. 2015. Copy-move forgery detection by matching triangles of keypoints. IEEE Transactions on Information Forensics and Security, 10(10): 2084-2094 [DOI: 10.1109/TIFS.2015.2445742]
Bahrami K, Kot A C, Li L D and Li H L. 2015. Blurred image splicing localization by exposing blur type inconsistency. IEEE Transactions on Information Forensics and Security, 10(5): 999-1009 [DOI: 10.1109/TIFS.2015.2394231]
Bi X L, Wei Y, Xiao B and Li W S. 2019. RRU-Net: the ringed residual U-Net for image splicing forgery detection//Proceedings of 2019 IEEE/CVFConference on Computer Vision and Pattern Recognition Workshops. Long Beach, USA: IEEE: 30-39 [ DOI: 10.1109/CVPRW.2019.00010 http://dx.doi.org/10.1109/CVPRW.2019.00010 ]
Bondi L, Lameri S, Güera D, Bestagini P, Delp E J and Stefano T. 2017. Tampering detection and localization through clustering of camera-based CNN features//Proceedings of 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops. Honolulu, USA: IEEE: 1855-1864 [ DOI: 10.1109/CVPRW.2017.232 http://dx.doi.org/10.1109/CVPRW.2017.232 ]
Chen M, Fridrich J, Goljan M and Lukas J. 2008. Determining image origin and integrity using sensor noise. IEEE Transactions on Information Forensics and Security, 3(1): 74-90 [DOI: 10.1109/TIFS.2007.916285]
Cozzolino D, Poggi G and Verdoliva L. 2017. Recasting residual-based local descriptors as convolutional neural networks: an application to image forgery detection//Proceedings of the 5th ACM Workshop. Philadelphia, USA: ACM: 159-164 [ DOI: 10.1145/3082031.3083247 http://dx.doi.org//10.1145/3082031.3083247 ]
Dong J, Wang W and Tan T N. 2013. CASIA image tampering detection evaluation database//Proceedings of 2013 IEEE China Summit and International Conference on Signal and Information Processing. Beijing, China: IEEE: 422-426 [ DOI: 10.1109/ChinaSIP.2013.6625374 http://dx.doi.org/10.1109/ChinaSIP.2013.6625374 ]
Fridrich J and Kodovsky J. 2012. Rich models for steganalysis of digital images. IEEE Transactions on Information Forensics and Security, 7(3): 868-882 [DOI: 10.1109/TIFS.2012.2190402]
Fridrich A J, Soukalm B D and Lukáš A J. 2003. Detection of copy-move forgery in digital images//Proceedings of Digital Forensic Research Workshop. Cleveland, USA: [s. n.]: 19-23
Gou H M, Swaminathan A and Wu M. 2007. Noise features for image tampering detection and steganalysis//Proceedings of 2007 IEEE International Conference on Image Processing. San Antonio, USA: IEEE: VI-97-VI-100 [ DOI: 10.1109/ICIP.2007.4379530 http://dx.doi.org/10.1109/ICIP.2007.4379530 ]
Guan H Y, Lee Y Y, Yates A, Delgado A, Zhou D, Joy D and Pereira A. 2016. NIST nimble 2016 datasets[DB/OL]. [2021-5-20] . https://www.nist.gov/itl/iad/mig/open-media-forensics-challenge https://www.nist.gov/itl/iad/mig/open-media-forensics-challenge
Hsu Y F and Chang S F. 2006. Detecting image splicing using geometry invariants and camera characteristics consistency//Proceedings of 2006 IEEE International Conference on Multimedia and Expo. Toronto, Canada: IEEE: 549-552 [ DOI: 10.1109/ICME.2006.262447 http://dx.doi.org/10.1109/ICME.2006.262447 ]
Johnson M K and Farid H. 2007. Exposing digital forgeries in complex lighting environments. IEEE Transactions on Information Forensics and Security, 2(3): 450-461 [DOI: 10.1109/TIFS.2007.90384]
Li G H, Wu Q, Tu D and Sun S J. 2007. A sorted neighborhood approach for detecting duplicated regions in image forgeries based on DWT and SVD//Proceedings of 2007 IEEE International Conference on Multimedia and Expo. Beijing, China: IEEE: 1750-1753 [ DOI: 10.1109/ICME.2007.4285009 http://dx.doi.org/10.1109/ICME.2007.4285009 ]
Liu Q G, Cao X C, Deng C and Guo X J. 2011. Identifying image composites through shadow matte consistency. IEEE Transactions on Information Forensics and Security, 6(3): 1111-1122 [DOI: 10.1109/TIFS.2011.2139209]
Li Y Z, Hu J, Niu S Z, Meng X Z and Zhu Y L. 2011. Blind digital image forensics based on the light direction inconsistent. Journal of Beijing University of Posts and Telecommunications, 34(03): 26-30
李叶舟, 胡静, 牛少彰, 孟宪哲, 朱艳玲. 2011. 基于图像背景噪声特性的篡改检测. 信号处理, 28(09): 1299-1307 [DOI: CNKI:11-3570/TN.20110429.1612.001]
Luo W Q, Huang J W and Qiu G P. 2006. Robust detection of region-duplicationforgery in digital image//Proceedings of the 18th International Conference on Pattern Recognition. Hong Kong, China: IEEE: 746-749 [ DOI: 10.1109/ICPR.2006.1003 http://dx.doi.org/10.1109/ICPR.2006.1003 ]
Lu Y F, Ju Y L and Yu Y. 2012. Tamper detection based on the image background noise characteristics. Journal of Signal Processing, 28(09): 1299-1307
卢燕飞, 鞠娅莉, 于跃. 2012. 基于图像背景噪声特性的篡改检测. 信号处理, 28(09): 1299-1307 [DOI: CNKI:SUN:XXCN.0.2012-09-012]
Mahdian B and Saic S. 2009. Using noise inconsistencies for blind image forensics. Image and Vision Computing, 27(10): 1497-1503 [DOI: 10.1016/j.imavis.2009.02.001]
Pan X Y, Zhang X and Lyu S W. 2011. Exposing image forgery with blind noise estimation//Proceedings of the 13th ACM Multimedia Workshop on Multimedia and Security. New York, USA: ACM: 15-20 [ DOI: 10.1145/2037252.2037256 http://dx.doi.org/10.1145/2037252.2037256 ]
Popescu A C and Farid H. 2004. Exposing Digital Forgeries by Detecting Duplicated Image Regions. Technical Report TR2004-515. Dartmouth College
Rao Y and Ni J Q. 2016. A deep learning approach to detection of splicing and copy-move forgeries in images//Proceedings of IEEE International Workshop on Information Forensics and Security. Abu Dhabi, United Arab Emirates: IEEE: 1-6 [ DOI: 10.1109/WIFS.2016.7823911 http://dx.doi.org/10.1109/WIFS.2016.7823911 ]
Ronneberger O, Fischer P and Brox T. 2015. U-Net: convolutional networks for biomedical image segmentation//Proceedings of the 18th International Conference on Medical Image Computing and Computer-Assisted Intervention. Munich, Germany: Springer: 234-241 [ DOI: 10.1007/978-3-319-24574-4_28 http://dx.doi.org/10.1007/978-3-319-24574-4_28 ]
Wang W H and Farid H. 2007. Exposing digital forgeries in video by detecting duplication//Proceedings of the 9th Workshop on Multimedia and Security. Dallas Texas, USA: ACM: 35-42 [ DOI: 10.1145/1288869.1288876 http://dx.doi.org/10.1145/1288869.1288876 ]
Wen B H, Zhu Y, Subramanian R, Ng T T, Shen X J and Winkler S. 2016. COVERAGE—A novel database for copy-move forgery detection//Proceedings of 2016 IEEE International Conference on Image Processing. Phoenix, USA: IEEE: 161-165 [ DOI: 10.1109/ICIP.2016.7532339 http://dx.doi.org/10.1109/ICIP.2016.7532339 ]
Wu Y, AbdAlmageed W and Natarajan P. 2019. ManTra-Net: manipulation tracing network for detection and localization of image forgeries with anomalous features//Proceedings of 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition. Long Beach, USA: IEEE: 9535-9544 [ DOI: 10.1109/CVPR.2019.00977 http://dx.doi.org/10.1109/CVPR.2019.00977 ]
Zhang X Q, Wang J X, Wang T, and Jiang R H. 2021b. Hierarchical Feature Fusion with Mixed Convolution Attention for Single Image Dehazing. IEEE Transactions on Circuits and Systems for Video Technology, 99: 1-1 [DOI: 10.1109/TCSVT.2021.3067062]
Zhang X Q, WangT, Jiang R H, Zhao Li and Xu Y W. 2021a. Multi-Attention Convolutional Neural Network for Video Deblurring. IEEE Transactions on Circuits and Systems for Video Technology, 99: 1-1 [DOI: 10.1109/TCSVT.2021.3093928]
Zhang Y, Goh J, Win L L and Thing V. 2016. Image region forgery detection: a deep learning approach//Proceedings of the Singapore Cyber-Security Conference. Amsterdam: IOS Press: 1-11 [ DOI: 10.3233/978-1-61499-617-0-1 http://dx.doi.org/10.3233/978-1-61499-617-0-1 ]
Zhou P, Han X T, Morariu V I and Davis L S. 2018. Learning rich features for image manipulation detection//Proceedings of 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition. Salt Lake City, USA: IEEE: 1053-1061 [ DOI: 10.1109/CVPR.2018.00116 http://dx.doi.org/10.1109/CVPR.2018.00116 ]
相关作者
相关机构
京公网安备11010802024621
