浏览全部资源
扫码关注微信
Received：10 June 2022，
Revised：2023-01-23，
Published：16 November 2023
移动端阅览
目的
2
图像编辑软件的普及使得篡改图像内容、破坏图像语义的成本越来越低。为避免恶意篡改图像对社会稳定和安全的威胁，检测图像的完整性和真实性尤为重要。面对新型成像设备和算法，需要重新验证现有图像篡改检测算法的有效性并针对双目超分辨率图像的安全性展开进一步研究。但由于双目超分辨率图像篡改数据集的缺乏，难以满足研究的需要。为此，构建了一个双目超分辨率图像通用篡改检测数据集SSRGFD（stereo super-resolution forensic general dataset）。
方法
2
数据集构建考虑复制黏贴、拼接和图像修复3种常见的篡改类型。为使数据集图像更贴合真实篡改场景，本文从篡改图像内容和隐藏篡改痕迹两方面出发为不同篡改类型设计了不同的篡改标准。首先使用超分辨率算法PASSRnet（parallax attention stereo image super-resolution network）从Flickr1024数据集生成双目超分辨率图像，分别基于3种篡改标准通过手工或深度学习算法对图像进行篡改，构建了2 067幅篡改图像，并为每一幅篡改图像提供了对应的篡改区域掩膜。
结果
2
实验从主观和客观两个角度评估数据集图像视觉质量。通过双刺激连续质量分级法得到的主观质量平均评分差异基本都低于1.5。客观质量评价方法BRISQUE（blind/referenceless image spatial quality evaluator）、NIQE（natural image quality evaluator）和 PIQE（parent institute for quality education）的平均评估结果分别为30. 76、4. 248和34. 11，与真实图像十分接近。实验使用多种检测方法在SSRGFD和单目图像数据集上进行比较。QMPPNet（multi-scale pyramid hybrid loss network）的性能指标均表现最优，但所有检测方法在SSRGFD上的性能相比于在单目图像数据集上的性能显著下降。
结论
2
构建的SSRGFD数据集内容丰富且具有较好的视觉质量，能够为双目超分辨率图像篡改检测研究工作提供良好的数据支持。SSRGFD数据集可以从
https://github.com/YL1006/SSRGFD
https://github.com/YL1006/SSRGFD
上获取。
Objective
2
With the rapid development of computers and networks， images have become an important component of information transmission and sharing. However， the popularization of image editors reduces the cost of tampering with image content and destroying image semantics. To avoid the threat posed by malicious tampering images to social stability and security， the integrity and authenticity of images should be detected. The popularization of dual cameras and the development of stereo super-resolution methods have introduced stereo super-resolution images into many fields， such as photography， remote sensing， and intelligent robots. However， the characteristics of these images differ from those of monocular images. Faced with new imaging devices and algorithms， the effectiveness of existing image tampering detection algorithms needs to be revalidated， and the security of stereo super-resolution images should be further examined. Nevertheless， stereo super-resolution image tampering datasets are currently lacking， hence posing difficulties in meeting the needs of image forensics research. To this end， a high-quality stereo super-resolution image general forensic dataset （SSRGFD） is constructed in this paper.
Method
2
Forgery images in the SSRGFD dataset are all stereo super-resolution images generated using Adobe Photoshop and deep learning algorithms. Three common categories of forgeries are considered， namely， copy-move， splicing， and inpainting， of which inpainting includes removal and restoration. Stereo super-resolution images are initially generated from the Flickr1024 dataset using the stereo super-resolution method PASSRnet. To enrich the image content and conceal visible traces of tampering， several tampering standards are designed for different forgery categories to make the tampering images in line with real scenes. Afterward， the copy-move and splicing stereo super-resolution tampering images are tampered using Adobe Photoshop based on these standards. In the copy-move stage， one or more duplicated regions are copied and moved to other appropriate regions on the image. In the splicing stage， one or more regions are replaced with duplicated regions from different images to synthesize the tampering image. Meanwhile， image inpainting involves the removal of some objects and the recovery of the missing region on an image. When removing image objects， the pixel in a certain range is picked up according to the image content to simulate the image background and cover the target object using Photoshop tools. Moreover， the HiFill deep learning method is used to recover the missing regions on these images. Due to the differences between the training images and the images to be tampered with， tampering images with obvious traces of inpainting are removed manually. For each forgery category， various preprocessing and post-processing methods may be applied to cover visible traces of tampering according to the proposed standards. The masks of the tampered region corresponding to each tampering image are also provided.
Result
2
The subjective visual quality of the SSRGFD dataset is evaluated using the double stimulus continuous quality scale method， and the difference in the scores given by the evaluator between the tampering and real images is less than 1.5. Among them， copy-move has the lowest score difference due to the fact that the duplicated and tampering regions come from the same image and that only few tampering traces are visible. Three no-reference image quality evaluation methods， namely， blind/referenceless image spatial quality evaluator（BRISQUE）， natural image quality evaluator（NIQE）， and parent institute for quality education（PIQE） are also applied for an objective visual quality evaluation. The evaluation results for the real and forgery images of the SSRGFD dataset are very similar. These experiments illustrate that forgery images have promising visual quality. To demonstrate the challenge posed by stereo super-resolution images to existing image tampering detection and localization methods， experiments are conducted using four effective models， namely， manipulation tracing network（MantraNet）， ringed residual U-Net（RRU-Net）， QMPPNet， and dense fully convolutional network（DenseFCN）. These experiments use precision， recall， pixel-level F1 score， Matthews correlation coefficient （MCC）， and intersection over union （IoU） as evaluation parameters for the methods proposed above. QMPPNet performs best in all metrics by combining semantic segmentation and edge features. The results of QMPPNet in precision， recall， pixel-level F1 score， MCC， and IoU are 0.507 9， 0.899 8， 0.614 8， 0.643 3， and 0.480 2， respectively. However， compared with the monocular images forgery dataset， the performance of these methods on the SSRGFD dataset is greatly reduced.
Conclusion
2
This paper constructs a tampering dataset on stereo super-resolution images. These images greatly affect the performance of the existing image tampering localization methods and dramatically reduce the capability of these methods on stereo super-resolution images. Several experiment results have verified the necessity of new image forensic methods adapted for stereo super-resolution images. However， the existing monocular datasets cannot meet research needs. The SSRGFD dataset with affluent content and considerable visual quality not only brings great challenges to image forensic methods but also provides effective data support for the image tampering detection and localization of stereo super-resolution images. The SSRGFD dataset is available at
https：//github.com/YL1006/SSRGFD
https://github.com/YL1006/SSRGFD
.
Bi X L ， Wei Y ， Xiao B and Li W S . 2019 . RRU-net： the ringed residual U-net for image splicing forgery detection // Proceedings of 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops . Long Beach， USA ： IEEE： 30 - 39 ［ DOI： 10.1109/CVPRW.2019.00010 http://dx.doi.org/10.1109/CVPRW.2019.00010 ］
Chen C Q ， Qing C ， Xu X M and Dickinson P . 2022 . Cross parallax attention network for stereo image super-resolution . IEEE Transactions on Multimedia ， 24 ： 202 - 216 ［ DOI： 10.1109/TMM.2021.3050092 http://dx.doi.org/10.1109/TMM.2021.3050092 ］
Chen C L ， Ni J Q and Huang J W ， 2013 . Blind detection of median filtering in digital images： a difference domain based approach . IEEE Transactions on Image Processing ， 22 （ 12 ）： 4699 - 4710 ［ DOI： 10.1109/TIP.2013.2277814 http://dx.doi.org/10.1109/TIP.2013.2277814 ］
Dong J ， Wang W and Tan T N . 2013 . CASIA image tampering detection evaluation database // Proceedings of 2013 IEEE China Summit and International Conference on Signal and Information Processing . Beijing， China ： IEEE： 422 - 426 ［ DOI： 10.1109/ChinaSIP.2013.6625374 http://dx.doi.org/10.1109/ChinaSIP.2013.6625374 ］
Guan H Y ， Kozak M ， Robertson E ， Lee Y ， Yates A N ， Delgado A ， Zhou D ， Kheyrkhah T ， Smith J and Fiscus J . 2019 . MFC datasets： large-scale benchmark datasets for media forensic challenge evaluation // Proceedings of 2019 IEEE Winter Applications of Computer Vision Workshops . Waikoloa， USA ： IEEE： 63 - 72 ［ DOI： 10.1109/WACVW.2019.00018 http://dx.doi.org/10.1109/WACVW.2019.00018 ］
Guo X F ， Yang H Y and Huang D . 2021 . Image inpainting via conditional texture and structure dual generation // Proceedings of 2021 IEEE/CVF International Conference on Computer Vision （ICCV） . Montreal， Canada ： IEEE： 14114 - 14123 ［ DOI： 10.1109/ICCV48922.2021.01387 http://dx.doi.org/10.1109/ICCV48922.2021.01387 ］
Heller S ， Rossetto L and Schuldt H . 2018 . The PS-battles dataset — an image collection for image manipulation detection ［EB/OL］. ［ 2022-06-10 ］. https://arxiv.org/pdf/1804.04866.pdf https://arxiv.org/pdf/1804.04866.pdf
Hsu Y F and Chang S F . 2006 . Detecting image splicing using geometry invariants and camera characteristics consistency // Proceedings of 2006 IEEE International Conference on Multimedia and Expo . Toronto， Canada ： IEEE： 549 - 552 ［ DOI： 10.1109/ICME.2006.262447 http://dx.doi.org/10.1109/ICME.2006.262447 ］
Jeon D S ， Baek S H ， Choi I and Kim M H . 2018 . Enhancing the spatial resolution of stereo images using a parallax prior // Proceedings of 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition . Salt Lake City， USA ： IEEE： 1721 - 1730 ［ DOI： 10.1109/CVPR.2018.00185 http://dx.doi.org/10.1109/CVPR.2018.00185 ］
Kwon M J ， Yu I J ， Nam S H and Lee H K . 2021 . CAT-Net： compression artifact tracing network for detection and localization of image splicing // Proceedings of 2021 IEEE Winter Conference on Applications of Computer Vision . Waikoloa， USA ： IEEE： 375 - 384 ［ DOI： 10.1109/WACV48630.2021.00042 http://dx.doi.org/10.1109/WACV48630.2021.00042 ］
Li X L ， Yu N H ， Zhang X P ， Zhang W M ， Li B ， Lu W ， Wang W and Liu X L . 2021 . Overview of digital media forensics technology . Journal of Image and Graphics ， 26 （ 6 ）： 1216 - 1226
李晓龙 ， 俞能海 ， 张新鹏 ， 张卫明 ， 李斌 ， 卢伟 ， 王伟 ， 刘晓龙 . 2021 . 数字媒体取证技术综述 . 中国图象图形学报 ， 26 （ 6 ）： 1216 - 1226 ［ DOI： 10.11834/jig.210081 http://dx.doi.org/10.11834/jig.210081 ］
Liu X J ， Lu W ， Zhang Q ， Huang J W and Shi Y Q . 2020 . Downscaling factor estimation on pre-JPEG compressed images . IEEE Transactions on Circuits and Systems for Video Technology ， 30 （ 3 ）： 618 - 631 ［ DOI： 10.1109/TCSVT.2019.2893353 http://dx.doi.org/10.1109/TCSVT.2019.2893353 ］
Mahfoudi G ， Tajini B ， Retraint F ， Morain-Nicolier F ， Dugelay J L and Pic M . 2019 . DEFACTO： image and face manipulation dataset // Proceedings of the 27th European Signal Processing Conference . A Coruna， Spain ： IEEE： #8903181 ［ DOI： 10.23919/EUSIPCO.2019.8903181 http://dx.doi.org/10.23919/EUSIPCO.2019.8903181 ］
Mittal A ， Moorthy A K and Bovik A C . 2012 . No-reference image quality assessment in the spatial domain . IEEE Transactions on Image Processing ， 21 （ 12 ）： 4695 - 4708 ［ DOI： 10.1109/TIP.2012.2214050 http://dx.doi.org/10.1109/TIP.2012.2214050 ］
Mittal A ， Soundararajan R and Bovik A C . 2013 . Making a “Completely Blind” image quality analyzer . IEEE Signal Processing Letters ， 20 （ 3 ）： 209 - 212 ［ DOI： 10.1109/LSP.2012.2227726 http://dx.doi.org/10.1109/LSP.2012.2227726 ］
National Radio and Television Administration， PRC . 2021 . GY/T 340 - 2020 Subjective assessment methods for image quality of ultra high-definition television —— Double-stimulus continuous quality-scale . Beijing ： Standards Press of China
国家广播电视总局 . 2021 . GY/T 340 - 2020 超高清晰度电视图像质量主观评价方法 双刺激连续质量标度法 . 北京 ： 中国标准出版社
Ng T T and Chang S F . 2004 . A data set of authentic and spliced image blocks ［EB/OL］. ［ 2022-06-10 ］. https://www.ee.columbia.edu/ln/dvmm/publications/04/TR_splicingDataSet_ttng.pdf https://www.ee.columbia.edu/ln/dvmm/publications/04/TR_splicingDataSet_ttng.pdf
Novozámský A ， Mahdian B and Saic S . 2020 . IMD2020： a large-scale annotated dataset tailored for detecting manipulated images // Proceedings of 2020 IEEE Winter Applications of Computer Vision Workshops . Snowmass， USA ： IEEE： 71 - 80 ［ DOI： 10.1109/WACVW50321.2020.9096940 http://dx.doi.org/10.1109/WACVW50321.2020.9096940 ］
Qiang Z P ， He L B ， Chen X and Xu D . 2019 . Survey on deep learning image inpainting methods . Journal of Image and Graphics ， 24 （ 3 ）： 447 - 463
强振平 ， 何丽波 ， 陈旭 ， 徐丹 . 2019 . 深度学习图像修复方法综述 . 中国图象图形学报 ， 24 （ 3 ）： 447 - 463 ［ DOI： 10.11834/jig.180408 http://dx.doi.org/10.11834/jig.180408 ］
Song W ， Choi S ， Jeong S and Sohn K . 2020 . Stereoscopic image super-resolution with stereo consistent feature . Proceedings of the AAAI Conference on Artificial Intelligence ， 34 （ 7 ）： 12031 - 12038 ［ DOI： 10.1609/aaai.v34i07.6880 http://dx.doi.org/10.1609/aaai.v34i07.6880 ］
Venkatanath N ， Praneeth D ， Maruthi C B ， Channappayya S S and Medasani S S . 2015 . Blind image quality evaluation using perception based features // Proceeding of the 21st National Conference on Communications . Mumbai， India ： IEEE： #7084843 ［ DOI： 10.1109/NCC.2015.7084843 http://dx.doi.org/10.1109/NCC.2015.7084843 ］
Wan Z Y ， Zhang J B ， Chen D D and Liao J . 2021 . High-fidelity pluralistic image completion with transformers // Proceedings of 2021 IEEE/CVF International Conference on Computer Vision （ICCV） . Montreal， Canada ： IEEE： 4672 - 4681 ［ DOI： 10.1109/ICCV48922.2021.00465 http://dx.doi.org/10.1109/ICCV48922.2021.00465 ］
Wang J W ， Huang W ， Luo X Y ， Shi Y Q and Jha S K . 2020 . Non-aligned double jpeg compression detection based on refined Markov features in QDCT domain . Journal of Real-Time Image Processing ， 17 （ 1 ）： 7 - 16 ［ DOI： 10.1007/s11554-019-00929-z http://dx.doi.org/10.1007/s11554-019-00929-z ］
Wang L G ， Wang Y Q ， Liang Z F ， Lin Z P ， Yang J G ， An W and Guo Y L . 2019a . Learning parallax attention for stereo image super-resolution // Proceedings of 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition . Long Beach， USA ： IEEE： 12242 - 12251 ［ DOI： 10.1109/CVPR.2019.01253 http://dx.doi.org/10.1109/CVPR.2019.01253 ］
Wang Y Q ， Wang L G ， Yang J G ， An W and Guo Y L . 2019b . Flickr1024： a large-scale dataset for stereo image super-resolution // Proceedings of 2019 IEEE/CVF International Conference on Computer Vision Workshop . Seoul， Korea （South） ： IEEE： 3852 - 3857 ［ DOI： 10.1109/ICCVW.2019.00478 http://dx.doi.org/10.1109/ICCVW.2019.00478 ］
Wu Y ， AbdAlmageed W and Natarajan P . 2019 . Mantra-net： manipulation tracing network for detection and localization of image forgeries with anomalous features // Proceedings of 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition . Long Beach， USA ： IEEE： 9535 - 9544 ［ DOI： 10.1109/CVPR.2019.00977 http://dx.doi.org/10.1109/CVPR.2019.00977 ］
Yang F ， Li J W ， Lu W and Weng J . 2017 . Copy-move forgery detection based on hybrid features . Engineering Applications of Artificial Intelligence ， 59 ： 73 - 83 ［ DOI： 10.1016/j.engappai.2016.12.022 http://dx.doi.org/10.1016/j.engappai.2016.12.022 ］
Yi Z L ， Tang Q ， Azizi S ， Jang D and Xu Z . 2020 . Contextual residual aggregation for ultra-high-resolution image inpainting // Proceedings of 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition . Seattle， USA ： IEEE： 7505 - 7514 ［ DOI： 10.1109/CVPR42600.2020.00753 http://dx.doi.org/10.1109/CVPR42600.2020.00753 ］
Yin Q L ， Wang J W and Luo X Y . 2021 . A hybrid loss network for localization of image manipulation // Proceedings of the 19th International Workshop on Digital Forensics and Watermarking . Melbourne， Australia ： Springer： 237 - 247 ［ DOI： 10.1007/978-3-030-69449-4_18 http://dx.doi.org/10.1007/978-3-030-69449-4_18 ］
Zeng H ， Zhan Y F ， Kang X G and Lin X D . 2017 . Image splicing localization using pca-based noise level estimation . Multimedia Tools and Applications ， 76 （ 4 ）： 4783 - 4799 ［ DOI： 10.1007/s11042-016-3712-8 http://dx.doi.org/10.1007/s11042-016-3712-8 ］
Zhang Q ， Lu W ， Huang T ， Luo S J ， Xu Z P and Mao Y J . 2020 . On the robustness of JPEG post-compression to resampling factor estimation . Signal Processing ， 168 ： # 107371 ［ DOI： 10.1016/j.sigpro.2019.107371 http://dx.doi.org/10.1016/j.sigpro.2019.107371 ］
Zhuang P Y ， Li H D ， Tan S Q ， Li B and Huang J W . 2021 . Image tampering localization using a dense fully convolutional network . IEEE Transactions on Information Forensics and Security ， 16 ： 2986 - 2999 ［ DOI： 10.1109/TIFS.2021.3070444 http://dx.doi.org/10.1109/TIFS.2021.3070444 ］
相关作者
相关机构
京公网安备11010802024621
