FF-Net: An End-to-end Feature-Fusion Network for Double JPEG Detection and Localization

Bo Liu, Ranglei Wu, Xiuli Bi, Bin Xiao
Proceedings of The 14th Asian Conference on Machine Learning, PMLR 189:643-657, 2023.

Abstract

In the real-world, most images are saved in JPEG format, so many forged images are partially or totally composed of JPEG images and then saved in JPEG format again. In this case, exposing forged images can be accomplished by the detection of double JPEG compressions. Although the detection methods of double JPEG compressions have greatly improved, they rely on handcrafted features of image patches and cannot locate forgery at pixel-level. To break this limitation, we propose an end-to-end feature-fusion network (FF-Net) for double compression detection and forgery localization. We find that JPEG compression fingerprint primarily exists on the high-frequency component of an image, and the singly and doubly compression yield different fingerprints. Therefore, we design two encoders cooperatively to learn the compression fingerprint directly from the whole image. A decoder is deployed to locate the regions with different compression fingerprints at pixel-level based on the learned compression fingerprint. The experiment results verify that the proposed FF-Net can detect and locate the forged regions more accurately than these existing detection methods. Besides, it has a good generalization ability that the network trained on one compression case can work in numerous compression cases. Moreover, it can detect different local forgeries, including copy-move, splicing, and object-removal.

Cite this Paper

BibTeX
@InProceedings{pmlr-v189-liu23a, title = {FF-Net: An End-to-end Feature-Fusion Network for Double JPEG Detection and Localization}, author = {Liu, Bo and Wu, Ranglei and Bi, Xiuli and Xiao, Bin}, booktitle = {Proceedings of The 14th Asian Conference on Machine Learning}, pages = {643--657}, year = {2023}, editor = {Khan, Emtiyaz and Gonen, Mehmet}, volume = {189}, series = {Proceedings of Machine Learning Research}, month = {12--14 Dec}, publisher = {PMLR}, pdf = {https://proceedings.mlr.press/v189/liu23a/liu23a.pdf}, url = {https://proceedings.mlr.press/v189/liu23a.html}, abstract = {In the real-world, most images are saved in JPEG format, so many forged images are partially or totally composed of JPEG images and then saved in JPEG format again. In this case, exposing forged images can be accomplished by the detection of double JPEG compressions. Although the detection methods of double JPEG compressions have greatly improved, they rely on handcrafted features of image patches and cannot locate forgery at pixel-level. To break this limitation, we propose an end-to-end feature-fusion network (FF-Net) for double compression detection and forgery localization. We find that JPEG compression fingerprint primarily exists on the high-frequency component of an image, and the singly and doubly compression yield different fingerprints. Therefore, we design two encoders cooperatively to learn the compression fingerprint directly from the whole image. A decoder is deployed to locate the regions with different compression fingerprints at pixel-level based on the learned compression fingerprint. The experiment results verify that the proposed FF-Net can detect and locate the forged regions more accurately than these existing detection methods. Besides, it has a good generalization ability that the network trained on one compression case can work in numerous compression cases. Moreover, it can detect different local forgeries, including copy-move, splicing, and object-removal.} }
Endnote
%0 Conference Paper %T FF-Net: An End-to-end Feature-Fusion Network for Double JPEG Detection and Localization %A Bo Liu %A Ranglei Wu %A Xiuli Bi %A Bin Xiao %B Proceedings of The 14th Asian Conference on Machine Learning %C Proceedings of Machine Learning Research %D 2023 %E Emtiyaz Khan %E Mehmet Gonen %F pmlr-v189-liu23a %I PMLR %P 643--657 %U https://proceedings.mlr.press/v189/liu23a.html %V 189 %X In the real-world, most images are saved in JPEG format, so many forged images are partially or totally composed of JPEG images and then saved in JPEG format again. In this case, exposing forged images can be accomplished by the detection of double JPEG compressions. Although the detection methods of double JPEG compressions have greatly improved, they rely on handcrafted features of image patches and cannot locate forgery at pixel-level. To break this limitation, we propose an end-to-end feature-fusion network (FF-Net) for double compression detection and forgery localization. We find that JPEG compression fingerprint primarily exists on the high-frequency component of an image, and the singly and doubly compression yield different fingerprints. Therefore, we design two encoders cooperatively to learn the compression fingerprint directly from the whole image. A decoder is deployed to locate the regions with different compression fingerprints at pixel-level based on the learned compression fingerprint. The experiment results verify that the proposed FF-Net can detect and locate the forged regions more accurately than these existing detection methods. Besides, it has a good generalization ability that the network trained on one compression case can work in numerous compression cases. Moreover, it can detect different local forgeries, including copy-move, splicing, and object-removal.
APA
Liu, B., Wu, R., Bi, X. & Xiao, B.. (2023). FF-Net: An End-to-end Feature-Fusion Network for Double JPEG Detection and Localization. Proceedings of The 14th Asian Conference on Machine Learning, in Proceedings of Machine Learning Research 189:643-657 Available from https://proceedings.mlr.press/v189/liu23a.html.

Related Material