Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

FF++ c23 c40 result #8

Open
LOOKCC opened this issue Jun 7, 2022 · 5 comments
Open

FF++ c23 c40 result #8

LOOKCC opened this issue Jun 7, 2022 · 5 comments

Comments

@LOOKCC
Copy link

LOOKCC commented Jun 7, 2022

In paper 4.4. Cross-Manipulation Evaluation,“We use the raw version for evaluation as well as the competitors.” but the most of the CVPR2021 and ICCV21 papers all use the c23 as the FF++ result to compare. But there is no c23 and c40 results in your paper. And as we know, the raw result in ff++ is neally 100% auc which is meanless to compare the raw.

what's more, comparing with FTCN and LipForensics, "Robustness to unseen perturbations" part is lost in paper, So I want to konw the Robustness of Self-Blended.

@LOOKCC LOOKCC changed the title FF++ 冲3 FF++ c23 c40 result Jun 7, 2022
@M-SunRise
Copy link

Have you ever run the code on C40 and get any results?

@LOOKCC
Copy link
Author

LOOKCC commented Aug 29, 2022

Have you ever run the code on C40 and get any results?

I did some experiments on c23 and the results were not very satisfying to me.

@M-SunRise
Copy link

Thanks for your generous sharing.

@YU-SHAO-XU
Copy link

@LOOKCC would you tell me how to test FF++ dataset ? should we revise the code in inference._dataset.py !?

@Blosslzy
Copy link

I conducted experiments on c40, and the generalization to other datasets yielded good results. However, the performance was quite poor in the cross-manipulation evaluation on FF++. The AUC results were approximately NT-60.67, DF-66.72, F2F-64.54, and FS-56.19.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants