-
Notifications
You must be signed in to change notification settings - Fork 35
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
FF++ c23 c40 result #8
Comments
Have you ever run the code on C40 and get any results? |
I did some experiments on c23 and the results were not very satisfying to me. |
Thanks for your generous sharing. |
@LOOKCC would you tell me how to test FF++ dataset ? should we revise the code in inference._dataset.py !? |
I conducted experiments on c40, and the generalization to other datasets yielded good results. However, the performance was quite poor in the cross-manipulation evaluation on FF++. The AUC results were approximately NT-60.67, DF-66.72, F2F-64.54, and FS-56.19. |
In paper 4.4. Cross-Manipulation Evaluation,“We use the raw version for evaluation as well as the competitors.” but the most of the CVPR2021 and ICCV21 papers all use the c23 as the FF++ result to compare. But there is no c23 and c40 results in your paper. And as we know, the raw result in ff++ is neally 100% auc which is meanless to compare the raw.
what's more, comparing with FTCN and LipForensics, "Robustness to unseen perturbations" part is lost in paper, So I want to konw the Robustness of Self-Blended.
The text was updated successfully, but these errors were encountered: