Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

The performance of DDAG on RegDB #5

Open
yjh576 opened this issue Dec 23, 2020 · 3 comments
Open

The performance of DDAG on RegDB #5

yjh576 opened this issue Dec 23, 2020 · 3 comments

Comments

@yjh576
Copy link

yjh576 commented Dec 23, 2020

This paper reports that DDGA is evaluated under both visible-to-infrared and infrared-to-visible query settings.
I re-implemented the code you published without making any changes. I obtain 31.25% map under visible to infrared setting, which is much more lower than 61.80% map reported in your paper. Under infrared to visible setting, similar results (61.97 vs 63.46) is still found.

Thanks in advances.

@mangye16
Copy link
Owner

mangye16 commented Jan 3, 2021

I suppose you might have made a mistake in the visible-to-infrared setting.

Just keep all the settings as default (Do not change the test_mode in [Line 69]), since this represents the feature extraction mode.

The only thing you need to change is the distance computation, changing the query and gallery setting.

@yjh576
Copy link
Author

yjh576 commented Jan 4, 2021

The visible-to-infrared setting is that
query_img, query_label = process_test_regdb(data_path, trial=args.trial, modal='visible')
gall_img, gall_label = process_test_regdb(data_path, trial=args.trial, modal='thermal').
The infrared-to-visible setting is that
query_img, query_label = process_test_regdb(data_path, trial=args.trial, modal='thermal'')
gall_img, gall_label = process_test_regdb(data_path, trial=args.trial, modal='visible').
Do you mean it?

Testing trial is only for RegDB dataset. Can you explain it in detail?

@mangye16
Copy link
Owner

mangye16 commented Jan 5, 2021

You may refer to the baseline code at test.py in Line 254.

Other parts are kept the same.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants