Replies: 2 comments
-
@tfriedel sketch, rendition (r), I consider to be quite out-of-distribution. The classes need to line up as these aren't open-set models / zero-shot models, but if you look at them they are quite different than imagenet images. ImageNet-v2 is also since it was a separate sampling of images, but there the goal was to try and match the selection criteria of imagenet in various ways though with a different pool of (more recent) images. |
Beta Was this translation helpful? Give feedback.
-
If you want to classify or cluster/search images outside the imagenet classes, I've long wanted to do a retrieval benchmark but it's quite involved so hasn't topped my priority list. But contributions welcome. |
Beta Was this translation helpful? Give feedback.
-
Describe the bug
I noticed this recent commit:
4515a43
It says in the results folder there are some results for OOD images. I couldn't find them. I was a bit unsure if maybe the sketches or adversarial images could have been meant as OOD? Or if there's actually some results for classes that are not part of the 1000 imagenet classes, but maybe they were not commited.
Beta Was this translation helpful? Give feedback.
All reactions