Script for comparison of CoCa zero-shot to open_clip implementation

ghstack-source-id: ab570aec8104d8a09a9bf637a5c434bf479d8131 Pull Request resolved: #507
facebookresearch · Nov 15, 2023 · 3917e48 · 3917e48
1 parent fa81663
commit 3917e48
Show file tree

Hide file tree

Showing 10 changed files with 1,462 additions and 4 deletions.
diff --git a/...coca/benchmark_imagenet1k_laion2b_s13b_b90k_coca_ViT-L-14_en_zeroshot_classification.json b/...coca/benchmark_imagenet1k_laion2b_s13b_b90k_coca_ViT-L-14_en_zeroshot_classification.json
@@ -0,0 +1 @@
+{"dataset": "wds/imagenet1k", "model": "coca_ViT-L-14", "pretrained": "laion2b_s13b_b90k", "task": "zeroshot_classification", "metrics": {"acc1": 0.7564, "acc5": 0.94286, "mean_per_class_recall": 0.75652}, "language": "en"}