Script for comparison of CoCa zero-shot to open_clip implementation

ghstack-source-id: f004f4797350fd79c37437a2f87fa8fa32f48068 Pull Request resolved: #507
facebookresearch · Nov 2, 2023 · c8cd4a3 · c8cd4a3
1 parent df65bc9
commit c8cd4a3
Show file tree

Hide file tree

Showing 10 changed files with 1,462 additions and 4 deletions.
diff --git a/...coca/benchmark_imagenet1k_laion2b_s13b_b90k_coca_ViT-L-14_en_zeroshot_classification.json b/...coca/benchmark_imagenet1k_laion2b_s13b_b90k_coca_ViT-L-14_en_zeroshot_classification.json
@@ -0,0 +1 @@
+{"dataset": "wds/imagenet1k", "model": "coca_ViT-L-14", "pretrained": "laion2b_s13b_b90k", "task": "zeroshot_classification", "metrics": {"acc1": 0.7564, "acc5": 0.94286, "mean_per_class_recall": 0.75652}, "language": "en"}