You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Hi OFA team, lots of appreciation for the great work!
Recently i've been trying to reproduce the experiments in the paper OFA-prompt, and i got a base-size model with accuracy of 73.08 on test-dev split.
However the test accuracy dropped significantly on test-std set, in which i only got around 22.38(11189 out of 50000).
below is my training script:
during evaluating, i changed batch-size to 80 and ran single chunked file in #68 . I wonder whether batch-size and size of test-size affects. Thanks for your attention @JustinLin610
The text was updated successfully, but these errors were encountered:
Hi OFA team, lots of appreciation for the great work!
Recently i've been trying to reproduce the experiments in the paper OFA-prompt, and i got a base-size model with accuracy of 73.08 on test-dev split.
However the test accuracy dropped significantly on test-std set, in which i only got around 22.38(11189 out of 50000).
below is my training script:
during evaluating, i changed batch-size to 80 and ran single chunked file in #68 . I wonder whether batch-size and size of test-size affects. Thanks for your attention @JustinLin610
The text was updated successfully, but these errors were encountered: