TOP1: 75.48 on cifar 10, much less than 83.4 reported in the paper.

[chester-w-xie]

Hi, I run the cifar.sh
in the end, the results output like this:

Epoch: [399][390/391]Time: 0.074 (0.308) Data: 0.008 (0.210) Loss: 1.6734 (1.5705)
10-NN,s=0.1: TOP1:  75.43
best accuracy: 75.62
doing PCA with 128 components ..done
10-NN,s=0.1: TOP1:  75.48
......
Epoch: [399][390/391]Time: 0.074 (0.308) Data: 0.008 (0.210) Loss: 1.6734 (1.5705)
10-NN,s=0.1: TOP1:  75.43
best accuracy: 75.62
doing PCA with 128 components ..done
10-NN,s=0.1: TOP1:  75.48

this result is much less than 83.4 reported in the paper. Can someone tell me why? Thank you very much!

[yukimasano]

Hi, thanks for the question. Note that the TOP1 that's being reported is the Nearest-Neighbor (NN) evaluation, which is typically lower than the linear-probing performance (83.4). You can find the NN performance in the bottom part of the table, where we obtained 77.6.