-
Notifications
You must be signed in to change notification settings - Fork 0
/
Copy pathveri_cm.log
1799 lines (1793 loc) · 125 KB
/
veri_cm.log
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463
464
465
466
467
468
469
470
471
472
473
474
475
476
477
478
479
480
481
482
483
484
485
486
487
488
489
490
491
492
493
494
495
496
497
498
499
500
501
502
503
504
505
506
507
508
509
510
511
512
513
514
515
516
517
518
519
520
521
522
523
524
525
526
527
528
529
530
531
532
533
534
535
536
537
538
539
540
541
542
543
544
545
546
547
548
549
550
551
552
553
554
555
556
557
558
559
560
561
562
563
564
565
566
567
568
569
570
571
572
573
574
575
576
577
578
579
580
581
582
583
584
585
586
587
588
589
590
591
592
593
594
595
596
597
598
599
600
601
602
603
604
605
606
607
608
609
610
611
612
613
614
615
616
617
618
619
620
621
622
623
624
625
626
627
628
629
630
631
632
633
634
635
636
637
638
639
640
641
642
643
644
645
646
647
648
649
650
651
652
653
654
655
656
657
658
659
660
661
662
663
664
665
666
667
668
669
670
671
672
673
674
675
676
677
678
679
680
681
682
683
684
685
686
687
688
689
690
691
692
693
694
695
696
697
698
699
700
701
702
703
704
705
706
707
708
709
710
711
712
713
714
715
716
717
718
719
720
721
722
723
724
725
726
727
728
729
730
731
732
733
734
735
736
737
738
739
740
741
742
743
744
745
746
747
748
749
750
751
752
753
754
755
756
757
758
759
760
761
762
763
764
765
766
767
768
769
770
771
772
773
774
775
776
777
778
779
780
781
782
783
784
785
786
787
788
789
790
791
792
793
794
795
796
797
798
799
800
801
802
803
804
805
806
807
808
809
810
811
812
813
814
815
816
817
818
819
820
821
822
823
824
825
826
827
828
829
830
831
832
833
834
835
836
837
838
839
840
841
842
843
844
845
846
847
848
849
850
851
852
853
854
855
856
857
858
859
860
861
862
863
864
865
866
867
868
869
870
871
872
873
874
875
876
877
878
879
880
881
882
883
884
885
886
887
888
889
890
891
892
893
894
895
896
897
898
899
900
901
902
903
904
905
906
907
908
909
910
911
912
913
914
915
916
917
918
919
920
921
922
923
924
925
926
927
928
929
930
931
932
933
934
935
936
937
938
939
940
941
942
943
944
945
946
947
948
949
950
951
952
953
954
955
956
957
958
959
960
961
962
963
964
965
966
967
968
969
970
971
972
973
974
975
976
977
978
979
980
981
982
983
984
985
986
987
988
989
990
991
992
993
994
995
996
997
998
999
1000
==========
Args:Namespace(arch='resnet50', batch_size=64, clustering='Kmeans', data_dir='/home/ljw/cluster-contrast/data', dataset='veri', dropout=0, epochs=50, eps=0.7, eps_gap=0.02, eval_step=10, features=0, height=224, iters=400, k1=30, k2=6, logs_dir='/home/ljw/cluster-contrast/logs', lr=0.00035, momentum=0.1, nmb_cluster=800, num_instances=16, pooling_type='gem', print_freq=10, seed=1, step_size=20, temp=0.05, use_hard=True, verbose=False, weight_decay=0.0005, width=224, workers=4)
==========
==> Load unlabeled dataset
self.dataset_dir /home/ljw/datasets/VeRi
=> VeRi loaded
Dataset statistics:
----------------------------------------
subset | # ids | # images | # cameras
----------------------------------------
train | 576 | 37778 | 20
query | 200 | 1678 | 19
gallery | 200 | 11579 | 19
----------------------------------------
pooling_type: gem
==> Create pseudo labels for unlabeled data
k-means time: 3 s
num_cluster 800
init---
==> Statistics for epoch 0: 800 clusters
Epoch: [0][10/400] Time 0.296 (0.468) Data 0.000 (0.032) Loss 6.629 (6.596)
Epoch: [0][20/400] Time 0.297 (0.382) Data 0.000 (0.016) Loss 6.735 (6.642)
Epoch: [0][30/400] Time 0.296 (0.354) Data 0.000 (0.011) Loss 6.784 (6.695)
Epoch: [0][40/400] Time 0.297 (0.339) Data 0.000 (0.008) Loss 6.731 (6.719)
Epoch: [0][50/400] Time 0.297 (0.331) Data 0.000 (0.006) Loss 6.699 (6.732)
Epoch: [0][60/400] Time 0.296 (0.325) Data 0.000 (0.005) Loss 6.543 (6.732)
Epoch: [0][70/400] Time 0.301 (0.321) Data 0.000 (0.005) Loss 6.637 (6.740)
Epoch: [0][80/400] Time 0.297 (0.318) Data 0.000 (0.004) Loss 7.012 (6.740)
Epoch: [0][90/400] Time 0.296 (0.316) Data 0.000 (0.004) Loss 6.945 (6.734)
Epoch: [0][100/400] Time 0.297 (0.314) Data 0.000 (0.003) Loss 6.624 (6.739)
Epoch: [0][110/400] Time 0.297 (0.312) Data 0.000 (0.003) Loss 6.627 (6.738)
Epoch: [0][120/400] Time 0.295 (0.311) Data 0.000 (0.003) Loss 6.660 (6.741)
Epoch: [0][130/400] Time 0.296 (0.310) Data 0.000 (0.003) Loss 6.687 (6.739)
Epoch: [0][140/400] Time 0.297 (0.309) Data 0.000 (0.002) Loss 6.889 (6.736)
Epoch: [0][150/400] Time 0.296 (0.308) Data 0.000 (0.002) Loss 6.636 (6.740)
Epoch: [0][160/400] Time 0.297 (0.307) Data 0.000 (0.002) Loss 6.719 (6.742)
Epoch: [0][170/400] Time 0.297 (0.307) Data 0.000 (0.002) Loss 6.662 (6.740)
Epoch: [0][180/400] Time 0.297 (0.306) Data 0.000 (0.002) Loss 6.850 (6.743)
Epoch: [0][190/400] Time 0.296 (0.306) Data 0.000 (0.002) Loss 6.655 (6.740)
Epoch: [0][200/400] Time 0.295 (0.305) Data 0.000 (0.002) Loss 6.806 (6.737)
Epoch: [0][210/400] Time 0.298 (0.308) Data 0.000 (0.005) Loss 6.625 (6.723)
Epoch: [0][220/400] Time 0.297 (0.308) Data 0.000 (0.005) Loss 6.171 (6.709)
Epoch: [0][230/400] Time 0.299 (0.307) Data 0.000 (0.004) Loss 6.915 (6.711)
Epoch: [0][240/400] Time 0.296 (0.307) Data 0.000 (0.004) Loss 6.953 (6.716)
Epoch: [0][250/400] Time 0.297 (0.306) Data 0.000 (0.004) Loss 7.321 (6.725)
Epoch: [0][260/400] Time 0.296 (0.306) Data 0.000 (0.004) Loss 7.090 (6.737)
Epoch: [0][270/400] Time 0.298 (0.306) Data 0.000 (0.004) Loss 7.262 (6.747)
Epoch: [0][280/400] Time 0.296 (0.305) Data 0.000 (0.004) Loss 7.212 (6.755)
Epoch: [0][290/400] Time 0.306 (0.305) Data 0.000 (0.003) Loss 6.943 (6.763)
Epoch: [0][300/400] Time 0.305 (0.305) Data 0.000 (0.003) Loss 6.495 (6.766)
Epoch: [0][310/400] Time 0.304 (0.305) Data 0.000 (0.003) Loss 7.220 (6.774)
Epoch: [0][320/400] Time 0.311 (0.305) Data 0.000 (0.003) Loss 7.148 (6.786)
Epoch: [0][330/400] Time 0.314 (0.306) Data 0.000 (0.003) Loss 6.791 (6.795)
Epoch: [0][340/400] Time 0.314 (0.306) Data 0.000 (0.003) Loss 7.070 (6.799)
Epoch: [0][350/400] Time 0.312 (0.306) Data 0.000 (0.003) Loss 6.905 (6.809)
Epoch: [0][360/400] Time 0.314 (0.306) Data 0.000 (0.003) Loss 7.023 (6.811)
Epoch: [0][370/400] Time 0.313 (0.306) Data 0.000 (0.003) Loss 7.050 (6.812)
Epoch: [0][380/400] Time 0.313 (0.307) Data 0.000 (0.003) Loss 6.700 (6.814)
Epoch: [0][390/400] Time 0.312 (0.307) Data 0.000 (0.003) Loss 7.333 (6.818)
Epoch: [0][400/400] Time 0.313 (0.307) Data 0.000 (0.003) Loss 6.957 (6.820)
==> Create pseudo labels for unlabeled data
k-means time: 2 s
num_cluster 800
init---
==> Statistics for epoch 1: 800 clusters
Epoch: [1][10/400] Time 0.316 (0.348) Data 0.000 (0.035) Loss 5.926 (5.471)
Epoch: [1][20/400] Time 0.313 (0.331) Data 0.000 (0.018) Loss 5.108 (5.609)
Epoch: [1][30/400] Time 0.316 (0.326) Data 0.000 (0.012) Loss 5.301 (5.670)
Epoch: [1][40/400] Time 0.314 (0.323) Data 0.000 (0.009) Loss 4.980 (5.776)
Epoch: [1][50/400] Time 0.315 (0.321) Data 0.000 (0.007) Loss 5.714 (5.801)
Epoch: [1][60/400] Time 0.313 (0.320) Data 0.000 (0.006) Loss 6.391 (5.827)
Epoch: [1][70/400] Time 0.318 (0.320) Data 0.000 (0.005) Loss 5.755 (5.872)
Epoch: [1][80/400] Time 0.319 (0.319) Data 0.000 (0.004) Loss 5.449 (5.884)
Epoch: [1][90/400] Time 0.315 (0.319) Data 0.000 (0.004) Loss 6.221 (5.871)
Epoch: [1][100/400] Time 0.321 (0.319) Data 0.000 (0.004) Loss 7.188 (5.875)
Epoch: [1][110/400] Time 0.319 (0.319) Data 0.000 (0.003) Loss 6.213 (5.884)
Epoch: [1][120/400] Time 0.317 (0.319) Data 0.000 (0.003) Loss 5.406 (5.890)
Epoch: [1][130/400] Time 0.319 (0.319) Data 0.000 (0.003) Loss 5.238 (5.881)
Epoch: [1][140/400] Time 0.318 (0.319) Data 0.000 (0.003) Loss 5.762 (5.868)
Epoch: [1][150/400] Time 0.321 (0.319) Data 0.000 (0.002) Loss 5.490 (5.848)
Epoch: [1][160/400] Time 0.319 (0.319) Data 0.000 (0.002) Loss 6.258 (5.836)
Epoch: [1][170/400] Time 0.317 (0.319) Data 0.000 (0.002) Loss 6.004 (5.830)
Epoch: [1][180/400] Time 0.319 (0.319) Data 0.000 (0.002) Loss 5.526 (5.823)
Epoch: [1][190/400] Time 0.318 (0.319) Data 0.000 (0.002) Loss 4.934 (5.817)
Epoch: [1][200/400] Time 0.317 (0.319) Data 0.000 (0.002) Loss 4.680 (5.785)
Epoch: [1][210/400] Time 0.320 (0.322) Data 0.000 (0.005) Loss 6.856 (5.794)
Epoch: [1][220/400] Time 0.315 (0.322) Data 0.000 (0.005) Loss 6.089 (5.806)
Epoch: [1][230/400] Time 0.316 (0.322) Data 0.000 (0.005) Loss 6.280 (5.814)
Epoch: [1][240/400] Time 0.315 (0.321) Data 0.000 (0.004) Loss 6.065 (5.823)
Epoch: [1][250/400] Time 0.315 (0.321) Data 0.000 (0.004) Loss 6.243 (5.829)
Epoch: [1][260/400] Time 0.315 (0.321) Data 0.000 (0.004) Loss 6.119 (5.850)
Epoch: [1][270/400] Time 0.314 (0.321) Data 0.000 (0.004) Loss 6.496 (5.865)
Epoch: [1][280/400] Time 0.315 (0.321) Data 0.000 (0.004) Loss 6.078 (5.877)
Epoch: [1][290/400] Time 0.317 (0.320) Data 0.000 (0.004) Loss 6.280 (5.881)
Epoch: [1][300/400] Time 0.315 (0.320) Data 0.000 (0.003) Loss 6.012 (5.893)
Epoch: [1][310/400] Time 0.316 (0.320) Data 0.000 (0.003) Loss 6.263 (5.902)
Epoch: [1][320/400] Time 0.316 (0.320) Data 0.000 (0.003) Loss 6.534 (5.908)
Epoch: [1][330/400] Time 0.315 (0.320) Data 0.000 (0.003) Loss 6.517 (5.916)
Epoch: [1][340/400] Time 0.318 (0.320) Data 0.000 (0.003) Loss 6.519 (5.923)
Epoch: [1][350/400] Time 0.316 (0.320) Data 0.000 (0.003) Loss 5.842 (5.928)
Epoch: [1][360/400] Time 0.320 (0.320) Data 0.000 (0.003) Loss 5.853 (5.933)
Epoch: [1][370/400] Time 0.322 (0.320) Data 0.000 (0.003) Loss 6.613 (5.942)
Epoch: [1][380/400] Time 0.318 (0.320) Data 0.000 (0.003) Loss 6.423 (5.950)
Epoch: [1][390/400] Time 0.318 (0.320) Data 0.000 (0.003) Loss 5.838 (5.954)
Epoch: [1][400/400] Time 0.319 (0.320) Data 0.000 (0.003) Loss 6.448 (5.962)
==> Create pseudo labels for unlabeled data
k-means time: 2 s
num_cluster 800
init---
==> Statistics for epoch 2: 800 clusters
Epoch: [2][10/400] Time 0.318 (0.358) Data 0.000 (0.036) Loss 3.937 (4.007)
Epoch: [2][20/400] Time 0.322 (0.339) Data 0.000 (0.018) Loss 4.639 (4.179)
Epoch: [2][30/400] Time 0.319 (0.333) Data 0.000 (0.012) Loss 4.394 (4.330)
Epoch: [2][40/400] Time 0.315 (0.330) Data 0.000 (0.009) Loss 4.635 (4.339)
Epoch: [2][50/400] Time 0.320 (0.329) Data 0.000 (0.007) Loss 4.538 (4.334)
Epoch: [2][60/400] Time 0.323 (0.327) Data 0.000 (0.006) Loss 4.554 (4.314)
Epoch: [2][70/400] Time 0.321 (0.327) Data 0.000 (0.005) Loss 4.037 (4.307)
Epoch: [2][80/400] Time 0.322 (0.326) Data 0.000 (0.005) Loss 4.375 (4.300)
Epoch: [2][90/400] Time 0.322 (0.326) Data 0.000 (0.004) Loss 3.969 (4.305)
Epoch: [2][100/400] Time 0.324 (0.325) Data 0.000 (0.004) Loss 4.238 (4.294)
Epoch: [2][110/400] Time 0.320 (0.325) Data 0.000 (0.003) Loss 3.436 (4.264)
Epoch: [2][120/400] Time 0.322 (0.325) Data 0.000 (0.003) Loss 3.912 (4.255)
Epoch: [2][130/400] Time 0.324 (0.324) Data 0.000 (0.003) Loss 4.465 (4.263)
Epoch: [2][140/400] Time 0.322 (0.324) Data 0.000 (0.003) Loss 3.897 (4.265)
Epoch: [2][150/400] Time 0.321 (0.324) Data 0.000 (0.002) Loss 4.866 (4.268)
Epoch: [2][160/400] Time 0.323 (0.324) Data 0.000 (0.002) Loss 4.936 (4.297)
Epoch: [2][170/400] Time 0.321 (0.324) Data 0.000 (0.002) Loss 5.199 (4.298)
Epoch: [2][180/400] Time 0.322 (0.324) Data 0.000 (0.002) Loss 2.946 (4.280)
Epoch: [2][190/400] Time 0.322 (0.323) Data 0.000 (0.002) Loss 3.570 (4.269)
Epoch: [2][200/400] Time 0.317 (0.323) Data 0.000 (0.002) Loss 5.056 (4.271)
Epoch: [2][210/400] Time 0.314 (0.326) Data 0.000 (0.005) Loss 5.490 (4.319)
Epoch: [2][220/400] Time 0.316 (0.326) Data 0.000 (0.005) Loss 5.159 (4.372)
Epoch: [2][230/400] Time 0.321 (0.326) Data 0.000 (0.005) Loss 5.408 (4.400)
Epoch: [2][240/400] Time 0.319 (0.325) Data 0.000 (0.005) Loss 5.596 (4.448)
Epoch: [2][250/400] Time 0.323 (0.325) Data 0.000 (0.004) Loss 4.633 (4.485)
Epoch: [2][260/400] Time 0.320 (0.325) Data 0.000 (0.004) Loss 4.608 (4.529)
Epoch: [2][270/400] Time 0.323 (0.325) Data 0.000 (0.004) Loss 5.207 (4.562)
Epoch: [2][280/400] Time 0.316 (0.325) Data 0.000 (0.004) Loss 4.629 (4.593)
Epoch: [2][290/400] Time 0.317 (0.324) Data 0.000 (0.004) Loss 4.958 (4.619)
Epoch: [2][300/400] Time 0.318 (0.324) Data 0.000 (0.004) Loss 5.396 (4.638)
Epoch: [2][310/400] Time 0.323 (0.324) Data 0.000 (0.004) Loss 4.565 (4.665)
Epoch: [2][320/400] Time 0.317 (0.324) Data 0.000 (0.004) Loss 5.662 (4.699)
Epoch: [2][330/400] Time 0.322 (0.324) Data 0.000 (0.003) Loss 6.249 (4.725)
Epoch: [2][340/400] Time 0.321 (0.324) Data 0.000 (0.003) Loss 5.448 (4.744)
Epoch: [2][350/400] Time 0.322 (0.324) Data 0.000 (0.003) Loss 5.483 (4.763)
Epoch: [2][360/400] Time 0.318 (0.324) Data 0.000 (0.003) Loss 5.717 (4.775)
Epoch: [2][370/400] Time 0.321 (0.324) Data 0.000 (0.003) Loss 5.486 (4.796)
Epoch: [2][380/400] Time 0.317 (0.323) Data 0.000 (0.003) Loss 4.808 (4.812)
Epoch: [2][390/400] Time 0.322 (0.323) Data 0.000 (0.003) Loss 5.151 (4.820)
Epoch: [2][400/400] Time 0.317 (0.323) Data 0.000 (0.003) Loss 5.303 (4.832)
==> Create pseudo labels for unlabeled data
k-means time: 2 s
num_cluster 800
init---
==> Statistics for epoch 3: 800 clusters
Epoch: [3][10/400] Time 0.315 (0.351) Data 0.000 (0.034) Loss 3.356 (3.802)
Epoch: [3][20/400] Time 0.316 (0.334) Data 0.000 (0.017) Loss 3.762 (3.686)
Epoch: [3][30/400] Time 0.320 (0.328) Data 0.000 (0.011) Loss 3.875 (3.605)
Epoch: [3][40/400] Time 0.315 (0.326) Data 0.000 (0.009) Loss 3.488 (3.517)
Epoch: [3][50/400] Time 0.316 (0.324) Data 0.000 (0.007) Loss 3.904 (3.584)
Epoch: [3][60/400] Time 0.316 (0.323) Data 0.000 (0.006) Loss 4.949 (3.568)
Epoch: [3][70/400] Time 0.317 (0.322) Data 0.000 (0.005) Loss 3.282 (3.579)
Epoch: [3][80/400] Time 0.316 (0.322) Data 0.000 (0.004) Loss 3.693 (3.571)
Epoch: [3][90/400] Time 0.320 (0.321) Data 0.000 (0.004) Loss 3.860 (3.620)
Epoch: [3][100/400] Time 0.321 (0.321) Data 0.000 (0.004) Loss 2.841 (3.618)
Epoch: [3][110/400] Time 0.323 (0.321) Data 0.000 (0.003) Loss 3.563 (3.641)
Epoch: [3][120/400] Time 0.322 (0.321) Data 0.000 (0.003) Loss 3.322 (3.605)
Epoch: [3][130/400] Time 0.320 (0.321) Data 0.000 (0.003) Loss 3.530 (3.600)
Epoch: [3][140/400] Time 0.318 (0.321) Data 0.000 (0.003) Loss 4.008 (3.618)
Epoch: [3][150/400] Time 0.320 (0.321) Data 0.000 (0.002) Loss 2.573 (3.614)
Epoch: [3][160/400] Time 0.324 (0.321) Data 0.000 (0.002) Loss 3.203 (3.602)
Epoch: [3][170/400] Time 0.318 (0.321) Data 0.000 (0.002) Loss 3.981 (3.603)
Epoch: [3][180/400] Time 0.319 (0.320) Data 0.000 (0.002) Loss 4.226 (3.580)
Epoch: [3][190/400] Time 0.319 (0.320) Data 0.000 (0.002) Loss 3.117 (3.561)
Epoch: [3][200/400] Time 0.315 (0.320) Data 0.000 (0.002) Loss 3.478 (3.553)
Epoch: [3][210/400] Time 0.320 (0.325) Data 0.000 (0.006) Loss 5.208 (3.620)
Epoch: [3][220/400] Time 0.321 (0.325) Data 0.000 (0.006) Loss 4.940 (3.691)
Epoch: [3][230/400] Time 0.319 (0.324) Data 0.000 (0.006) Loss 5.518 (3.754)
Epoch: [3][240/400] Time 0.316 (0.324) Data 0.000 (0.006) Loss 5.801 (3.822)
Epoch: [3][250/400] Time 0.317 (0.324) Data 0.000 (0.005) Loss 5.066 (3.877)
Epoch: [3][260/400] Time 0.322 (0.324) Data 0.000 (0.005) Loss 5.509 (3.921)
Epoch: [3][270/400] Time 0.319 (0.324) Data 0.000 (0.005) Loss 5.434 (3.971)
Epoch: [3][280/400] Time 0.320 (0.323) Data 0.000 (0.005) Loss 4.599 (4.011)
Epoch: [3][290/400] Time 0.321 (0.323) Data 0.000 (0.005) Loss 4.958 (4.044)
Epoch: [3][300/400] Time 0.320 (0.323) Data 0.000 (0.004) Loss 6.199 (4.082)
Epoch: [3][310/400] Time 0.315 (0.323) Data 0.000 (0.004) Loss 5.024 (4.110)
Epoch: [3][320/400] Time 0.321 (0.323) Data 0.000 (0.004) Loss 4.938 (4.145)
Epoch: [3][330/400] Time 0.320 (0.323) Data 0.000 (0.004) Loss 6.034 (4.180)
Epoch: [3][340/400] Time 0.316 (0.323) Data 0.000 (0.004) Loss 5.255 (4.201)
Epoch: [3][350/400] Time 0.316 (0.323) Data 0.000 (0.004) Loss 4.313 (4.219)
Epoch: [3][360/400] Time 0.315 (0.322) Data 0.000 (0.004) Loss 5.494 (4.241)
Epoch: [3][370/400] Time 0.320 (0.322) Data 0.000 (0.004) Loss 5.201 (4.265)
Epoch: [3][380/400] Time 0.322 (0.322) Data 0.000 (0.004) Loss 5.672 (4.287)
Epoch: [3][390/400] Time 0.316 (0.322) Data 0.000 (0.003) Loss 4.372 (4.306)
Epoch: [3][400/400] Time 0.318 (0.322) Data 0.000 (0.003) Loss 3.946 (4.324)
==> Create pseudo labels for unlabeled data
k-means time: 2 s
num_cluster 800
init---
==> Statistics for epoch 4: 800 clusters
Epoch: [4][10/400] Time 0.315 (0.348) Data 0.000 (0.031) Loss 3.437 (3.487)
Epoch: [4][20/400] Time 0.314 (0.331) Data 0.000 (0.016) Loss 3.225 (3.503)
Epoch: [4][30/400] Time 0.320 (0.326) Data 0.000 (0.011) Loss 3.662 (3.479)
Epoch: [4][40/400] Time 0.315 (0.323) Data 0.000 (0.008) Loss 2.622 (3.389)
Epoch: [4][50/400] Time 0.320 (0.323) Data 0.000 (0.006) Loss 2.996 (3.340)
Epoch: [4][60/400] Time 0.323 (0.322) Data 0.000 (0.005) Loss 2.546 (3.258)
Epoch: [4][70/400] Time 0.318 (0.321) Data 0.000 (0.005) Loss 4.291 (3.253)
Epoch: [4][80/400] Time 0.315 (0.321) Data 0.000 (0.004) Loss 2.732 (3.219)
Epoch: [4][90/400] Time 0.315 (0.320) Data 0.000 (0.004) Loss 3.070 (3.256)
Epoch: [4][100/400] Time 0.322 (0.320) Data 0.000 (0.003) Loss 2.507 (3.240)
Epoch: [4][110/400] Time 0.316 (0.320) Data 0.000 (0.003) Loss 2.775 (3.226)
Epoch: [4][120/400] Time 0.315 (0.320) Data 0.000 (0.003) Loss 2.951 (3.216)
Epoch: [4][130/400] Time 0.321 (0.319) Data 0.000 (0.003) Loss 2.925 (3.204)
Epoch: [4][140/400] Time 0.320 (0.319) Data 0.000 (0.002) Loss 3.357 (3.195)
Epoch: [4][150/400] Time 0.315 (0.319) Data 0.000 (0.002) Loss 3.104 (3.190)
Epoch: [4][160/400] Time 0.318 (0.319) Data 0.000 (0.002) Loss 2.919 (3.168)
Epoch: [4][170/400] Time 0.319 (0.319) Data 0.000 (0.002) Loss 2.087 (3.162)
Epoch: [4][180/400] Time 0.316 (0.319) Data 0.000 (0.002) Loss 2.476 (3.139)
Epoch: [4][190/400] Time 0.320 (0.319) Data 0.000 (0.002) Loss 2.403 (3.120)
Epoch: [4][200/400] Time 0.319 (0.319) Data 0.000 (0.002) Loss 2.733 (3.110)
Epoch: [4][210/400] Time 0.319 (0.323) Data 0.000 (0.005) Loss 5.393 (3.183)
Epoch: [4][220/400] Time 0.319 (0.323) Data 0.000 (0.005) Loss 4.743 (3.245)
Epoch: [4][230/400] Time 0.315 (0.322) Data 0.000 (0.005) Loss 4.882 (3.308)
Epoch: [4][240/400] Time 0.322 (0.322) Data 0.000 (0.005) Loss 4.664 (3.381)
Epoch: [4][250/400] Time 0.316 (0.322) Data 0.000 (0.005) Loss 5.469 (3.437)
Epoch: [4][260/400] Time 0.323 (0.322) Data 0.000 (0.004) Loss 5.287 (3.502)
Epoch: [4][270/400] Time 0.320 (0.322) Data 0.000 (0.004) Loss 4.651 (3.558)
Epoch: [4][280/400] Time 0.323 (0.322) Data 0.000 (0.004) Loss 5.114 (3.610)
Epoch: [4][290/400] Time 0.325 (0.322) Data 0.000 (0.004) Loss 5.203 (3.660)
Epoch: [4][300/400] Time 0.318 (0.322) Data 0.000 (0.004) Loss 5.221 (3.696)
Epoch: [4][310/400] Time 0.324 (0.322) Data 0.000 (0.004) Loss 4.741 (3.735)
Epoch: [4][320/400] Time 0.315 (0.322) Data 0.000 (0.004) Loss 4.529 (3.767)
Epoch: [4][330/400] Time 0.321 (0.322) Data 0.000 (0.004) Loss 4.837 (3.806)
Epoch: [4][340/400] Time 0.322 (0.322) Data 0.000 (0.003) Loss 5.791 (3.846)
Epoch: [4][350/400] Time 0.325 (0.322) Data 0.000 (0.003) Loss 5.053 (3.873)
Epoch: [4][360/400] Time 0.323 (0.322) Data 0.000 (0.003) Loss 6.137 (3.899)
Epoch: [4][370/400] Time 0.323 (0.322) Data 0.000 (0.003) Loss 4.947 (3.922)
Epoch: [4][380/400] Time 0.317 (0.322) Data 0.000 (0.003) Loss 4.781 (3.950)
Epoch: [4][390/400] Time 0.315 (0.322) Data 0.000 (0.003) Loss 5.639 (3.968)
Epoch: [4][400/400] Time 0.316 (0.322) Data 0.000 (0.003) Loss 4.876 (3.991)
==> Create pseudo labels for unlabeled data
k-means time: 2 s
num_cluster 800
init---
==> Statistics for epoch 5: 800 clusters
Epoch: [5][10/400] Time 0.321 (0.352) Data 0.000 (0.031) Loss 2.940 (3.307)
Epoch: [5][20/400] Time 0.314 (0.334) Data 0.000 (0.016) Loss 3.660 (3.219)
Epoch: [5][30/400] Time 0.315 (0.328) Data 0.000 (0.010) Loss 3.374 (3.217)
Epoch: [5][40/400] Time 0.313 (0.324) Data 0.000 (0.008) Loss 3.291 (3.143)
Epoch: [5][50/400] Time 0.315 (0.322) Data 0.000 (0.006) Loss 4.329 (3.193)
Epoch: [5][60/400] Time 0.319 (0.321) Data 0.000 (0.005) Loss 4.354 (3.227)
Epoch: [5][70/400] Time 0.317 (0.320) Data 0.000 (0.005) Loss 3.475 (3.195)
Epoch: [5][80/400] Time 0.316 (0.320) Data 0.000 (0.004) Loss 3.067 (3.210)
Epoch: [5][90/400] Time 0.313 (0.319) Data 0.000 (0.004) Loss 3.611 (3.190)
Epoch: [5][100/400] Time 0.314 (0.319) Data 0.000 (0.003) Loss 2.444 (3.170)
Epoch: [5][110/400] Time 0.317 (0.318) Data 0.000 (0.003) Loss 3.192 (3.181)
Epoch: [5][120/400] Time 0.315 (0.318) Data 0.000 (0.003) Loss 3.040 (3.192)
Epoch: [5][130/400] Time 0.314 (0.318) Data 0.000 (0.002) Loss 2.495 (3.193)
Epoch: [5][140/400] Time 0.315 (0.318) Data 0.000 (0.002) Loss 2.789 (3.172)
Epoch: [5][150/400] Time 0.315 (0.317) Data 0.000 (0.002) Loss 2.882 (3.167)
Epoch: [5][160/400] Time 0.314 (0.317) Data 0.000 (0.002) Loss 2.926 (3.162)
Epoch: [5][170/400] Time 0.315 (0.317) Data 0.000 (0.002) Loss 3.541 (3.149)
Epoch: [5][180/400] Time 0.314 (0.317) Data 0.000 (0.002) Loss 2.811 (3.168)
Epoch: [5][190/400] Time 0.315 (0.317) Data 0.000 (0.002) Loss 3.675 (3.167)
Epoch: [5][200/400] Time 0.314 (0.317) Data 0.000 (0.002) Loss 4.397 (3.164)
Epoch: [5][210/400] Time 0.315 (0.320) Data 0.000 (0.005) Loss 3.947 (3.233)
Epoch: [5][220/400] Time 0.325 (0.320) Data 0.000 (0.005) Loss 3.974 (3.291)
Epoch: [5][230/400] Time 0.318 (0.320) Data 0.000 (0.004) Loss 5.605 (3.361)
Epoch: [5][240/400] Time 0.318 (0.320) Data 0.000 (0.004) Loss 4.520 (3.424)
Epoch: [5][250/400] Time 0.315 (0.320) Data 0.000 (0.004) Loss 5.200 (3.469)
Epoch: [5][260/400] Time 0.318 (0.320) Data 0.000 (0.004) Loss 4.425 (3.514)
Epoch: [5][270/400] Time 0.324 (0.320) Data 0.000 (0.004) Loss 4.682 (3.563)
Epoch: [5][280/400] Time 0.322 (0.320) Data 0.000 (0.004) Loss 5.563 (3.615)
Epoch: [5][290/400] Time 0.315 (0.320) Data 0.000 (0.004) Loss 4.830 (3.654)
Epoch: [5][300/400] Time 0.319 (0.320) Data 0.000 (0.003) Loss 4.467 (3.691)
Epoch: [5][310/400] Time 0.321 (0.320) Data 0.000 (0.003) Loss 3.640 (3.730)
Epoch: [5][320/400] Time 0.324 (0.320) Data 0.000 (0.003) Loss 4.020 (3.756)
Epoch: [5][330/400] Time 0.323 (0.320) Data 0.000 (0.003) Loss 4.796 (3.776)
Epoch: [5][340/400] Time 0.324 (0.320) Data 0.000 (0.003) Loss 4.583 (3.801)
Epoch: [5][350/400] Time 0.320 (0.320) Data 0.000 (0.003) Loss 5.131 (3.821)
Epoch: [5][360/400] Time 0.321 (0.320) Data 0.000 (0.003) Loss 5.157 (3.839)
Epoch: [5][370/400] Time 0.316 (0.320) Data 0.000 (0.003) Loss 4.549 (3.863)
Epoch: [5][380/400] Time 0.322 (0.320) Data 0.000 (0.003) Loss 4.575 (3.886)
Epoch: [5][390/400] Time 0.314 (0.320) Data 0.000 (0.003) Loss 4.339 (3.898)
Epoch: [5][400/400] Time 0.317 (0.320) Data 0.000 (0.003) Loss 4.777 (3.919)
==> Create pseudo labels for unlabeled data
k-means time: 2 s
num_cluster 800
init---
==> Statistics for epoch 6: 800 clusters
Epoch: [6][10/400] Time 0.316 (0.347) Data 0.000 (0.029) Loss 3.924 (2.976)
Epoch: [6][20/400] Time 0.321 (0.333) Data 0.000 (0.015) Loss 3.959 (2.922)
Epoch: [6][30/400] Time 0.315 (0.328) Data 0.000 (0.010) Loss 4.027 (2.963)
Epoch: [6][40/400] Time 0.313 (0.326) Data 0.000 (0.007) Loss 2.408 (2.906)
Epoch: [6][50/400] Time 0.315 (0.324) Data 0.000 (0.006) Loss 3.093 (2.921)
Epoch: [6][60/400] Time 0.316 (0.323) Data 0.000 (0.005) Loss 3.251 (2.887)
Epoch: [6][70/400] Time 0.315 (0.322) Data 0.000 (0.004) Loss 2.873 (2.887)
Epoch: [6][80/400] Time 0.319 (0.322) Data 0.000 (0.004) Loss 3.280 (2.894)
Epoch: [6][90/400] Time 0.317 (0.321) Data 0.000 (0.003) Loss 1.959 (2.861)
Epoch: [6][100/400] Time 0.317 (0.321) Data 0.000 (0.003) Loss 3.535 (2.890)
Epoch: [6][110/400] Time 0.321 (0.321) Data 0.000 (0.003) Loss 3.045 (2.890)
Epoch: [6][120/400] Time 0.318 (0.321) Data 0.000 (0.003) Loss 2.216 (2.872)
Epoch: [6][130/400] Time 0.319 (0.321) Data 0.000 (0.002) Loss 3.341 (2.883)
Epoch: [6][140/400] Time 0.322 (0.321) Data 0.000 (0.002) Loss 2.624 (2.871)
Epoch: [6][150/400] Time 0.316 (0.320) Data 0.000 (0.002) Loss 3.290 (2.850)
Epoch: [6][160/400] Time 0.322 (0.320) Data 0.000 (0.002) Loss 2.381 (2.832)
Epoch: [6][170/400] Time 0.318 (0.320) Data 0.000 (0.002) Loss 3.142 (2.809)
Epoch: [6][180/400] Time 0.320 (0.320) Data 0.000 (0.002) Loss 2.889 (2.819)
Epoch: [6][190/400] Time 0.327 (0.320) Data 0.000 (0.002) Loss 3.020 (2.815)
Epoch: [6][200/400] Time 0.321 (0.320) Data 0.000 (0.002) Loss 2.142 (2.798)
Epoch: [6][210/400] Time 0.320 (0.323) Data 0.000 (0.005) Loss 4.482 (2.874)
Epoch: [6][220/400] Time 0.319 (0.323) Data 0.000 (0.004) Loss 3.858 (2.934)
Epoch: [6][230/400] Time 0.320 (0.323) Data 0.000 (0.004) Loss 4.420 (3.004)
Epoch: [6][240/400] Time 0.319 (0.323) Data 0.000 (0.004) Loss 5.217 (3.079)
Epoch: [6][250/400] Time 0.321 (0.323) Data 0.000 (0.004) Loss 5.226 (3.145)
Epoch: [6][260/400] Time 0.318 (0.323) Data 0.000 (0.004) Loss 4.223 (3.206)
Epoch: [6][270/400] Time 0.317 (0.323) Data 0.000 (0.004) Loss 5.071 (3.256)
Epoch: [6][280/400] Time 0.321 (0.322) Data 0.000 (0.004) Loss 5.168 (3.302)
Epoch: [6][290/400] Time 0.319 (0.322) Data 0.000 (0.003) Loss 5.149 (3.356)
Epoch: [6][300/400] Time 0.317 (0.322) Data 0.000 (0.003) Loss 4.109 (3.401)
Epoch: [6][310/400] Time 0.319 (0.322) Data 0.000 (0.003) Loss 4.420 (3.449)
Epoch: [6][320/400] Time 0.318 (0.322) Data 0.000 (0.003) Loss 5.282 (3.484)
Epoch: [6][330/400] Time 0.319 (0.322) Data 0.000 (0.003) Loss 4.310 (3.524)
Epoch: [6][340/400] Time 0.318 (0.322) Data 0.000 (0.003) Loss 5.089 (3.575)
Epoch: [6][350/400] Time 0.320 (0.322) Data 0.000 (0.003) Loss 4.942 (3.601)
Epoch: [6][360/400] Time 0.315 (0.322) Data 0.000 (0.003) Loss 4.477 (3.628)
Epoch: [6][370/400] Time 0.319 (0.322) Data 0.000 (0.003) Loss 4.169 (3.654)
Epoch: [6][380/400] Time 0.317 (0.322) Data 0.000 (0.003) Loss 3.625 (3.680)
Epoch: [6][390/400] Time 0.317 (0.322) Data 0.000 (0.003) Loss 4.130 (3.699)
Epoch: [6][400/400] Time 0.316 (0.322) Data 0.000 (0.002) Loss 5.220 (3.720)
==> Create pseudo labels for unlabeled data
k-means time: 2 s
num_cluster 800
init---
==> Statistics for epoch 7: 800 clusters
Epoch: [7][10/400] Time 0.314 (0.358) Data 0.000 (0.039) Loss 2.805 (2.857)
Epoch: [7][20/400] Time 0.315 (0.338) Data 0.000 (0.019) Loss 2.875 (2.877)
Epoch: [7][30/400] Time 0.322 (0.332) Data 0.000 (0.013) Loss 2.613 (2.831)
Epoch: [7][40/400] Time 0.319 (0.329) Data 0.000 (0.010) Loss 2.280 (2.872)
Epoch: [7][50/400] Time 0.318 (0.327) Data 0.000 (0.008) Loss 3.057 (2.847)
Epoch: [7][60/400] Time 0.320 (0.326) Data 0.000 (0.007) Loss 3.224 (2.840)
Epoch: [7][70/400] Time 0.321 (0.325) Data 0.000 (0.006) Loss 3.943 (2.851)
Epoch: [7][80/400] Time 0.317 (0.324) Data 0.000 (0.005) Loss 2.917 (2.849)
Epoch: [7][90/400] Time 0.319 (0.324) Data 0.000 (0.004) Loss 2.956 (2.795)
Epoch: [7][100/400] Time 0.318 (0.323) Data 0.000 (0.004) Loss 3.153 (2.766)
Epoch: [7][110/400] Time 0.323 (0.323) Data 0.000 (0.004) Loss 1.519 (2.762)
Epoch: [7][120/400] Time 0.318 (0.323) Data 0.000 (0.003) Loss 2.023 (2.744)
Epoch: [7][130/400] Time 0.323 (0.322) Data 0.000 (0.003) Loss 2.827 (2.747)
Epoch: [7][140/400] Time 0.321 (0.322) Data 0.000 (0.003) Loss 2.795 (2.758)
Epoch: [7][150/400] Time 0.320 (0.322) Data 0.000 (0.003) Loss 3.037 (2.744)
Epoch: [7][160/400] Time 0.317 (0.322) Data 0.000 (0.003) Loss 3.502 (2.737)
Epoch: [7][170/400] Time 0.315 (0.322) Data 0.000 (0.002) Loss 2.311 (2.741)
Epoch: [7][180/400] Time 0.317 (0.322) Data 0.000 (0.002) Loss 3.034 (2.730)
Epoch: [7][190/400] Time 0.316 (0.321) Data 0.000 (0.002) Loss 3.783 (2.725)
Epoch: [7][200/400] Time 0.318 (0.321) Data 0.000 (0.002) Loss 2.619 (2.715)
Epoch: [7][210/400] Time 0.317 (0.324) Data 0.000 (0.005) Loss 4.085 (2.797)
Epoch: [7][220/400] Time 0.319 (0.324) Data 0.000 (0.005) Loss 5.071 (2.889)
Epoch: [7][230/400] Time 0.316 (0.324) Data 0.000 (0.005) Loss 4.495 (2.958)
Epoch: [7][240/400] Time 0.316 (0.324) Data 0.000 (0.005) Loss 5.400 (3.034)
Epoch: [7][250/400] Time 0.316 (0.323) Data 0.000 (0.004) Loss 5.192 (3.093)
Epoch: [7][260/400] Time 0.322 (0.323) Data 0.000 (0.004) Loss 4.869 (3.163)
Epoch: [7][270/400] Time 0.316 (0.323) Data 0.000 (0.004) Loss 4.534 (3.206)
Epoch: [7][280/400] Time 0.315 (0.323) Data 0.000 (0.004) Loss 4.718 (3.252)
Epoch: [7][290/400] Time 0.315 (0.323) Data 0.000 (0.004) Loss 4.544 (3.306)
Epoch: [7][300/400] Time 0.319 (0.323) Data 0.000 (0.004) Loss 4.417 (3.358)
Epoch: [7][310/400] Time 0.318 (0.322) Data 0.000 (0.004) Loss 5.049 (3.405)
Epoch: [7][320/400] Time 0.315 (0.322) Data 0.000 (0.003) Loss 4.019 (3.439)
Epoch: [7][330/400] Time 0.320 (0.322) Data 0.000 (0.003) Loss 5.515 (3.480)
Epoch: [7][340/400] Time 0.321 (0.322) Data 0.000 (0.003) Loss 5.217 (3.514)
Epoch: [7][350/400] Time 0.320 (0.322) Data 0.000 (0.003) Loss 4.897 (3.543)
Epoch: [7][360/400] Time 0.317 (0.322) Data 0.000 (0.003) Loss 4.700 (3.567)
Epoch: [7][370/400] Time 0.318 (0.322) Data 0.000 (0.003) Loss 4.917 (3.596)
Epoch: [7][380/400] Time 0.320 (0.322) Data 0.000 (0.003) Loss 5.118 (3.624)
Epoch: [7][390/400] Time 0.314 (0.322) Data 0.000 (0.003) Loss 4.660 (3.643)
Epoch: [7][400/400] Time 0.319 (0.322) Data 0.000 (0.003) Loss 4.547 (3.669)
==> Create pseudo labels for unlabeled data
k-means time: 2 s
num_cluster 800
init---
==> Statistics for epoch 8: 800 clusters
Epoch: [8][10/400] Time 0.318 (0.357) Data 0.000 (0.037) Loss 3.324 (2.727)
Epoch: [8][20/400] Time 0.320 (0.338) Data 0.000 (0.019) Loss 3.024 (2.929)
Epoch: [8][30/400] Time 0.321 (0.332) Data 0.000 (0.012) Loss 2.299 (2.872)
Epoch: [8][40/400] Time 0.324 (0.329) Data 0.000 (0.009) Loss 2.489 (2.783)
Epoch: [8][50/400] Time 0.312 (0.327) Data 0.000 (0.008) Loss 2.556 (2.778)
Epoch: [8][60/400] Time 0.321 (0.326) Data 0.000 (0.006) Loss 2.633 (2.761)
Epoch: [8][70/400] Time 0.314 (0.325) Data 0.000 (0.005) Loss 3.271 (2.809)
Epoch: [8][80/400] Time 0.321 (0.324) Data 0.000 (0.005) Loss 3.207 (2.779)
Epoch: [8][90/400] Time 0.316 (0.323) Data 0.000 (0.004) Loss 2.378 (2.760)
Epoch: [8][100/400] Time 0.315 (0.322) Data 0.000 (0.004) Loss 2.763 (2.755)
Epoch: [8][110/400] Time 0.315 (0.322) Data 0.000 (0.004) Loss 2.930 (2.727)
Epoch: [8][120/400] Time 0.321 (0.322) Data 0.000 (0.003) Loss 2.203 (2.697)
Epoch: [8][130/400] Time 0.315 (0.322) Data 0.000 (0.003) Loss 2.743 (2.703)
Epoch: [8][140/400] Time 0.314 (0.321) Data 0.000 (0.003) Loss 1.810 (2.681)
Epoch: [8][150/400] Time 0.317 (0.321) Data 0.000 (0.003) Loss 2.797 (2.672)
Epoch: [8][160/400] Time 0.321 (0.321) Data 0.000 (0.002) Loss 1.325 (2.665)
Epoch: [8][170/400] Time 0.314 (0.321) Data 0.000 (0.002) Loss 1.980 (2.642)
Epoch: [8][180/400] Time 0.321 (0.320) Data 0.000 (0.002) Loss 2.918 (2.640)
Epoch: [8][190/400] Time 0.320 (0.320) Data 0.000 (0.002) Loss 1.862 (2.645)
Epoch: [8][200/400] Time 0.316 (0.320) Data 0.000 (0.002) Loss 2.121 (2.628)
Epoch: [8][210/400] Time 0.315 (0.324) Data 0.000 (0.005) Loss 4.264 (2.716)
Epoch: [8][220/400] Time 0.320 (0.323) Data 0.000 (0.005) Loss 4.688 (2.801)
Epoch: [8][230/400] Time 0.322 (0.323) Data 0.000 (0.005) Loss 4.909 (2.883)
Epoch: [8][240/400] Time 0.320 (0.323) Data 0.000 (0.005) Loss 3.887 (2.927)
Epoch: [8][250/400] Time 0.322 (0.323) Data 0.000 (0.005) Loss 4.912 (2.996)
Epoch: [8][260/400] Time 0.321 (0.323) Data 0.000 (0.004) Loss 5.069 (3.058)
Epoch: [8][270/400] Time 0.315 (0.323) Data 0.000 (0.004) Loss 3.942 (3.104)
Epoch: [8][280/400] Time 0.320 (0.323) Data 0.000 (0.004) Loss 3.472 (3.163)
Epoch: [8][290/400] Time 0.321 (0.322) Data 0.000 (0.004) Loss 6.272 (3.216)
Epoch: [8][300/400] Time 0.323 (0.322) Data 0.000 (0.004) Loss 4.656 (3.258)
Epoch: [8][310/400] Time 0.323 (0.322) Data 0.000 (0.004) Loss 4.559 (3.298)
Epoch: [8][320/400] Time 0.320 (0.322) Data 0.000 (0.004) Loss 4.730 (3.340)
Epoch: [8][330/400] Time 0.321 (0.322) Data 0.000 (0.003) Loss 3.852 (3.384)
Epoch: [8][340/400] Time 0.316 (0.322) Data 0.000 (0.003) Loss 4.742 (3.420)
Epoch: [8][350/400] Time 0.320 (0.322) Data 0.000 (0.003) Loss 4.160 (3.456)
Epoch: [8][360/400] Time 0.319 (0.322) Data 0.000 (0.003) Loss 4.430 (3.484)
Epoch: [8][370/400] Time 0.322 (0.322) Data 0.000 (0.003) Loss 4.889 (3.514)
Epoch: [8][380/400] Time 0.320 (0.322) Data 0.000 (0.003) Loss 5.100 (3.538)
Epoch: [8][390/400] Time 0.324 (0.322) Data 0.000 (0.003) Loss 4.414 (3.570)
Epoch: [8][400/400] Time 0.321 (0.322) Data 0.000 (0.003) Loss 3.886 (3.585)
==> Create pseudo labels for unlabeled data
k-means time: 2 s
num_cluster 800
init---
==> Statistics for epoch 9: 800 clusters
Epoch: [9][10/400] Time 0.316 (0.352) Data 0.000 (0.035) Loss 3.091 (2.758)
Epoch: [9][20/400] Time 0.317 (0.335) Data 0.000 (0.017) Loss 3.017 (2.742)
Epoch: [9][30/400] Time 0.319 (0.328) Data 0.000 (0.012) Loss 2.741 (2.753)
Epoch: [9][40/400] Time 0.314 (0.325) Data 0.000 (0.009) Loss 2.683 (2.698)
Epoch: [9][50/400] Time 0.314 (0.323) Data 0.000 (0.007) Loss 2.692 (2.704)
Epoch: [9][60/400] Time 0.315 (0.322) Data 0.000 (0.006) Loss 2.325 (2.680)
Epoch: [9][70/400] Time 0.318 (0.321) Data 0.000 (0.005) Loss 2.497 (2.667)
Epoch: [9][80/400] Time 0.317 (0.320) Data 0.000 (0.004) Loss 3.766 (2.703)
Epoch: [9][90/400] Time 0.316 (0.320) Data 0.000 (0.004) Loss 2.843 (2.710)
Epoch: [9][100/400] Time 0.315 (0.319) Data 0.000 (0.004) Loss 2.200 (2.686)
Epoch: [9][110/400] Time 0.316 (0.319) Data 0.000 (0.003) Loss 2.843 (2.676)
Epoch: [9][120/400] Time 0.316 (0.319) Data 0.000 (0.003) Loss 2.227 (2.681)
Epoch: [9][130/400] Time 0.316 (0.319) Data 0.000 (0.003) Loss 2.033 (2.667)
Epoch: [9][140/400] Time 0.315 (0.318) Data 0.000 (0.003) Loss 2.360 (2.659)
Epoch: [9][150/400] Time 0.317 (0.318) Data 0.000 (0.002) Loss 2.069 (2.632)
Epoch: [9][160/400] Time 0.317 (0.318) Data 0.000 (0.002) Loss 2.500 (2.613)
Epoch: [9][170/400] Time 0.316 (0.318) Data 0.000 (0.002) Loss 3.238 (2.630)
Epoch: [9][180/400] Time 0.316 (0.318) Data 0.000 (0.002) Loss 1.754 (2.616)
Epoch: [9][190/400] Time 0.315 (0.318) Data 0.000 (0.002) Loss 2.557 (2.611)
Epoch: [9][200/400] Time 0.314 (0.318) Data 0.000 (0.002) Loss 3.071 (2.587)
Epoch: [9][210/400] Time 0.319 (0.321) Data 0.000 (0.005) Loss 3.358 (2.668)
Epoch: [9][220/400] Time 0.317 (0.320) Data 0.000 (0.005) Loss 3.868 (2.741)
Epoch: [9][230/400] Time 0.314 (0.320) Data 0.000 (0.004) Loss 4.852 (2.832)
Epoch: [9][240/400] Time 0.315 (0.320) Data 0.000 (0.004) Loss 3.781 (2.889)
Epoch: [9][250/400] Time 0.314 (0.320) Data 0.000 (0.004) Loss 5.328 (2.963)
Epoch: [9][260/400] Time 0.317 (0.320) Data 0.000 (0.004) Loss 4.365 (3.011)
Epoch: [9][270/400] Time 0.315 (0.319) Data 0.000 (0.004) Loss 5.161 (3.061)
Epoch: [9][280/400] Time 0.316 (0.319) Data 0.000 (0.004) Loss 4.557 (3.111)
Epoch: [9][290/400] Time 0.315 (0.319) Data 0.000 (0.003) Loss 4.670 (3.161)
Epoch: [9][300/400] Time 0.317 (0.319) Data 0.000 (0.003) Loss 3.430 (3.199)
Epoch: [9][310/400] Time 0.315 (0.319) Data 0.000 (0.003) Loss 3.322 (3.226)
Epoch: [9][320/400] Time 0.319 (0.319) Data 0.000 (0.003) Loss 4.404 (3.277)
Epoch: [9][330/400] Time 0.314 (0.319) Data 0.000 (0.003) Loss 4.972 (3.312)
Epoch: [9][340/400] Time 0.318 (0.319) Data 0.000 (0.003) Loss 3.785 (3.347)
Epoch: [9][350/400] Time 0.316 (0.319) Data 0.000 (0.003) Loss 4.190 (3.374)
Epoch: [9][360/400] Time 0.316 (0.318) Data 0.000 (0.003) Loss 4.061 (3.393)
Epoch: [9][370/400] Time 0.316 (0.318) Data 0.000 (0.003) Loss 6.443 (3.423)
Epoch: [9][380/400] Time 0.314 (0.318) Data 0.000 (0.003) Loss 4.615 (3.452)
Epoch: [9][390/400] Time 0.316 (0.318) Data 0.000 (0.003) Loss 4.829 (3.481)
Epoch: [9][400/400] Time 0.314 (0.318) Data 0.000 (0.003) Loss 3.932 (3.504)
Extract Features: [50/208] Time 0.102 (0.121) Data 0.000 (0.024)
Extract Features: [100/208] Time 0.103 (0.111) Data 0.000 (0.012)
Extract Features: [150/208] Time 0.103 (0.108) Data 0.000 (0.008)
Extract Features: [200/208] Time 0.102 (0.107) Data 0.000 (0.006)
Mean AP: 37.8%
* Finished epoch 9 model mAP: 37.8% best: 37.8% *
==> Create pseudo labels for unlabeled data
k-means time: 2 s
num_cluster 800
init---
==> Statistics for epoch 10: 800 clusters
Epoch: [10][10/400] Time 0.314 (0.358) Data 0.000 (0.042) Loss 2.322 (2.462)
Epoch: [10][20/400] Time 0.315 (0.337) Data 0.000 (0.021) Loss 2.383 (2.540)
Epoch: [10][30/400] Time 0.314 (0.329) Data 0.000 (0.014) Loss 2.523 (2.540)
Epoch: [10][40/400] Time 0.318 (0.326) Data 0.000 (0.010) Loss 2.332 (2.500)
Epoch: [10][50/400] Time 0.317 (0.324) Data 0.000 (0.008) Loss 2.791 (2.500)
Epoch: [10][60/400] Time 0.315 (0.323) Data 0.000 (0.007) Loss 1.969 (2.487)
Epoch: [10][70/400] Time 0.316 (0.322) Data 0.000 (0.006) Loss 2.531 (2.488)
Epoch: [10][80/400] Time 0.316 (0.321) Data 0.000 (0.005) Loss 2.586 (2.502)
Epoch: [10][90/400] Time 0.315 (0.321) Data 0.000 (0.005) Loss 2.830 (2.479)
Epoch: [10][100/400] Time 0.316 (0.320) Data 0.000 (0.004) Loss 2.588 (2.482)
Epoch: [10][110/400] Time 0.318 (0.320) Data 0.000 (0.004) Loss 2.634 (2.459)
Epoch: [10][120/400] Time 0.316 (0.320) Data 0.000 (0.004) Loss 2.623 (2.452)
Epoch: [10][130/400] Time 0.315 (0.320) Data 0.000 (0.003) Loss 2.496 (2.428)
Epoch: [10][140/400] Time 0.315 (0.319) Data 0.000 (0.003) Loss 1.934 (2.405)
Epoch: [10][150/400] Time 0.316 (0.319) Data 0.000 (0.003) Loss 2.672 (2.400)
Epoch: [10][160/400] Time 0.316 (0.319) Data 0.000 (0.003) Loss 2.543 (2.392)
Epoch: [10][170/400] Time 0.319 (0.319) Data 0.000 (0.003) Loss 2.207 (2.365)
Epoch: [10][180/400] Time 0.317 (0.319) Data 0.000 (0.002) Loss 2.249 (2.364)
Epoch: [10][190/400] Time 0.316 (0.319) Data 0.000 (0.002) Loss 1.643 (2.362)
Epoch: [10][200/400] Time 0.315 (0.318) Data 0.000 (0.002) Loss 1.777 (2.348)
Epoch: [10][210/400] Time 0.314 (0.322) Data 0.000 (0.005) Loss 4.528 (2.435)
Epoch: [10][220/400] Time 0.319 (0.321) Data 0.000 (0.005) Loss 4.540 (2.512)
Epoch: [10][230/400] Time 0.320 (0.321) Data 0.000 (0.005) Loss 3.892 (2.588)
Epoch: [10][240/400] Time 0.316 (0.321) Data 0.000 (0.005) Loss 3.948 (2.657)
Epoch: [10][250/400] Time 0.318 (0.321) Data 0.000 (0.004) Loss 4.474 (2.728)
Epoch: [10][260/400] Time 0.319 (0.321) Data 0.000 (0.004) Loss 4.216 (2.790)
Epoch: [10][270/400] Time 0.317 (0.321) Data 0.000 (0.004) Loss 4.963 (2.851)
Epoch: [10][280/400] Time 0.316 (0.321) Data 0.000 (0.004) Loss 5.045 (2.916)
Epoch: [10][290/400] Time 0.316 (0.320) Data 0.000 (0.004) Loss 4.047 (2.964)
Epoch: [10][300/400] Time 0.317 (0.320) Data 0.000 (0.004) Loss 4.731 (3.011)
Epoch: [10][310/400] Time 0.314 (0.320) Data 0.000 (0.004) Loss 3.915 (3.058)
Epoch: [10][320/400] Time 0.318 (0.320) Data 0.000 (0.004) Loss 4.203 (3.100)
Epoch: [10][330/400] Time 0.317 (0.320) Data 0.000 (0.003) Loss 4.516 (3.143)
Epoch: [10][340/400] Time 0.315 (0.320) Data 0.000 (0.003) Loss 4.961 (3.187)
Epoch: [10][350/400] Time 0.316 (0.320) Data 0.000 (0.003) Loss 3.804 (3.220)
Epoch: [10][360/400] Time 0.315 (0.320) Data 0.000 (0.003) Loss 4.667 (3.253)
Epoch: [10][370/400] Time 0.315 (0.320) Data 0.000 (0.003) Loss 5.329 (3.289)
Epoch: [10][380/400] Time 0.315 (0.320) Data 0.000 (0.003) Loss 4.472 (3.323)
Epoch: [10][390/400] Time 0.315 (0.320) Data 0.000 (0.003) Loss 5.257 (3.349)
Epoch: [10][400/400] Time 0.314 (0.319) Data 0.000 (0.003) Loss 4.806 (3.374)
==> Create pseudo labels for unlabeled data
k-means time: 2 s
num_cluster 800
init---
==> Statistics for epoch 11: 800 clusters
Epoch: [11][10/400] Time 0.313 (0.350) Data 0.000 (0.035) Loss 2.734 (2.476)
Epoch: [11][20/400] Time 0.315 (0.332) Data 0.000 (0.018) Loss 2.462 (2.462)
Epoch: [11][30/400] Time 0.313 (0.326) Data 0.000 (0.012) Loss 2.536 (2.498)
Epoch: [11][40/400] Time 0.312 (0.323) Data 0.000 (0.009) Loss 2.687 (2.589)
Epoch: [11][50/400] Time 0.314 (0.321) Data 0.000 (0.007) Loss 2.225 (2.543)
Epoch: [11][60/400] Time 0.314 (0.320) Data 0.000 (0.006) Loss 2.993 (2.569)
Epoch: [11][70/400] Time 0.317 (0.319) Data 0.000 (0.005) Loss 3.459 (2.552)
Epoch: [11][80/400] Time 0.312 (0.319) Data 0.000 (0.004) Loss 2.125 (2.557)
Epoch: [11][90/400] Time 0.315 (0.318) Data 0.000 (0.004) Loss 2.586 (2.544)
Epoch: [11][100/400] Time 0.315 (0.318) Data 0.000 (0.004) Loss 1.609 (2.522)
Epoch: [11][110/400] Time 0.313 (0.318) Data 0.000 (0.003) Loss 2.818 (2.516)
Epoch: [11][120/400] Time 0.315 (0.317) Data 0.000 (0.003) Loss 2.163 (2.494)
Epoch: [11][130/400] Time 0.313 (0.317) Data 0.000 (0.003) Loss 3.525 (2.482)
Epoch: [11][140/400] Time 0.315 (0.317) Data 0.000 (0.003) Loss 2.244 (2.478)
Epoch: [11][150/400] Time 0.313 (0.317) Data 0.000 (0.002) Loss 3.125 (2.468)
Epoch: [11][160/400] Time 0.315 (0.317) Data 0.000 (0.002) Loss 2.058 (2.456)
Epoch: [11][170/400] Time 0.315 (0.316) Data 0.000 (0.002) Loss 2.492 (2.427)
Epoch: [11][180/400] Time 0.314 (0.316) Data 0.000 (0.002) Loss 1.536 (2.411)
Epoch: [11][190/400] Time 0.312 (0.316) Data 0.000 (0.002) Loss 1.185 (2.397)
Epoch: [11][200/400] Time 0.315 (0.316) Data 0.000 (0.002) Loss 1.789 (2.383)
Epoch: [11][210/400] Time 0.314 (0.319) Data 0.000 (0.005) Loss 4.637 (2.477)
Epoch: [11][220/400] Time 0.314 (0.319) Data 0.000 (0.005) Loss 4.833 (2.562)
Epoch: [11][230/400] Time 0.321 (0.319) Data 0.000 (0.004) Loss 3.974 (2.648)
Epoch: [11][240/400] Time 0.315 (0.319) Data 0.000 (0.004) Loss 4.061 (2.704)
Epoch: [11][250/400] Time 0.316 (0.318) Data 0.000 (0.004) Loss 5.100 (2.776)
Epoch: [11][260/400] Time 0.315 (0.318) Data 0.000 (0.004) Loss 4.003 (2.840)
Epoch: [11][270/400] Time 0.315 (0.318) Data 0.000 (0.004) Loss 4.980 (2.910)
Epoch: [11][280/400] Time 0.315 (0.318) Data 0.000 (0.004) Loss 3.732 (2.952)
Epoch: [11][290/400] Time 0.316 (0.318) Data 0.000 (0.003) Loss 4.511 (2.995)
Epoch: [11][300/400] Time 0.315 (0.318) Data 0.000 (0.003) Loss 4.983 (3.053)
Epoch: [11][310/400] Time 0.315 (0.318) Data 0.000 (0.003) Loss 4.260 (3.094)
Epoch: [11][320/400] Time 0.315 (0.318) Data 0.000 (0.003) Loss 3.872 (3.134)
Epoch: [11][330/400] Time 0.317 (0.318) Data 0.000 (0.003) Loss 3.951 (3.163)
Epoch: [11][340/400] Time 0.316 (0.318) Data 0.000 (0.003) Loss 5.060 (3.201)
Epoch: [11][350/400] Time 0.316 (0.318) Data 0.000 (0.003) Loss 4.705 (3.238)
Epoch: [11][360/400] Time 0.315 (0.318) Data 0.000 (0.003) Loss 4.597 (3.262)
Epoch: [11][370/400] Time 0.316 (0.317) Data 0.000 (0.003) Loss 3.876 (3.286)
Epoch: [11][380/400] Time 0.317 (0.317) Data 0.000 (0.003) Loss 4.057 (3.312)
Epoch: [11][390/400] Time 0.314 (0.317) Data 0.000 (0.003) Loss 4.285 (3.333)
Epoch: [11][400/400] Time 0.313 (0.317) Data 0.000 (0.003) Loss 4.017 (3.356)
==> Create pseudo labels for unlabeled data
k-means time: 2 s
num_cluster 800
init---
==> Statistics for epoch 12: 800 clusters
Epoch: [12][10/400] Time 0.315 (0.346) Data 0.000 (0.031) Loss 2.030 (2.652)
Epoch: [12][20/400] Time 0.314 (0.330) Data 0.000 (0.016) Loss 3.271 (2.724)
Epoch: [12][30/400] Time 0.314 (0.326) Data 0.000 (0.010) Loss 2.570 (2.810)
Epoch: [12][40/400] Time 0.317 (0.323) Data 0.000 (0.008) Loss 2.645 (2.738)
Epoch: [12][50/400] Time 0.316 (0.322) Data 0.000 (0.006) Loss 2.728 (2.734)
Epoch: [12][60/400] Time 0.315 (0.321) Data 0.000 (0.005) Loss 3.511 (2.674)
Epoch: [12][70/400] Time 0.314 (0.320) Data 0.000 (0.005) Loss 2.967 (2.628)
Epoch: [12][80/400] Time 0.313 (0.319) Data 0.000 (0.004) Loss 2.363 (2.580)
Epoch: [12][90/400] Time 0.313 (0.319) Data 0.000 (0.004) Loss 2.713 (2.588)
Epoch: [12][100/400] Time 0.315 (0.319) Data 0.000 (0.003) Loss 2.800 (2.579)
Epoch: [12][110/400] Time 0.313 (0.318) Data 0.000 (0.003) Loss 3.451 (2.578)
Epoch: [12][120/400] Time 0.318 (0.318) Data 0.000 (0.003) Loss 2.802 (2.563)
Epoch: [12][130/400] Time 0.315 (0.318) Data 0.000 (0.003) Loss 2.703 (2.570)
Epoch: [12][140/400] Time 0.315 (0.318) Data 0.000 (0.002) Loss 3.678 (2.576)
Epoch: [12][150/400] Time 0.315 (0.318) Data 0.000 (0.002) Loss 2.291 (2.560)
Epoch: [12][160/400] Time 0.314 (0.317) Data 0.000 (0.002) Loss 2.029 (2.546)
Epoch: [12][170/400] Time 0.314 (0.317) Data 0.000 (0.002) Loss 1.859 (2.538)
Epoch: [12][180/400] Time 0.315 (0.317) Data 0.000 (0.002) Loss 1.786 (2.520)
Epoch: [12][190/400] Time 0.316 (0.317) Data 0.000 (0.002) Loss 2.237 (2.505)
Epoch: [12][200/400] Time 0.315 (0.317) Data 0.000 (0.002) Loss 2.966 (2.490)
Epoch: [12][210/400] Time 0.314 (0.320) Data 0.000 (0.004) Loss 3.931 (2.573)
Epoch: [12][220/400] Time 0.316 (0.320) Data 0.000 (0.004) Loss 3.989 (2.650)
Epoch: [12][230/400] Time 0.320 (0.320) Data 0.000 (0.004) Loss 4.287 (2.721)
Epoch: [12][240/400] Time 0.316 (0.319) Data 0.000 (0.004) Loss 4.725 (2.799)
Epoch: [12][250/400] Time 0.316 (0.319) Data 0.000 (0.004) Loss 4.480 (2.857)
Epoch: [12][260/400] Time 0.315 (0.319) Data 0.000 (0.004) Loss 4.891 (2.926)
Epoch: [12][270/400] Time 0.316 (0.319) Data 0.000 (0.003) Loss 4.169 (2.979)
Epoch: [12][280/400] Time 0.315 (0.319) Data 0.000 (0.003) Loss 3.351 (3.021)
Epoch: [12][290/400] Time 0.315 (0.319) Data 0.000 (0.003) Loss 4.201 (3.064)
Epoch: [12][300/400] Time 0.315 (0.319) Data 0.000 (0.003) Loss 4.521 (3.108)
Epoch: [12][310/400] Time 0.317 (0.319) Data 0.000 (0.003) Loss 4.438 (3.154)
Epoch: [12][320/400] Time 0.318 (0.318) Data 0.000 (0.003) Loss 4.934 (3.194)
Epoch: [12][330/400] Time 0.315 (0.318) Data 0.000 (0.003) Loss 4.224 (3.236)
Epoch: [12][340/400] Time 0.315 (0.318) Data 0.000 (0.003) Loss 4.155 (3.266)
Epoch: [12][350/400] Time 0.315 (0.318) Data 0.000 (0.003) Loss 4.457 (3.304)
Epoch: [12][360/400] Time 0.314 (0.318) Data 0.000 (0.003) Loss 4.161 (3.339)
Epoch: [12][370/400] Time 0.317 (0.318) Data 0.000 (0.003) Loss 4.400 (3.358)
Epoch: [12][380/400] Time 0.316 (0.318) Data 0.000 (0.002) Loss 4.599 (3.381)
Epoch: [12][390/400] Time 0.316 (0.318) Data 0.000 (0.002) Loss 3.958 (3.405)
Epoch: [12][400/400] Time 0.313 (0.318) Data 0.000 (0.002) Loss 4.468 (3.422)
==> Create pseudo labels for unlabeled data
k-means time: 2 s
num_cluster 800
init---
==> Statistics for epoch 13: 800 clusters
Epoch: [13][10/400] Time 0.315 (0.352) Data 0.000 (0.037) Loss 3.385 (2.463)
Epoch: [13][20/400] Time 0.314 (0.333) Data 0.000 (0.019) Loss 2.169 (2.472)
Epoch: [13][30/400] Time 0.313 (0.327) Data 0.000 (0.012) Loss 2.710 (2.590)
Epoch: [13][40/400] Time 0.315 (0.323) Data 0.000 (0.009) Loss 1.970 (2.542)
Epoch: [13][50/400] Time 0.314 (0.322) Data 0.000 (0.007) Loss 3.132 (2.572)
Epoch: [13][60/400] Time 0.314 (0.320) Data 0.000 (0.006) Loss 2.785 (2.608)
Epoch: [13][70/400] Time 0.315 (0.319) Data 0.000 (0.005) Loss 3.620 (2.625)
Epoch: [13][80/400] Time 0.318 (0.319) Data 0.000 (0.005) Loss 2.286 (2.698)
Epoch: [13][90/400] Time 0.314 (0.318) Data 0.000 (0.004) Loss 2.044 (2.665)
Epoch: [13][100/400] Time 0.314 (0.318) Data 0.000 (0.004) Loss 3.559 (2.691)
Epoch: [13][110/400] Time 0.315 (0.318) Data 0.000 (0.003) Loss 2.793 (2.689)
Epoch: [13][120/400] Time 0.315 (0.317) Data 0.000 (0.003) Loss 3.070 (2.697)
Epoch: [13][130/400] Time 0.315 (0.317) Data 0.000 (0.003) Loss 2.453 (2.674)
Epoch: [13][140/400] Time 0.321 (0.317) Data 0.000 (0.003) Loss 2.896 (2.687)
Epoch: [13][150/400] Time 0.314 (0.317) Data 0.000 (0.003) Loss 3.049 (2.680)
Epoch: [13][160/400] Time 0.314 (0.317) Data 0.000 (0.002) Loss 2.633 (2.679)
Epoch: [13][170/400] Time 0.315 (0.316) Data 0.000 (0.002) Loss 2.268 (2.671)
Epoch: [13][180/400] Time 0.313 (0.316) Data 0.000 (0.002) Loss 2.770 (2.662)
Epoch: [13][190/400] Time 0.314 (0.316) Data 0.000 (0.002) Loss 2.971 (2.653)
Epoch: [13][200/400] Time 0.313 (0.316) Data 0.000 (0.002) Loss 3.537 (2.641)
Epoch: [13][210/400] Time 0.314 (0.320) Data 0.000 (0.006) Loss 4.752 (2.717)
Epoch: [13][220/400] Time 0.317 (0.320) Data 0.000 (0.005) Loss 4.584 (2.802)
Epoch: [13][230/400] Time 0.318 (0.320) Data 0.000 (0.005) Loss 3.575 (2.875)
Epoch: [13][240/400] Time 0.315 (0.319) Data 0.000 (0.005) Loss 5.179 (2.939)
Epoch: [13][250/400] Time 0.315 (0.319) Data 0.000 (0.005) Loss 4.030 (2.989)
Epoch: [13][260/400] Time 0.316 (0.319) Data 0.000 (0.005) Loss 4.188 (3.044)
Epoch: [13][270/400] Time 0.315 (0.319) Data 0.000 (0.004) Loss 4.659 (3.083)
Epoch: [13][280/400] Time 0.317 (0.319) Data 0.000 (0.004) Loss 4.581 (3.135)
Epoch: [13][290/400] Time 0.315 (0.319) Data 0.000 (0.004) Loss 3.997 (3.178)
Epoch: [13][300/400] Time 0.315 (0.319) Data 0.000 (0.004) Loss 4.214 (3.214)
Epoch: [13][310/400] Time 0.315 (0.319) Data 0.000 (0.004) Loss 4.884 (3.255)
Epoch: [13][320/400] Time 0.317 (0.318) Data 0.000 (0.004) Loss 3.577 (3.282)
Epoch: [13][330/400] Time 0.316 (0.318) Data 0.000 (0.004) Loss 3.610 (3.312)
Epoch: [13][340/400] Time 0.316 (0.318) Data 0.000 (0.004) Loss 4.570 (3.345)
Epoch: [13][350/400] Time 0.315 (0.318) Data 0.000 (0.003) Loss 4.169 (3.371)
Epoch: [13][360/400] Time 0.315 (0.318) Data 0.000 (0.003) Loss 4.229 (3.402)
Epoch: [13][370/400] Time 0.316 (0.318) Data 0.000 (0.003) Loss 4.674 (3.429)
Epoch: [13][380/400] Time 0.315 (0.318) Data 0.000 (0.003) Loss 4.531 (3.455)
Epoch: [13][390/400] Time 0.316 (0.318) Data 0.000 (0.003) Loss 4.398 (3.479)
Epoch: [13][400/400] Time 0.315 (0.318) Data 0.000 (0.003) Loss 4.406 (3.498)
==> Create pseudo labels for unlabeled data
k-means time: 2 s
num_cluster 800
init---
==> Statistics for epoch 14: 800 clusters
Epoch: [14][10/400] Time 0.319 (0.359) Data 0.000 (0.042) Loss 2.829 (2.780)
Epoch: [14][20/400] Time 0.319 (0.338) Data 0.000 (0.021) Loss 2.908 (2.665)
Epoch: [14][30/400] Time 0.313 (0.331) Data 0.000 (0.014) Loss 2.145 (2.595)
Epoch: [14][40/400] Time 0.318 (0.327) Data 0.000 (0.010) Loss 2.240 (2.576)
Epoch: [14][50/400] Time 0.316 (0.325) Data 0.000 (0.008) Loss 2.528 (2.592)
Epoch: [14][60/400] Time 0.315 (0.323) Data 0.000 (0.007) Loss 2.103 (2.564)
Epoch: [14][70/400] Time 0.314 (0.322) Data 0.000 (0.006) Loss 1.962 (2.549)
Epoch: [14][80/400] Time 0.316 (0.321) Data 0.000 (0.005) Loss 2.975 (2.528)
Epoch: [14][90/400] Time 0.316 (0.321) Data 0.000 (0.005) Loss 2.321 (2.515)
Epoch: [14][100/400] Time 0.317 (0.320) Data 0.000 (0.004) Loss 2.289 (2.505)
Epoch: [14][110/400] Time 0.317 (0.320) Data 0.000 (0.004) Loss 2.669 (2.494)
Epoch: [14][120/400] Time 0.318 (0.320) Data 0.000 (0.004) Loss 2.559 (2.479)
Epoch: [14][130/400] Time 0.315 (0.319) Data 0.000 (0.003) Loss 2.113 (2.482)
Epoch: [14][140/400] Time 0.318 (0.319) Data 0.000 (0.003) Loss 1.898 (2.466)
Epoch: [14][150/400] Time 0.316 (0.319) Data 0.000 (0.003) Loss 2.329 (2.473)
Epoch: [14][160/400] Time 0.322 (0.319) Data 0.000 (0.003) Loss 3.438 (2.483)
Epoch: [14][170/400] Time 0.314 (0.319) Data 0.000 (0.003) Loss 2.052 (2.471)
Epoch: [14][180/400] Time 0.318 (0.319) Data 0.000 (0.002) Loss 2.263 (2.454)
Epoch: [14][190/400] Time 0.315 (0.318) Data 0.000 (0.002) Loss 2.712 (2.443)
Epoch: [14][200/400] Time 0.315 (0.318) Data 0.000 (0.002) Loss 1.432 (2.428)
Epoch: [14][210/400] Time 0.314 (0.321) Data 0.000 (0.005) Loss 3.453 (2.507)
Epoch: [14][220/400] Time 0.315 (0.321) Data 0.000 (0.005) Loss 3.453 (2.577)
Epoch: [14][230/400] Time 0.314 (0.321) Data 0.000 (0.004) Loss 3.999 (2.650)
Epoch: [14][240/400] Time 0.315 (0.320) Data 0.000 (0.004) Loss 3.794 (2.708)
Epoch: [14][250/400] Time 0.317 (0.320) Data 0.000 (0.004) Loss 4.504 (2.785)
Epoch: [14][260/400] Time 0.317 (0.320) Data 0.000 (0.004) Loss 4.353 (2.845)
Epoch: [14][270/400] Time 0.315 (0.320) Data 0.000 (0.004) Loss 4.421 (2.905)
Epoch: [14][280/400] Time 0.318 (0.320) Data 0.000 (0.004) Loss 3.988 (2.959)
Epoch: [14][290/400] Time 0.314 (0.320) Data 0.000 (0.004) Loss 4.068 (3.009)
Epoch: [14][300/400] Time 0.315 (0.319) Data 0.000 (0.003) Loss 4.464 (3.048)
Epoch: [14][310/400] Time 0.315 (0.319) Data 0.000 (0.003) Loss 4.378 (3.088)
Epoch: [14][320/400] Time 0.315 (0.319) Data 0.000 (0.003) Loss 4.625 (3.123)
Epoch: [14][330/400] Time 0.316 (0.319) Data 0.000 (0.003) Loss 5.141 (3.160)
Epoch: [14][340/400] Time 0.315 (0.319) Data 0.000 (0.003) Loss 4.625 (3.196)
Epoch: [14][350/400] Time 0.315 (0.319) Data 0.000 (0.003) Loss 5.518 (3.241)
Epoch: [14][360/400] Time 0.316 (0.319) Data 0.000 (0.003) Loss 5.408 (3.266)
Epoch: [14][370/400] Time 0.317 (0.319) Data 0.000 (0.003) Loss 4.480 (3.298)
Epoch: [14][380/400] Time 0.315 (0.319) Data 0.000 (0.003) Loss 4.554 (3.319)
Epoch: [14][390/400] Time 0.315 (0.319) Data 0.000 (0.003) Loss 3.993 (3.345)
Epoch: [14][400/400] Time 0.316 (0.318) Data 0.000 (0.003) Loss 4.118 (3.367)
==> Create pseudo labels for unlabeled data
k-means time: 2 s
num_cluster 800
init---
==> Statistics for epoch 15: 800 clusters
Epoch: [15][10/400] Time 0.316 (0.357) Data 0.000 (0.040) Loss 2.503 (2.486)
Epoch: [15][20/400] Time 0.313 (0.336) Data 0.000 (0.020) Loss 2.531 (2.518)
Epoch: [15][30/400] Time 0.316 (0.329) Data 0.000 (0.013) Loss 3.678 (2.557)
Epoch: [15][40/400] Time 0.316 (0.326) Data 0.000 (0.010) Loss 2.568 (2.544)
Epoch: [15][50/400] Time 0.313 (0.323) Data 0.000 (0.008) Loss 2.684 (2.527)
Epoch: [15][60/400] Time 0.316 (0.322) Data 0.000 (0.007) Loss 2.229 (2.528)
Epoch: [15][70/400] Time 0.316 (0.321) Data 0.000 (0.006) Loss 3.472 (2.553)
Epoch: [15][80/400] Time 0.315 (0.320) Data 0.000 (0.005) Loss 2.038 (2.521)
Epoch: [15][90/400] Time 0.315 (0.320) Data 0.000 (0.005) Loss 2.649 (2.524)
Epoch: [15][100/400] Time 0.318 (0.320) Data 0.000 (0.004) Loss 1.814 (2.503)
Epoch: [15][110/400] Time 0.316 (0.319) Data 0.000 (0.004) Loss 2.727 (2.508)
Epoch: [15][120/400] Time 0.315 (0.319) Data 0.000 (0.003) Loss 2.750 (2.503)
Epoch: [15][130/400] Time 0.316 (0.319) Data 0.000 (0.003) Loss 2.682 (2.490)
Epoch: [15][140/400] Time 0.315 (0.318) Data 0.000 (0.003) Loss 2.270 (2.494)
Epoch: [15][150/400] Time 0.315 (0.318) Data 0.000 (0.003) Loss 2.933 (2.466)
Epoch: [15][160/400] Time 0.317 (0.318) Data 0.000 (0.003) Loss 1.936 (2.456)
Epoch: [15][170/400] Time 0.314 (0.318) Data 0.000 (0.002) Loss 3.340 (2.458)
Epoch: [15][180/400] Time 0.315 (0.318) Data 0.000 (0.002) Loss 2.321 (2.452)
Epoch: [15][190/400] Time 0.315 (0.318) Data 0.000 (0.002) Loss 1.969 (2.438)
Epoch: [15][200/400] Time 0.314 (0.317) Data 0.000 (0.002) Loss 2.414 (2.423)
Epoch: [15][210/400] Time 0.314 (0.320) Data 0.000 (0.005) Loss 3.621 (2.501)
Epoch: [15][220/400] Time 0.316 (0.320) Data 0.000 (0.005) Loss 4.551 (2.589)
Epoch: [15][230/400] Time 0.316 (0.320) Data 0.000 (0.005) Loss 4.909 (2.641)
Epoch: [15][240/400] Time 0.316 (0.320) Data 0.000 (0.005) Loss 3.920 (2.702)
Epoch: [15][250/400] Time 0.316 (0.320) Data 0.000 (0.004) Loss 4.381 (2.767)
Epoch: [15][260/400] Time 0.316 (0.320) Data 0.000 (0.004) Loss 5.256 (2.818)
Epoch: [15][270/400] Time 0.315 (0.319) Data 0.000 (0.004) Loss 3.573 (2.875)
Epoch: [15][280/400] Time 0.315 (0.319) Data 0.000 (0.004) Loss 4.586 (2.933)
Epoch: [15][290/400] Time 0.315 (0.319) Data 0.000 (0.004) Loss 4.604 (2.977)
Epoch: [15][300/400] Time 0.316 (0.319) Data 0.000 (0.004) Loss 4.571 (3.015)
Epoch: [15][310/400] Time 0.314 (0.319) Data 0.000 (0.004) Loss 3.844 (3.060)
Epoch: [15][320/400] Time 0.314 (0.319) Data 0.000 (0.003) Loss 4.129 (3.105)
Epoch: [15][330/400] Time 0.313 (0.319) Data 0.000 (0.003) Loss 4.257 (3.146)
Epoch: [15][340/400] Time 0.316 (0.318) Data 0.000 (0.003) Loss 5.170 (3.184)
Epoch: [15][350/400] Time 0.314 (0.318) Data 0.000 (0.003) Loss 4.869 (3.216)
Epoch: [15][360/400] Time 0.314 (0.318) Data 0.000 (0.003) Loss 4.739 (3.246)
Epoch: [15][370/400] Time 0.314 (0.318) Data 0.000 (0.003) Loss 4.548 (3.278)
Epoch: [15][380/400] Time 0.315 (0.318) Data 0.000 (0.003) Loss 4.566 (3.305)
Epoch: [15][390/400] Time 0.316 (0.318) Data 0.000 (0.003) Loss 4.465 (3.332)
Epoch: [15][400/400] Time 0.315 (0.318) Data 0.000 (0.003) Loss 3.654 (3.349)
==> Create pseudo labels for unlabeled data
k-means time: 2 s
num_cluster 800
init---
==> Statistics for epoch 16: 800 clusters
Epoch: [16][10/400] Time 0.316 (0.352) Data 0.000 (0.033) Loss 2.859 (2.547)
Epoch: [16][20/400] Time 0.315 (0.334) Data 0.000 (0.017) Loss 2.473 (2.441)
Epoch: [16][30/400] Time 0.315 (0.328) Data 0.000 (0.011) Loss 2.013 (2.441)
Epoch: [16][40/400] Time 0.317 (0.325) Data 0.000 (0.008) Loss 2.577 (2.500)
Epoch: [16][50/400] Time 0.313 (0.323) Data 0.000 (0.007) Loss 2.653 (2.540)
Epoch: [16][60/400] Time 0.316 (0.321) Data 0.000 (0.006) Loss 2.801 (2.520)
Epoch: [16][70/400] Time 0.314 (0.321) Data 0.000 (0.005) Loss 2.790 (2.525)
Epoch: [16][80/400] Time 0.320 (0.320) Data 0.000 (0.004) Loss 2.048 (2.508)
Epoch: [16][90/400] Time 0.315 (0.320) Data 0.000 (0.004) Loss 2.581 (2.491)
Epoch: [16][100/400] Time 0.323 (0.319) Data 0.000 (0.003) Loss 2.382 (2.505)
Epoch: [16][110/400] Time 0.314 (0.319) Data 0.000 (0.003) Loss 2.399 (2.474)
Epoch: [16][120/400] Time 0.316 (0.319) Data 0.000 (0.003) Loss 3.052 (2.469)
Epoch: [16][130/400] Time 0.314 (0.318) Data 0.000 (0.003) Loss 2.700 (2.468)
Epoch: [16][140/400] Time 0.315 (0.318) Data 0.000 (0.002) Loss 1.779 (2.459)
Epoch: [16][150/400] Time 0.314 (0.318) Data 0.000 (0.002) Loss 1.810 (2.465)
Epoch: [16][160/400] Time 0.315 (0.318) Data 0.000 (0.002) Loss 1.609 (2.449)
Epoch: [16][170/400] Time 0.320 (0.318) Data 0.000 (0.002) Loss 2.157 (2.435)
Epoch: [16][180/400] Time 0.316 (0.318) Data 0.000 (0.002) Loss 2.112 (2.429)
Epoch: [16][190/400] Time 0.317 (0.318) Data 0.000 (0.002) Loss 1.947 (2.414)
Epoch: [16][200/400] Time 0.316 (0.317) Data 0.000 (0.002) Loss 2.609 (2.415)
Epoch: [16][210/400] Time 0.315 (0.321) Data 0.000 (0.005) Loss 4.027 (2.509)
Epoch: [16][220/400] Time 0.315 (0.320) Data 0.000 (0.005) Loss 2.860 (2.573)
Epoch: [16][230/400] Time 0.317 (0.320) Data 0.000 (0.004) Loss 3.860 (2.620)
Epoch: [16][240/400] Time 0.315 (0.320) Data 0.000 (0.004) Loss 4.809 (2.694)
Epoch: [16][250/400] Time 0.315 (0.320) Data 0.000 (0.004) Loss 4.298 (2.749)
Epoch: [16][260/400] Time 0.314 (0.320) Data 0.000 (0.004) Loss 3.545 (2.797)
Epoch: [16][270/400] Time 0.314 (0.319) Data 0.000 (0.004) Loss 4.135 (2.849)
Epoch: [16][280/400] Time 0.315 (0.319) Data 0.000 (0.004) Loss 5.410 (2.916)
Epoch: [16][290/400] Time 0.315 (0.319) Data 0.000 (0.003) Loss 3.894 (2.957)
Epoch: [16][300/400] Time 0.316 (0.319) Data 0.000 (0.003) Loss 3.463 (2.997)
Epoch: [16][310/400] Time 0.314 (0.319) Data 0.000 (0.003) Loss 4.681 (3.048)
Epoch: [16][320/400] Time 0.322 (0.319) Data 0.000 (0.003) Loss 4.668 (3.087)
Epoch: [16][330/400] Time 0.315 (0.319) Data 0.000 (0.003) Loss 5.296 (3.129)
Epoch: [16][340/400] Time 0.315 (0.319) Data 0.000 (0.003) Loss 4.446 (3.169)
Epoch: [16][350/400] Time 0.315 (0.319) Data 0.000 (0.003) Loss 5.168 (3.203)
Epoch: [16][360/400] Time 0.314 (0.319) Data 0.000 (0.003) Loss 3.713 (3.220)
Epoch: [16][370/400] Time 0.316 (0.319) Data 0.000 (0.003) Loss 4.385 (3.248)
Epoch: [16][380/400] Time 0.317 (0.319) Data 0.000 (0.003) Loss 3.769 (3.279)
Epoch: [16][390/400] Time 0.315 (0.318) Data 0.000 (0.003) Loss 4.981 (3.298)
Epoch: [16][400/400] Time 0.315 (0.318) Data 0.000 (0.003) Loss 4.467 (3.323)
==> Create pseudo labels for unlabeled data
k-means time: 3 s
num_cluster 800
init---
==> Statistics for epoch 17: 800 clusters
Epoch: [17][10/400] Time 0.315 (0.354) Data 0.000 (0.035) Loss 1.706 (2.372)
Epoch: [17][20/400] Time 0.316 (0.335) Data 0.000 (0.018) Loss 1.912 (2.350)
Epoch: [17][30/400] Time 0.315 (0.328) Data 0.000 (0.012) Loss 2.019 (2.458)
Epoch: [17][40/400] Time 0.316 (0.325) Data 0.000 (0.009) Loss 2.578 (2.473)
Epoch: [17][50/400] Time 0.318 (0.323) Data 0.000 (0.007) Loss 2.806 (2.442)
Epoch: [17][60/400] Time 0.317 (0.322) Data 0.000 (0.006) Loss 2.662 (2.454)
Epoch: [17][70/400] Time 0.315 (0.321) Data 0.000 (0.005) Loss 2.727 (2.448)
Epoch: [17][80/400] Time 0.317 (0.321) Data 0.000 (0.005) Loss 2.952 (2.492)
Epoch: [17][90/400] Time 0.315 (0.320) Data 0.000 (0.004) Loss 2.010 (2.481)
Epoch: [17][100/400] Time 0.315 (0.320) Data 0.000 (0.004) Loss 2.766 (2.493)
Epoch: [17][110/400] Time 0.315 (0.319) Data 0.000 (0.003) Loss 2.365 (2.492)
Epoch: [17][120/400] Time 0.316 (0.319) Data 0.000 (0.003) Loss 2.357 (2.499)
Epoch: [17][130/400] Time 0.317 (0.319) Data 0.000 (0.003) Loss 2.480 (2.479)
Epoch: [17][140/400] Time 0.314 (0.318) Data 0.000 (0.003) Loss 2.290 (2.476)
Epoch: [17][150/400] Time 0.320 (0.318) Data 0.000 (0.002) Loss 2.642 (2.491)
Epoch: [17][160/400] Time 0.316 (0.318) Data 0.000 (0.002) Loss 2.247 (2.473)
Epoch: [17][170/400] Time 0.315 (0.318) Data 0.000 (0.002) Loss 3.263 (2.478)
Epoch: [17][180/400] Time 0.315 (0.318) Data 0.000 (0.002) Loss 2.602 (2.460)
Epoch: [17][190/400] Time 0.315 (0.318) Data 0.000 (0.002) Loss 2.307 (2.443)
Epoch: [17][200/400] Time 0.313 (0.318) Data 0.000 (0.002) Loss 2.540 (2.432)
Epoch: [17][210/400] Time 0.314 (0.321) Data 0.000 (0.005) Loss 3.832 (2.498)
Epoch: [17][220/400] Time 0.314 (0.320) Data 0.000 (0.005) Loss 3.864 (2.575)
Epoch: [17][230/400] Time 0.317 (0.320) Data 0.000 (0.004) Loss 4.400 (2.649)
Epoch: [17][240/400] Time 0.315 (0.320) Data 0.000 (0.004) Loss 4.057 (2.708)
Epoch: [17][250/400] Time 0.313 (0.320) Data 0.000 (0.004) Loss 4.145 (2.768)
Epoch: [17][260/400] Time 0.316 (0.320) Data 0.000 (0.004) Loss 3.380 (2.815)
Epoch: [17][270/400] Time 0.316 (0.319) Data 0.000 (0.004) Loss 4.061 (2.868)
Epoch: [17][280/400] Time 0.317 (0.319) Data 0.000 (0.004) Loss 4.464 (2.919)
Epoch: [17][290/400] Time 0.314 (0.319) Data 0.000 (0.004) Loss 4.077 (2.969)
Epoch: [17][300/400] Time 0.314 (0.319) Data 0.000 (0.003) Loss 4.502 (3.017)
Epoch: [17][310/400] Time 0.315 (0.319) Data 0.000 (0.003) Loss 5.111 (3.053)
Epoch: [17][320/400] Time 0.313 (0.319) Data 0.000 (0.003) Loss 4.386 (3.095)
Epoch: [17][330/400] Time 0.313 (0.319) Data 0.000 (0.003) Loss 3.551 (3.127)
Epoch: [17][340/400] Time 0.314 (0.318) Data 0.000 (0.003) Loss 4.047 (3.152)
Epoch: [17][350/400] Time 0.312 (0.318) Data 0.000 (0.003) Loss 4.257 (3.185)
Epoch: [17][360/400] Time 0.315 (0.318) Data 0.000 (0.003) Loss 3.648 (3.213)
Epoch: [17][370/400] Time 0.315 (0.318) Data 0.000 (0.003) Loss 3.707 (3.242)
Epoch: [17][380/400] Time 0.314 (0.318) Data 0.000 (0.003) Loss 5.232 (3.271)
Epoch: [17][390/400] Time 0.314 (0.318) Data 0.000 (0.003) Loss 3.728 (3.287)
Epoch: [17][400/400] Time 0.314 (0.318) Data 0.000 (0.003) Loss 4.736 (3.308)
==> Create pseudo labels for unlabeled data
k-means time: 2 s
num_cluster 800
init---
==> Statistics for epoch 18: 800 clusters
Epoch: [18][10/400] Time 0.316 (0.356) Data 0.000 (0.041) Loss 2.731 (2.497)
Epoch: [18][20/400] Time 0.313 (0.335) Data 0.000 (0.020) Loss 2.764 (2.567)
Epoch: [18][30/400] Time 0.316 (0.329) Data 0.000 (0.014) Loss 2.160 (2.560)
Epoch: [18][40/400] Time 0.314 (0.325) Data 0.000 (0.010) Loss 2.461 (2.457)
Epoch: [18][50/400] Time 0.315 (0.323) Data 0.000 (0.008) Loss 2.449 (2.482)
Epoch: [18][60/400] Time 0.311 (0.322) Data 0.000 (0.007) Loss 1.760 (2.419)
Epoch: [18][70/400] Time 0.313 (0.321) Data 0.000 (0.006) Loss 2.254 (2.401)
Epoch: [18][80/400] Time 0.314 (0.320) Data 0.000 (0.005) Loss 2.476 (2.406)
Epoch: [18][90/400] Time 0.314 (0.319) Data 0.000 (0.005) Loss 2.164 (2.370)
Epoch: [18][100/400] Time 0.315 (0.319) Data 0.000 (0.004) Loss 2.011 (2.344)
Epoch: [18][110/400] Time 0.315 (0.318) Data 0.000 (0.004) Loss 2.581 (2.324)
Epoch: [18][120/400] Time 0.312 (0.318) Data 0.000 (0.003) Loss 1.692 (2.326)
Epoch: [18][130/400] Time 0.315 (0.318) Data 0.000 (0.003) Loss 1.959 (2.316)
Epoch: [18][140/400] Time 0.314 (0.318) Data 0.000 (0.003) Loss 2.366 (2.302)
Epoch: [18][150/400] Time 0.315 (0.318) Data 0.000 (0.003) Loss 1.715 (2.291)
Epoch: [18][160/400] Time 0.314 (0.317) Data 0.000 (0.003) Loss 3.375 (2.296)
Epoch: [18][170/400] Time 0.316 (0.317) Data 0.000 (0.002) Loss 1.318 (2.276)
Epoch: [18][180/400] Time 0.314 (0.317) Data 0.000 (0.002) Loss 1.428 (2.264)
Epoch: [18][190/400] Time 0.316 (0.317) Data 0.000 (0.002) Loss 2.062 (2.262)
Epoch: [18][200/400] Time 0.313 (0.317) Data 0.000 (0.002) Loss 2.032 (2.250)
Epoch: [18][210/400] Time 0.315 (0.320) Data 0.000 (0.005) Loss 3.214 (2.320)
Epoch: [18][220/400] Time 0.318 (0.320) Data 0.000 (0.005) Loss 4.501 (2.387)
Epoch: [18][230/400] Time 0.314 (0.320) Data 0.000 (0.005) Loss 3.782 (2.468)
Epoch: [18][240/400] Time 0.316 (0.320) Data 0.000 (0.005) Loss 4.014 (2.542)
Epoch: [18][250/400] Time 0.316 (0.320) Data 0.000 (0.005) Loss 4.527 (2.603)
Epoch: [18][260/400] Time 0.318 (0.320) Data 0.000 (0.004) Loss 5.038 (2.669)
Epoch: [18][270/400] Time 0.316 (0.319) Data 0.000 (0.004) Loss 4.359 (2.722)
Epoch: [18][280/400] Time 0.314 (0.319) Data 0.000 (0.004) Loss 4.314 (2.775)
Epoch: [18][290/400] Time 0.315 (0.319) Data 0.000 (0.004) Loss 3.864 (2.831)
Epoch: [18][300/400] Time 0.314 (0.319) Data 0.000 (0.004) Loss 4.672 (2.884)
Epoch: [18][310/400] Time 0.315 (0.319) Data 0.000 (0.004) Loss 4.529 (2.931)
Epoch: [18][320/400] Time 0.315 (0.319) Data 0.000 (0.004) Loss 4.217 (2.970)
Epoch: [18][330/400] Time 0.315 (0.319) Data 0.000 (0.004) Loss 4.639 (3.005)
Epoch: [18][340/400] Time 0.315 (0.319) Data 0.000 (0.003) Loss 3.778 (3.040)
Epoch: [18][350/400] Time 0.314 (0.319) Data 0.000 (0.003) Loss 4.845 (3.077)
Epoch: [18][360/400] Time 0.315 (0.318) Data 0.000 (0.003) Loss 4.485 (3.112)
Epoch: [18][370/400] Time 0.321 (0.318) Data 0.000 (0.003) Loss 3.721 (3.135)
Epoch: [18][380/400] Time 0.314 (0.318) Data 0.000 (0.003) Loss 3.702 (3.164)
Epoch: [18][390/400] Time 0.318 (0.318) Data 0.000 (0.003) Loss 4.470 (3.192)
Epoch: [18][400/400] Time 0.314 (0.318) Data 0.000 (0.003) Loss 4.588 (3.219)
==> Create pseudo labels for unlabeled data
k-means time: 2 s
num_cluster 800
init---
==> Statistics for epoch 19: 800 clusters
Epoch: [19][10/400] Time 0.316 (0.353) Data 0.000 (0.036) Loss 2.521 (2.265)
Epoch: [19][20/400] Time 0.315 (0.334) Data 0.000 (0.018) Loss 2.620 (2.390)
Epoch: [19][30/400] Time 0.310 (0.328) Data 0.000 (0.012) Loss 1.777 (2.431)
Epoch: [19][40/400] Time 0.314 (0.324) Data 0.000 (0.009) Loss 2.785 (2.427)
Epoch: [19][50/400] Time 0.314 (0.322) Data 0.000 (0.007) Loss 2.407 (2.460)
Epoch: [19][60/400] Time 0.314 (0.320) Data 0.000 (0.006) Loss 2.807 (2.468)
Epoch: [19][70/400] Time 0.315 (0.319) Data 0.000 (0.005) Loss 2.503 (2.470)
Epoch: [19][80/400] Time 0.314 (0.319) Data 0.000 (0.005) Loss 2.190 (2.428)
Epoch: [19][90/400] Time 0.315 (0.318) Data 0.000 (0.004) Loss 2.531 (2.459)
Epoch: [19][100/400] Time 0.315 (0.318) Data 0.000 (0.004) Loss 2.609 (2.452)
Epoch: [19][110/400] Time 0.316 (0.318) Data 0.000 (0.003) Loss 2.715 (2.437)
Epoch: [19][120/400] Time 0.315 (0.318) Data 0.000 (0.003) Loss 2.011 (2.433)
Epoch: [19][130/400] Time 0.315 (0.317) Data 0.000 (0.003) Loss 2.642 (2.418)
Epoch: [19][140/400] Time 0.313 (0.317) Data 0.000 (0.003) Loss 2.116 (2.410)
Epoch: [19][150/400] Time 0.314 (0.317) Data 0.000 (0.003) Loss 1.481 (2.411)
Epoch: [19][160/400] Time 0.316 (0.317) Data 0.000 (0.002) Loss 1.949 (2.393)
Epoch: [19][170/400] Time 0.320 (0.317) Data 0.000 (0.002) Loss 1.623 (2.385)
Epoch: [19][180/400] Time 0.316 (0.317) Data 0.000 (0.002) Loss 2.409 (2.384)
Epoch: [19][190/400] Time 0.315 (0.317) Data 0.000 (0.002) Loss 1.497 (2.385)
Epoch: [19][200/400] Time 0.314 (0.317) Data 0.000 (0.002) Loss 2.335 (2.383)
Epoch: [19][210/400] Time 0.318 (0.320) Data 0.000 (0.005) Loss 3.465 (2.443)
Epoch: [19][220/400] Time 0.317 (0.319) Data 0.000 (0.005) Loss 4.626 (2.521)
Epoch: [19][230/400] Time 0.315 (0.319) Data 0.000 (0.004) Loss 4.400 (2.594)
Epoch: [19][240/400] Time 0.316 (0.319) Data 0.000 (0.004) Loss 4.248 (2.653)
Epoch: [19][250/400] Time 0.323 (0.319) Data 0.000 (0.004) Loss 4.722 (2.720)
Epoch: [19][260/400] Time 0.316 (0.319) Data 0.000 (0.004) Loss 4.860 (2.776)
Epoch: [19][270/400] Time 0.315 (0.319) Data 0.000 (0.004) Loss 3.652 (2.827)
Epoch: [19][280/400] Time 0.316 (0.319) Data 0.000 (0.004) Loss 4.237 (2.867)
Epoch: [19][290/400] Time 0.316 (0.319) Data 0.000 (0.004) Loss 4.018 (2.909)
Epoch: [19][300/400] Time 0.315 (0.318) Data 0.000 (0.003) Loss 3.607 (2.948)
Epoch: [19][310/400] Time 0.315 (0.318) Data 0.000 (0.003) Loss 4.559 (2.981)
Epoch: [19][320/400] Time 0.314 (0.318) Data 0.000 (0.003) Loss 5.317 (3.019)
Epoch: [19][330/400] Time 0.313 (0.318) Data 0.000 (0.003) Loss 4.911 (3.057)
Epoch: [19][340/400] Time 0.316 (0.318) Data 0.000 (0.003) Loss 3.253 (3.091)
Epoch: [19][350/400] Time 0.316 (0.318) Data 0.000 (0.003) Loss 4.691 (3.125)
Epoch: [19][360/400] Time 0.315 (0.318) Data 0.000 (0.003) Loss 4.067 (3.153)
Epoch: [19][370/400] Time 0.315 (0.318) Data 0.000 (0.003) Loss 5.202 (3.188)
Epoch: [19][380/400] Time 0.314 (0.318) Data 0.000 (0.003) Loss 4.927 (3.214)
Epoch: [19][390/400] Time 0.316 (0.318) Data 0.000 (0.003) Loss 3.397 (3.237)
Epoch: [19][400/400] Time 0.316 (0.318) Data 0.000 (0.003) Loss 4.057 (3.266)
Extract Features: [50/208] Time 0.094 (0.108) Data 0.000 (0.012)
Extract Features: [100/208] Time 0.095 (0.102) Data 0.000 (0.006)
Extract Features: [150/208] Time 0.094 (0.099) Data 0.000 (0.004)
Extract Features: [200/208] Time 0.095 (0.098) Data 0.000 (0.003)
Mean AP: 43.1%
* Finished epoch 19 model mAP: 43.1% best: 43.1% *
==> Create pseudo labels for unlabeled data
k-means time: 3 s
num_cluster 800
init---
==> Statistics for epoch 20: 800 clusters
Epoch: [20][10/400] Time 0.314 (0.353) Data 0.000 (0.036) Loss 2.328 (2.632)
Epoch: [20][20/400] Time 0.315 (0.334) Data 0.000 (0.018) Loss 2.208 (2.467)
Epoch: [20][30/400] Time 0.320 (0.328) Data 0.000 (0.012) Loss 2.161 (2.422)
Epoch: [20][40/400] Time 0.314 (0.325) Data 0.000 (0.009) Loss 2.126 (2.389)
Epoch: [20][50/400] Time 0.315 (0.323) Data 0.000 (0.007) Loss 2.870 (2.380)
Epoch: [20][60/400] Time 0.316 (0.322) Data 0.000 (0.006) Loss 1.888 (2.358)
Epoch: [20][70/400] Time 0.316 (0.321) Data 0.000 (0.005) Loss 2.261 (2.344)
Epoch: [20][80/400] Time 0.316 (0.320) Data 0.000 (0.005) Loss 2.657 (2.330)
Epoch: [20][90/400] Time 0.314 (0.320) Data 0.000 (0.004) Loss 1.657 (2.339)
Epoch: [20][100/400] Time 0.315 (0.319) Data 0.000 (0.004) Loss 2.356 (2.326)
Epoch: [20][110/400] Time 0.315 (0.319) Data 0.000 (0.003) Loss 2.050 (2.322)
Epoch: [20][120/400] Time 0.317 (0.319) Data 0.000 (0.003) Loss 1.963 (2.321)
Epoch: [20][130/400] Time 0.315 (0.318) Data 0.000 (0.003) Loss 2.713 (2.288)
Epoch: [20][140/400] Time 0.315 (0.318) Data 0.000 (0.003) Loss 2.937 (2.276)
Epoch: [20][150/400] Time 0.314 (0.318) Data 0.000 (0.003) Loss 2.050 (2.247)
Epoch: [20][160/400] Time 0.316 (0.318) Data 0.000 (0.002) Loss 1.964 (2.229)
Epoch: [20][170/400] Time 0.315 (0.318) Data 0.000 (0.002) Loss 2.203 (2.208)
Epoch: [20][180/400] Time 0.314 (0.318) Data 0.000 (0.002) Loss 1.828 (2.194)
Epoch: [20][190/400] Time 0.314 (0.318) Data 0.000 (0.002) Loss 2.018 (2.176)
Epoch: [20][200/400] Time 0.313 (0.317) Data 0.000 (0.002) Loss 2.649 (2.163)
Epoch: [20][210/400] Time 0.315 (0.321) Data 0.000 (0.005) Loss 4.326 (2.271)
Epoch: [20][220/400] Time 0.314 (0.320) Data 0.000 (0.005) Loss 3.556 (2.338)
Epoch: [20][230/400] Time 0.315 (0.320) Data 0.000 (0.005) Loss 3.701 (2.430)
Epoch: [20][240/400] Time 0.317 (0.320) Data 0.000 (0.004) Loss 4.122 (2.495)
Epoch: [20][250/400] Time 0.314 (0.320) Data 0.000 (0.004) Loss 3.146 (2.555)
Epoch: [20][260/400] Time 0.316 (0.320) Data 0.000 (0.004) Loss 3.599 (2.608)
Epoch: [20][270/400] Time 0.317 (0.320) Data 0.000 (0.004) Loss 4.919 (2.677)
Epoch: [20][280/400] Time 0.315 (0.319) Data 0.000 (0.004) Loss 5.034 (2.732)
Epoch: [20][290/400] Time 0.316 (0.319) Data 0.000 (0.004) Loss 4.092 (2.782)
Epoch: [20][300/400] Time 0.313 (0.319) Data 0.000 (0.004) Loss 4.559 (2.829)
Epoch: [20][310/400] Time 0.316 (0.319) Data 0.000 (0.003) Loss 4.131 (2.865)
Epoch: [20][320/400] Time 0.316 (0.319) Data 0.000 (0.003) Loss 4.266 (2.895)
Epoch: [20][330/400] Time 0.315 (0.319) Data 0.000 (0.003) Loss 4.115 (2.931)
Epoch: [20][340/400] Time 0.315 (0.319) Data 0.000 (0.003) Loss 4.291 (2.962)
Epoch: [20][350/400] Time 0.317 (0.319) Data 0.000 (0.003) Loss 3.378 (2.990)
Epoch: [20][360/400] Time 0.314 (0.319) Data 0.000 (0.003) Loss 4.683 (3.023)
Epoch: [20][370/400] Time 0.317 (0.318) Data 0.000 (0.003) Loss 4.824 (3.059)
Epoch: [20][380/400] Time 0.315 (0.318) Data 0.000 (0.003) Loss 3.119 (3.078)
Epoch: [20][390/400] Time 0.315 (0.318) Data 0.000 (0.003) Loss 3.980 (3.104)
Epoch: [20][400/400] Time 0.313 (0.318) Data 0.000 (0.003) Loss 3.770 (3.125)
==> Create pseudo labels for unlabeled data
k-means time: 2 s
num_cluster 800
init---
==> Statistics for epoch 21: 800 clusters
Epoch: [21][10/400] Time 0.316 (0.353) Data 0.000 (0.037) Loss 1.630 (2.103)
Epoch: [21][20/400] Time 0.314 (0.334) Data 0.000 (0.019) Loss 2.467 (2.200)
Epoch: [21][30/400] Time 0.315 (0.328) Data 0.000 (0.012) Loss 1.976 (2.184)
Epoch: [21][40/400] Time 0.315 (0.325) Data 0.000 (0.009) Loss 2.321 (2.158)
Epoch: [21][50/400] Time 0.314 (0.323) Data 0.000 (0.008) Loss 2.457 (2.187)
Epoch: [21][60/400] Time 0.316 (0.321) Data 0.000 (0.006) Loss 2.402 (2.197)
Epoch: [21][70/400] Time 0.315 (0.321) Data 0.000 (0.005) Loss 2.440 (2.197)
Epoch: [21][80/400] Time 0.315 (0.320) Data 0.000 (0.005) Loss 2.373 (2.189)
Epoch: [21][90/400] Time 0.315 (0.320) Data 0.000 (0.004) Loss 1.667 (2.167)
Epoch: [21][100/400] Time 0.315 (0.319) Data 0.000 (0.004) Loss 1.945 (2.141)
Epoch: [21][110/400] Time 0.318 (0.319) Data 0.000 (0.003) Loss 2.230 (2.126)
Epoch: [21][120/400] Time 0.316 (0.319) Data 0.000 (0.003) Loss 1.496 (2.132)
Epoch: [21][130/400] Time 0.315 (0.318) Data 0.000 (0.003) Loss 2.075 (2.121)
Epoch: [21][140/400] Time 0.315 (0.318) Data 0.000 (0.003) Loss 1.895 (2.101)
Epoch: [21][150/400] Time 0.314 (0.318) Data 0.000 (0.003) Loss 1.848 (2.087)
Epoch: [21][160/400] Time 0.316 (0.318) Data 0.000 (0.002) Loss 1.713 (2.083)
Epoch: [21][170/400] Time 0.315 (0.318) Data 0.000 (0.002) Loss 2.087 (2.069)
Epoch: [21][180/400] Time 0.315 (0.317) Data 0.000 (0.002) Loss 2.025 (2.067)
Epoch: [21][190/400] Time 0.315 (0.317) Data 0.000 (0.002) Loss 2.054 (2.065)