https://arxiv.org/abs/2012.11552
Online Bag-of-Visual-Words Generation for Unsupervised Representation Learning (Spyros Gidaris, Andrei Bursuc, Gilles Puy, Nikos Komodakis, Matthieu Cord, Patrick Pérez)
vq-vae처럼 teacher의 feature를 quantize해서 visual bag-of-words를 만든 다음 student가 이를 예측하도록 만들어서 representation learning.
#contrastive_learning #self_supervised #discrete_vae