201021 Self-training and Pre-training are Complementary for Speech Recognition.md

https://arxiv.org/abs/2010.11430

Self-training and Pre-training are Complementary for Speech Recognition (Qiantong Xu, Alexei Baevski, Tatiana Likhomanenko, Paden Tomasello, Alexis Conneau, Ronan Collobert, Gabriel Synnaeve, Michael Auli)

페북에서도 self training과 pretraining을 조합해서 asr을 깬 결과를 보고. 오디오 업계도 대-unsupervised & semisupervised learning의 시대?

#self_supervised #pretraining #asr