200412 Pre-training Text Representations as Meta Learning.md

https://arxiv.org/abs/2004.05568

Pre-training Text Representations as Meta Learning (Shangwen Lv, Yuechen Wang, Daya Guo, Duyu Tang, Nan Duan, Fuqing Zhu, Ming Gong, Linjun Shou, Ryan Ma, Daxin Jiang, Guihong Cao, Ming Zhou, Songlin Hu)

text 프리트레이닝을 각 파인튜닝 과제에 대한 메타러닝으로 접근하기. 자연스러운 발전 방향일지도.

#meta_learning #pretraining #finetuning