https://arxiv.org/abs/2012.14116
Syntax-Enhanced Pre-trained Model (Zenan Xu, Daya Guo, Duyu Tang, Qinliang Su, Linjun Shou, Ming Gong, Wanjun Zhong, Xiaojun Quan, Nan Duan, Daxin Jiang)
syntax 트리를 결합한 트랜스포머 프리트레이닝 & 파인튜닝.
#pretraining #language_model #syntax